[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:07.042850 20756 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.69.62:38109
I20260709 13:05:07.044332 20756 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:07.045426 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.062983 20763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.062999 20765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.065356 20756 server_base.cc:1061] running on GCE node
W20260709 13:05:07.063006 20762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.275844 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:08.276124 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:08.276386 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602308276362 us; error 0 us; skew 500 ppm
I20260709 13:05:08.277348 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:08.282924 20756 webserver.cc:533] Webserver started at http://127.20.69.62:39673/ using document root <none> and password file <none>
I20260709 13:05:08.283878 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:08.284126 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:08.284673 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:08.290650 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/master-0-root/instance:
uuid: "3d4d29c6015d45b887cc41223332693b"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-56lb"
I20260709 13:05:08.299214 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:05:08.305066 20771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.306360 20756 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:08.306792 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/master-0-root
uuid: "3d4d29c6015d45b887cc41223332693b"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-56lb"
I20260709 13:05:08.307173 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:08.370154 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:08.371790 20756 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:08.372278 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:08.445590 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.62:38109
I20260709 13:05:08.445665 20822 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.62:38109 every 8 connection(s)
I20260709 13:05:08.453780 20823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.476380 20823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b: Bootstrap starting.
I20260709 13:05:08.482856 20823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.485026 20823 log.cc:826] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:08.489966 20823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b: No bootstrap required, opened a new log
I20260709 13:05:08.510677 20823 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4d29c6015d45b887cc41223332693b" member_type: VOTER }
I20260709 13:05:08.511238 20823 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.511441 20823 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d4d29c6015d45b887cc41223332693b, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.512421 20823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4d29c6015d45b887cc41223332693b" member_type: VOTER }
I20260709 13:05:08.512940 20823 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:08.513211 20823 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:08.513518 20823 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.517707 20823 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4d29c6015d45b887cc41223332693b" member_type: VOTER }
I20260709 13:05:08.518460 20823 leader_election.cc:304] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d4d29c6015d45b887cc41223332693b; no voters: 
I20260709 13:05:08.520219 20823 leader_election.cc:290] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:08.520740 20826 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.523627 20826 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 1 LEADER]: Becoming Leader. State: Replica: 3d4d29c6015d45b887cc41223332693b, State: Running, Role: LEADER
I20260709 13:05:08.524789 20826 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4d29c6015d45b887cc41223332693b" member_type: VOTER }
I20260709 13:05:08.526037 20823 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:08.536863 20827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d4d29c6015d45b887cc41223332693b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4d29c6015d45b887cc41223332693b" member_type: VOTER } }
I20260709 13:05:08.536979 20828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d4d29c6015d45b887cc41223332693b. Latest consensus state: current_term: 1 leader_uuid: "3d4d29c6015d45b887cc41223332693b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d4d29c6015d45b887cc41223332693b" member_type: VOTER } }
I20260709 13:05:08.537879 20827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:08.537993 20828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:08.541539 20835 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:08.553778 20835 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:08.561779 20756 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:08.573774 20835 catalog_manager.cc:1383] Generated new cluster ID: c5e3cd5991bb492ba71960b3b4237d5f
I20260709 13:05:08.574080 20835 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:08.598416 20835 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:08.600245 20835 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:08.621978 20835 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b: Generated new TSK 0
I20260709 13:05:08.622994 20835 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:08.629309 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:08.638285 20845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.639302 20846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.644156 20756 server_base.cc:1061] running on GCE node
W20260709 13:05:08.644152 20849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.645220 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:08.645416 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:08.645640 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602308645606 us; error 0 us; skew 500 ppm
I20260709 13:05:08.646267 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:08.650597 20756 webserver.cc:533] Webserver started at http://127.20.69.1:34053/ using document root <none> and password file <none>
I20260709 13:05:08.651168 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:08.651396 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:08.651685 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:08.652974 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-0-root/instance:
uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-56lb"
I20260709 13:05:08.658617 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:08.662962 20853 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.663978 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:05:08.664347 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-56lb"
I20260709 13:05:08.664841 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:08.702618 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:08.704078 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:08.706640 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:08.711848 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:08.712134 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.712421 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:08.712630 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.809514 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:43547
I20260709 13:05:08.809666 20915 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:43547 every 8 connection(s)
I20260709 13:05:08.817049 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:08.827411 20920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.831190 20921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.843175 20756 server_base.cc:1061] running on GCE node
I20260709 13:05:08.843930 20916 heartbeater.cc:344] Connected to a master server at 127.20.69.62:38109
I20260709 13:05:08.844470 20916 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:08.845661 20923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.845789 20916 heartbeater.cc:507] Master 127.20.69.62:38109 requested a full tablet report, sending...
I20260709 13:05:08.846946 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:08.847450 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:08.847723 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602308847702 us; error 0 us; skew 500 ppm
I20260709 13:05:08.848435 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:08.849440 20788 ts_manager.cc:194] Registered new tserver with Master: 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547)
I20260709 13:05:08.852404 20788 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37926
I20260709 13:05:08.856984 20756 webserver.cc:533] Webserver started at http://127.20.69.2:35491/ using document root <none> and password file <none>
I20260709 13:05:08.857546 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:08.857750 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:08.858047 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:08.859140 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-1-root/instance:
uuid: "a00abf1541f045ef8609dc0c9c56be36"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-56lb"
I20260709 13:05:08.864729 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:05:08.869895 20928 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.870788 20756 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:05:08.871112 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-1-root
uuid: "a00abf1541f045ef8609dc0c9c56be36"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-56lb"
I20260709 13:05:08.871425 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:08.889230 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:08.890499 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:08.892714 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:08.895567 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:08.895802 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.896059 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:08.896230 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.990828 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.2:42817
I20260709 13:05:08.990988 20990 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.2:42817 every 8 connection(s)
I20260709 13:05:08.998292 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:09.006260 20994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:09.014840 20995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:09.015450 20991 heartbeater.cc:344] Connected to a master server at 127.20.69.62:38109
I20260709 13:05:09.015493 20756 server_base.cc:1061] running on GCE node
I20260709 13:05:09.015924 20991 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:09.016848 20997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:09.017006 20991 heartbeater.cc:507] Master 127.20.69.62:38109 requested a full tablet report, sending...
I20260709 13:05:09.018060 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:09.018400 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:09.018616 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602309018594 us; error 0 us; skew 500 ppm
I20260709 13:05:09.019253 20788 ts_manager.cc:194] Registered new tserver with Master: a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:09.019364 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:09.021011 20788 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37934
I20260709 13:05:09.022522 20756 webserver.cc:533] Webserver started at http://127.20.69.3:36921/ using document root <none> and password file <none>
I20260709 13:05:09.023169 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:09.023427 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:09.023748 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:09.025272 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-2-root/instance:
uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
format_stamp: "Formatted at 2026-07-09 13:05:09 on dist-test-slave-56lb"
I20260709 13:05:09.031104 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:09.035583 21002 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:09.036573 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:09.036988 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-2-root
uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
format_stamp: "Formatted at 2026-07-09 13:05:09 on dist-test-slave-56lb"
I20260709 13:05:09.037364 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602306874617-20756-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:09.066514 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:09.068135 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:09.069828 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:09.073647 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:09.073947 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:09.074237 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:09.074437 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:09.161659 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.3:44779
I20260709 13:05:09.161885 21064 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.3:44779 every 8 connection(s)
I20260709 13:05:09.178344 21065 heartbeater.cc:344] Connected to a master server at 127.20.69.62:38109
I20260709 13:05:09.178745 21065 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:09.179553 21065 heartbeater.cc:507] Master 127.20.69.62:38109 requested a full tablet report, sending...
I20260709 13:05:09.181540 20788 ts_manager.cc:194] Registered new tserver with Master: 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:09.181736 20756 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01236682s
I20260709 13:05:09.182917 20788 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37936
I20260709 13:05:09.236873 20788 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37950:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:09.240720 20788 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:09.360785 20954 tablet_service.cc:1511] Processing CreateTablet for tablet aa10d1f4f0424a628ccf25828250db75 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:09.362331 20953 tablet_service.cc:1511] Processing CreateTablet for tablet 905bf4fa78f24c14b6b49baa0f13df43 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:09.363866 20956 tablet_service.cc:1511] Processing CreateTablet for tablet acccd54ce09c4f69840b3b1f3abb77ec (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:09.363867 20954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa10d1f4f0424a628ccf25828250db75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.365914 20952 tablet_service.cc:1511] Processing CreateTablet for tablet d96a051abc604b07b8932e56a0825414 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:09.367803 20955 tablet_service.cc:1511] Processing CreateTablet for tablet b2575610c4604ceb82419f6bf47acc9b (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:09.381567 20956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acccd54ce09c4f69840b3b1f3abb77ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.380765 21030 tablet_service.cc:1511] Processing CreateTablet for tablet acccd54ce09c4f69840b3b1f3abb77ec (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:09.389942 20953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905bf4fa78f24c14b6b49baa0f13df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.390753 21030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acccd54ce09c4f69840b3b1f3abb77ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.397058 20952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96a051abc604b07b8932e56a0825414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.399206 20879 tablet_service.cc:1511] Processing CreateTablet for tablet aa10d1f4f0424a628ccf25828250db75 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:09.396100 20878 tablet_service.cc:1511] Processing CreateTablet for tablet 905bf4fa78f24c14b6b49baa0f13df43 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:09.406953 20955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2575610c4604ceb82419f6bf47acc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.398871 20881 tablet_service.cc:1511] Processing CreateTablet for tablet acccd54ce09c4f69840b3b1f3abb77ec (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:09.397419 21029 tablet_service.cc:1511] Processing CreateTablet for tablet b2575610c4604ceb82419f6bf47acc9b (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:09.405500 20880 tablet_service.cc:1511] Processing CreateTablet for tablet b2575610c4604ceb82419f6bf47acc9b (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:09.405550 20876 tablet_service.cc:1511] Processing CreateTablet for tablet 7eceed2523ae416aa7c7781653e88593 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:09.403030 20951 tablet_service.cc:1511] Processing CreateTablet for tablet 7eceed2523ae416aa7c7781653e88593 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:09.403450 20877 tablet_service.cc:1511] Processing CreateTablet for tablet d96a051abc604b07b8932e56a0825414 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:09.415452 20951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eceed2523ae416aa7c7781653e88593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.417778 20878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905bf4fa78f24c14b6b49baa0f13df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.419029 21026 tablet_service.cc:1511] Processing CreateTablet for tablet d96a051abc604b07b8932e56a0825414 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:09.419224 20875 tablet_service.cc:1511] Processing CreateTablet for tablet 838c1f51e25a4ccdb9ba4d3ab7fd63e8 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:09.420385 21029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2575610c4604ceb82419f6bf47acc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.422605 21028 tablet_service.cc:1511] Processing CreateTablet for tablet aa10d1f4f0424a628ccf25828250db75 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:09.426935 21025 tablet_service.cc:1511] Processing CreateTablet for tablet 7eceed2523ae416aa7c7781653e88593 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:09.430488 21028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa10d1f4f0424a628ccf25828250db75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.434015 20950 tablet_service.cc:1511] Processing CreateTablet for tablet 838c1f51e25a4ccdb9ba4d3ab7fd63e8 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:09.435530 20950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838c1f51e25a4ccdb9ba4d3ab7fd63e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.425565 21027 tablet_service.cc:1511] Processing CreateTablet for tablet 905bf4fa78f24c14b6b49baa0f13df43 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:09.440171 21026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96a051abc604b07b8932e56a0825414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.437858 20881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acccd54ce09c4f69840b3b1f3abb77ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.445552 21024 tablet_service.cc:1511] Processing CreateTablet for tablet 838c1f51e25a4ccdb9ba4d3ab7fd63e8 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:09.455724 20874 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9166d7d114455cb73fd4861d14f1c0 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:09.458496 21027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905bf4fa78f24c14b6b49baa0f13df43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.466473 21025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eceed2523ae416aa7c7781653e88593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.468204 20949 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9166d7d114455cb73fd4861d14f1c0 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:09.470662 20949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9166d7d114455cb73fd4861d14f1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.473652 20877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96a051abc604b07b8932e56a0825414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.475402 20875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838c1f51e25a4ccdb9ba4d3ab7fd63e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.475479 21024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 838c1f51e25a4ccdb9ba4d3ab7fd63e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.478492 20874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9166d7d114455cb73fd4861d14f1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.486163 20879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa10d1f4f0424a628ccf25828250db75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.507893 20880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2575610c4604ceb82419f6bf47acc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.563163 21023 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9166d7d114455cb73fd4861d14f1c0 (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:09.565042 21023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9166d7d114455cb73fd4861d14f1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.568358 21083 tablet_bootstrap.cc:492] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:09.582446 20876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eceed2523ae416aa7c7781653e88593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.586249 20873 tablet_service.cc:1511] Processing CreateTablet for tablet b100f77bb0514dcd86148e34472f6bda (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 13:05:09.591118 20836 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:09.605221 20873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b100f77bb0514dcd86148e34472f6bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.649319 20952 tablet_service.cc:1511] Processing CreateTablet for tablet b100f77bb0514dcd86148e34472f6bda (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:09.653625 20952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b100f77bb0514dcd86148e34472f6bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.654197 21028 tablet_service.cc:1511] Processing CreateTablet for tablet b100f77bb0514dcd86148e34472f6bda (DEFAULT_TABLE table=test-workload [id=26e9b92df3ef4ddab37cc6edb939f16a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:09.656116 21028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b100f77bb0514dcd86148e34472f6bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.658263 21084 tablet_bootstrap.cc:492] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:09.684656 21083 tablet_bootstrap.cc:654] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.709406 21085 tablet_bootstrap.cc:492] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:09.722615 21084 tablet_bootstrap.cc:654] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.727056 21083 tablet_bootstrap.cc:492] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:09.732574 21083 ts_tablet_manager.cc:1403] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.170s	user 0.018s	sys 0.000s
I20260709 13:05:09.738758 21083 raft_consensus.cc:359] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:09.743871 21083 raft_consensus.cc:385] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.744199 21083 raft_consensus.cc:740] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.746992 21085 tablet_bootstrap.cc:654] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.747735 21083 consensus_queue.cc:260] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:09.751438 21084 tablet_bootstrap.cc:492] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:09.752070 21084 ts_tablet_manager.cc:1403] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.015s
I20260709 13:05:09.755918 21084 raft_consensus.cc:359] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.756561 21065 heartbeater.cc:499] Master 127.20.69.62:38109 was elected leader, sending a full tablet report...
I20260709 13:05:09.756678 21084 raft_consensus.cc:385] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.757063 21084 raft_consensus.cc:740] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.757787 21083 ts_tablet_manager.cc:1434] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.009s
I20260709 13:05:09.758836 21083 tablet_bootstrap.cc:492] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:09.762377 21084 consensus_queue.cc:260] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.767302 21083 tablet_bootstrap.cc:654] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.778174 20991 heartbeater.cc:499] Master 127.20.69.62:38109 was elected leader, sending a full tablet report...
I20260709 13:05:09.778779 21084 ts_tablet_manager.cc:1434] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.020s
I20260709 13:05:09.779384 21085 tablet_bootstrap.cc:492] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:09.779870 21085 ts_tablet_manager.cc:1403] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.101s	user 0.005s	sys 0.013s
I20260709 13:05:09.780099 21084 tablet_bootstrap.cc:492] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:09.783347 21085 raft_consensus.cc:359] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:09.784111 21085 raft_consensus.cc:385] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.784420 21085 raft_consensus.cc:740] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.785233 21085 consensus_queue.cc:260] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:09.789676 21084 tablet_bootstrap.cc:654] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.796453 21083 tablet_bootstrap.cc:492] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:09.797142 21083 ts_tablet_manager.cc:1403] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.011s
I20260709 13:05:09.800458 21083 raft_consensus.cc:359] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.801765 21083 raft_consensus.cc:385] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.802098 21084 tablet_bootstrap.cc:492] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:09.802264 21083 raft_consensus.cc:740] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.802655 21084 ts_tablet_manager.cc:1403] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 13:05:09.803503 21083 consensus_queue.cc:260] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.809314 20916 heartbeater.cc:499] Master 127.20.69.62:38109 was elected leader, sending a full tablet report...
I20260709 13:05:09.806250 21085 ts_tablet_manager.cc:1434] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 13:05:09.810526 21085 tablet_bootstrap.cc:492] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:09.810724 21083 ts_tablet_manager.cc:1434] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:05:09.811713 21083 tablet_bootstrap.cc:492] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:09.806373 21084 raft_consensus.cc:359] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
W20260709 13:05:09.818641 20917 tablet.cc:2406] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:09.826306 21084 raft_consensus.cc:385] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.826756 21084 raft_consensus.cc:740] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.827677 21084 consensus_queue.cc:260] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.830132 21084 ts_tablet_manager.cc:1434] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.006s
I20260709 13:05:09.831270 21084 tablet_bootstrap.cc:492] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:09.832634 21083 tablet_bootstrap.cc:654] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.833154 21085 tablet_bootstrap.cc:654] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.838322 21084 tablet_bootstrap.cc:654] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.849104 21083 tablet_bootstrap.cc:492] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:09.849731 21083 ts_tablet_manager.cc:1403] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.001s
I20260709 13:05:09.852246 21085 tablet_bootstrap.cc:492] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:09.852845 21085 ts_tablet_manager.cc:1403] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.008s
I20260709 13:05:09.854724 21083 raft_consensus.cc:359] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.855568 21083 raft_consensus.cc:385] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.855880 21083 raft_consensus.cc:740] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.856649 21083 consensus_queue.cc:260] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.857084 21085 raft_consensus.cc:359] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.858210 21085 raft_consensus.cc:385] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.858513 21085 raft_consensus.cc:740] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.859246 21085 consensus_queue.cc:260] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.861757 21083 ts_tablet_manager.cc:1434] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:05:09.862581 21085 ts_tablet_manager.cc:1434] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:09.862761 21083 tablet_bootstrap.cc:492] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:09.863528 21085 tablet_bootstrap.cc:492] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:09.885200 21088 raft_consensus.cc:493] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.885922 21088 raft_consensus.cc:515] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.889413 21088 leader_election.cc:290] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:09.889523 21083 tablet_bootstrap.cc:654] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.897173 21084 tablet_bootstrap.cc:492] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:09.898981 21084 ts_tablet_manager.cc:1403] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.009s
I20260709 13:05:09.900231 21085 tablet_bootstrap.cc:654] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.900849 21083 tablet_bootstrap.cc:492] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:09.901328 21083 ts_tablet_manager.cc:1403] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.005s
I20260709 13:05:09.903570 21084 raft_consensus.cc:359] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.904333 21083 raft_consensus.cc:359] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.906595 21085 tablet_bootstrap.cc:492] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:09.907609 21083 raft_consensus.cc:385] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.907704 21084 raft_consensus.cc:385] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.907821 21085 ts_tablet_manager.cc:1403] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.019s
I20260709 13:05:09.907953 21083 raft_consensus.cc:740] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.908926 21084 raft_consensus.cc:740] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.909750 21083 consensus_queue.cc:260] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.910975 21084 consensus_queue.cc:260] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.912278 21085 raft_consensus.cc:359] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.913064 21085 raft_consensus.cc:385] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.913355 21085 raft_consensus.cc:740] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.914089 21085 consensus_queue.cc:260] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.916478 21085 ts_tablet_manager.cc:1434] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:09.917487 21085 tablet_bootstrap.cc:492] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:09.917608 21083 ts_tablet_manager.cc:1434] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:05:09.918669 21083 tablet_bootstrap.cc:492] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:09.923893 21084 ts_tablet_manager.cc:1434] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:05:09.926414 21085 tablet_bootstrap.cc:654] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.929492 21083 tablet_bootstrap.cc:654] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.937713 21084 tablet_bootstrap.cc:492] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:09.940148 21085 tablet_bootstrap.cc:492] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:09.940570 21085 ts_tablet_manager.cc:1403] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 13:05:09.941476 21092 raft_consensus.cc:493] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.941980 21092 raft_consensus.cc:515] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.944679 21092 leader_election.cc:290] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:09.951884 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:09.952360 21083 tablet_bootstrap.cc:492] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:09.952863 21083 ts_tablet_manager.cc:1403] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.001s
I20260709 13:05:09.952800 20966 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:09.960544 21084 tablet_bootstrap.cc:654] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.961354 21003 leader_election.cc:304] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:09.964162 21088 raft_consensus.cc:2804] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.964735 21088 raft_consensus.cc:493] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.965229 21088 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.970484 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:09.971946 20891 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:09.972834 21083 raft_consensus.cc:359] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.975903 21090 raft_consensus.cc:493] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.977751 21090 raft_consensus.cc:515] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.978989 21083 raft_consensus.cc:385] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.975332 21085 raft_consensus.cc:359] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.982226 21085 raft_consensus.cc:385] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.982098 21083 raft_consensus.cc:740] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.985057 21085 raft_consensus.cc:740] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.985458 21090 leader_election.cc:290] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:09.987104 21085 consensus_queue.cc:260] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:09.988390 21083 consensus_queue.cc:260] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.010640 21085 ts_tablet_manager.cc:1434] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.002s
I20260709 13:05:10.003944 21088 raft_consensus.cc:515] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.020891 21085 tablet_bootstrap.cc:492] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:10.042143 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:10.043119 20891 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.045732 21088 leader_election.cc:290] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:10.046507 21088 raft_consensus.cc:493] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.046945 21088 raft_consensus.cc:515] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.050770 21088 leader_election.cc:290] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:10.058534 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.059800 20890 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.064281 21084 tablet_bootstrap.cc:492] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:10.064231 21004 leader_election.cc:304] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.064940 21084 ts_tablet_manager.cc:1403] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.011s
I20260709 13:05:10.069097 21112 raft_consensus.cc:2804] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.070250 21112 raft_consensus.cc:493] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.070611 21112 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.076377 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
I20260709 13:05:10.074483 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.071908 21084 raft_consensus.cc:359] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.085038 21084 raft_consensus.cc:385] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.084307 21083 ts_tablet_manager.cc:1434] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.131s	user 0.013s	sys 0.010s
I20260709 13:05:10.082743 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96a051abc604b07b8932e56a0825414" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.088829 21084 raft_consensus.cc:740] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.089558 21083 tablet_bootstrap.cc:492] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:10.087934 20891 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.092221 21004 leader_election.cc:304] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.093096 21085 tablet_bootstrap.cc:654] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:10.092933 20930 leader_election.cc:343] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.093358 21088 raft_consensus.cc:2804] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.089706 21084 consensus_queue.cc:260] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.093837 21088 raft_consensus.cc:697] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:10.095011 21112 raft_consensus.cc:515] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.096552 20966 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 0.
I20260709 13:05:10.097326 21040 raft_consensus.cc:2393] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02d70c63ce4f4f7c819cf745c493f2ca in current term 1: Already voted for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in this term.
I20260709 13:05:10.096858 21088 consensus_queue.cc:237] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.108846 21090 raft_consensus.cc:493] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.117710 20854 leader_election.cc:304] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:10.109804 21090 raft_consensus.cc:515] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.120537 21092 raft_consensus.cc:2804] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.123557 21092 raft_consensus.cc:493] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.124054 21092 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.142948 21112 leader_election.cc:290] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:10.142956 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:10.144131 21112 raft_consensus.cc:493] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.151046 21090 leader_election.cc:290] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.150756 21112 raft_consensus.cc:515] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.153321 21088 raft_consensus.cc:493] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.156085 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.155860 21088 raft_consensus.cc:515] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:10.154311 21084 ts_tablet_manager.cc:1434] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.001s
I20260709 13:05:10.161123 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.157747 21112 leader_election.cc:290] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
W20260709 13:05:10.162801 20930 leader_election.cc:343] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:10.163268 21004 leader_election.cc:343] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.170895 21084 tablet_bootstrap.cc:492] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:10.169701 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:10.176455 21092 raft_consensus.cc:515] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.177628 20891 raft_consensus.cc:2393] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in current term 1: Already voted for candidate 02d70c63ce4f4f7c819cf745c493f2ca in this term.
I20260709 13:05:10.169135 20965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.178936 20966 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.178972 20965 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.181408 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:10.182612 20964 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.169000 20786 catalog_manager.cc:5697] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.184985 21116 raft_consensus.cc:493] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.186072 20963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.186296 20965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:10.192633 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:10.194366 21040 raft_consensus.cc:2393] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 02d70c63ce4f4f7c819cf745c493f2ca in current term 1: Already voted for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in this term.
I20260709 13:05:10.190241 21092 leader_election.cc:290] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.185499 21116 raft_consensus.cc:515] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
W20260709 13:05:10.198608 21003 leader_election.cc:343] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.198781 21088 leader_election.cc:290] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547)
I20260709 13:05:10.199152 21003 leader_election.cc:304] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:10.200162 21088 raft_consensus.cc:2749] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.202281 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.202997 20891 raft_consensus.cc:2468] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.204648 21004 leader_election.cc:304] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.205523 21088 raft_consensus.cc:2804] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.206030 21088 raft_consensus.cc:493] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.206480 21088 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.198479 20965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.210587 20964 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 1.
I20260709 13:05:10.212117 20854 leader_election.cc:304] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:10.213330 21092 raft_consensus.cc:2804] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.229686 20966 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.230237 21088 raft_consensus.cc:515] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:10.233291 21088 leader_election.cc:290] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547)
I20260709 13:05:10.239514 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
I20260709 13:05:10.240473 21040 raft_consensus.cc:2393] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02d70c63ce4f4f7c819cf745c493f2ca in current term 1: Already voted for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in this term.
I20260709 13:05:10.241291 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
W20260709 13:05:10.260460 21003 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:42817, user_credentials={real_user=slave}} blocked reactor thread for 62461.7us
I20260709 13:05:10.259694 21116 leader_election.cc:290] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
W20260709 13:05:10.261854 20854 leader_election.cc:343] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.262295 21092 raft_consensus.cc:697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:10.262565 20854 leader_election.cc:304] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca; no voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:10.271276 21116 raft_consensus.cc:493] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.272019 21116 raft_consensus.cc:515] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.276724 21116 leader_election.cc:290] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.277420 21116 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.263417 21092 consensus_queue.cc:237] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.261902 21003 leader_election.cc:304] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:10.285861 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b100f77bb0514dcd86148e34472f6bda" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
I20260709 13:05:10.288725 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b100f77bb0514dcd86148e34472f6bda" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.288656 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:10.289477 21088 raft_consensus.cc:2749] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:05:10.291600 20856 leader_election.cc:343] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.292013 21084 tablet_bootstrap.cc:654] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:10.292650 20854 leader_election.cc:343] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:10.293851 21003 leader_election.cc:343] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.294130 20854 leader_election.cc:304] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca; no voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:10.297796 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:10.294890 21083 tablet_bootstrap.cc:654] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.301323 21088 raft_consensus.cc:493] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.310617 21122 raft_consensus.cc:2749] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.311669 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96a051abc604b07b8932e56a0825414" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
I20260709 13:05:10.305706 21088 raft_consensus.cc:515] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.314580 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
I20260709 13:05:10.316696 21040 raft_consensus.cc:2468] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 0.
W20260709 13:05:10.313625 21003 leader_election.cc:343] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.318578 21088 leader_election.cc:290] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
W20260709 13:05:10.320926 20931 leader_election.cc:343] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.321002 21085 tablet_bootstrap.cc:492] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:10.324151 21085 ts_tablet_manager.cc:1403] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.312s	user 0.012s	sys 0.012s
I20260709 13:05:10.324339 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96a051abc604b07b8932e56a0825414" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.324210 20787 catalog_manager.cc:5697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 1 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:10.326401 21004 leader_election.cc:343] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.323715 20931 leader_election.cc:304] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a00abf1541f045ef8609dc0c9c56be36; no voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:10.328786 20931 leader_election.cc:304] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:10.329823 21090 raft_consensus.cc:2749] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.329965 21085 raft_consensus.cc:359] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.330531 21090 raft_consensus.cc:2804] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.330785 21085 raft_consensus.cc:385] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.330919 21090 raft_consensus.cc:493] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.331128 21085 raft_consensus.cc:740] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.331315 21090 raft_consensus.cc:3060] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.331573 21116 raft_consensus.cc:2749] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.336560 21085 consensus_queue.cc:260] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.341110 21085 ts_tablet_manager.cc:1434] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:05:10.342635 21085 tablet_bootstrap.cc:492] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:10.342319 21090 raft_consensus.cc:515] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.345194 20891 raft_consensus.cc:2468] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.345309 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96a051abc604b07b8932e56a0825414" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:10.347479 21004 leader_election.cc:304] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:10.348420 21088 raft_consensus.cc:2804] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:10.346953 20930 leader_election.cc:343] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.349328 21088 raft_consensus.cc:697] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:10.350596 21084 tablet_bootstrap.cc:492] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:10.350246 21088 consensus_queue.cc:237] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:10.351754 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96a051abc604b07b8932e56a0825414" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.352285 21090 leader_election.cc:290] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.352991 20964 raft_consensus.cc:2393] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in current term 1: Already voted for candidate a00abf1541f045ef8609dc0c9c56be36 in this term.
I20260709 13:05:10.353724 21084 ts_tablet_manager.cc:1403] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.183s	user 0.018s	sys 0.017s
I20260709 13:05:10.355775 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96a051abc604b07b8932e56a0825414" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:10.358022 21003 leader_election.cc:304] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:10.359856 21039 raft_consensus.cc:3060] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.367377 21083 tablet_bootstrap.cc:492] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:10.367909 21083 ts_tablet_manager.cc:1403] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.279s	user 0.014s	sys 0.008s
I20260709 13:05:10.371655 21083 raft_consensus.cc:359] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.372391 21083 raft_consensus.cc:385] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.372545 21039 raft_consensus.cc:2468] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 1.
I20260709 13:05:10.372920 21083 raft_consensus.cc:740] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.372458 21084 raft_consensus.cc:359] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.373812 21084 raft_consensus.cc:385] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.373710 21083 consensus_queue.cc:260] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.374006 20931 leader_election.cc:304] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:10.374289 21084 raft_consensus.cc:740] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.374751 21088 raft_consensus.cc:2749] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.375149 21090 raft_consensus.cc:2804] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.376221 21090 raft_consensus.cc:697] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 1 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:10.377018 21083 ts_tablet_manager.cc:1434] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:05:10.377346 21090 consensus_queue.cc:237] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.379222 21085 tablet_bootstrap.cc:654] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.377993 21083 tablet_bootstrap.cc:492] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:10.378738 21084 consensus_queue.cc:260] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.406221 21083 tablet_bootstrap.cc:654] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.402240 21084 ts_tablet_manager.cc:1434] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:05:10.408313 21084 tablet_bootstrap.cc:492] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:10.414877 21116 raft_consensus.cc:493] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.414760 20788 catalog_manager.cc:5697] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 0 to 1, leader changed from <none> to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.415539 21116 raft_consensus.cc:515] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.418309 21116 leader_election.cc:290] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.419478 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
I20260709 13:05:10.420486 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
W20260709 13:05:10.420953 20856 leader_election.cc:343] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:10.422605 20854 leader_election.cc:343] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.423050 20854 leader_election.cc:304] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca; no voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:10.423866 21116 raft_consensus.cc:2749] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.426163 21084 tablet_bootstrap.cc:654] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.438972 20786 catalog_manager.cc:5697] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.445752 21085 tablet_bootstrap.cc:492] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:10.446249 21085 ts_tablet_manager.cc:1403] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.039s
I20260709 13:05:10.450169 21083 tablet_bootstrap.cc:492] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:10.450752 21083 ts_tablet_manager.cc:1403] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.009s
I20260709 13:05:10.451710 21085 raft_consensus.cc:359] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.452482 21085 raft_consensus.cc:385] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.452834 21085 raft_consensus.cc:740] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.453584 21085 consensus_queue.cc:260] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.454241 21083 raft_consensus.cc:359] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.455083 21083 raft_consensus.cc:385] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.455965 21083 raft_consensus.cc:740] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.459045 21085 ts_tablet_manager.cc:1434] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:05:10.460076 21085 tablet_bootstrap.cc:492] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:10.470335 21084 tablet_bootstrap.cc:492] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:10.470022 21083 consensus_queue.cc:260] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.470817 21084 ts_tablet_manager.cc:1403] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.006s
I20260709 13:05:10.473822 21084 raft_consensus.cc:359] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.474536 21084 raft_consensus.cc:385] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.474828 21084 raft_consensus.cc:740] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.476751 21083 ts_tablet_manager.cc:1434] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:05:10.477939 21083 tablet_bootstrap.cc:492] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:10.479367 21085 tablet_bootstrap.cc:654] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.480639 21084 consensus_queue.cc:260] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.483466 21084 ts_tablet_manager.cc:1434] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:05:10.484421 21084 tablet_bootstrap.cc:492] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:10.485234 21083 tablet_bootstrap.cc:654] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.495277 21084 tablet_bootstrap.cc:654] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.504724 21085 tablet_bootstrap.cc:492] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:10.505244 21085 ts_tablet_manager.cc:1403] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.005s
I20260709 13:05:10.509042 21085 raft_consensus.cc:359] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.510035 21085 raft_consensus.cc:385] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.510334 21085 raft_consensus.cc:740] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.511179 21085 consensus_queue.cc:260] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.513729 21083 tablet_bootstrap.cc:492] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:10.514214 21085 ts_tablet_manager.cc:1434] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:05:10.514505 21083 ts_tablet_manager.cc:1403] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.009s
I20260709 13:05:10.518265 21083 raft_consensus.cc:359] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.519325 21083 raft_consensus.cc:385] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.519747 21083 raft_consensus.cc:740] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.520805 21083 consensus_queue.cc:260] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.524816 21083 ts_tablet_manager.cc:1434] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:10.525383 21085 tablet_bootstrap.cc:492] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:10.526645 21084 tablet_bootstrap.cc:492] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:10.527093 21084 ts_tablet_manager.cc:1403] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.012s
I20260709 13:05:10.527942 21083 tablet_bootstrap.cc:492] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7: Bootstrap starting.
I20260709 13:05:10.530602 21084 raft_consensus.cc:359] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:10.531400 21084 raft_consensus.cc:385] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.531737 21084 raft_consensus.cc:740] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.532563 21084 consensus_queue.cc:260] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:10.535907 21084 ts_tablet_manager.cc:1434] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:05:10.537001 21084 tablet_bootstrap.cc:492] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:10.541704 21083 tablet_bootstrap.cc:654] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.544358 21084 tablet_bootstrap.cc:654] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.533066 21085 tablet_bootstrap.cc:654] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.555792 21090 raft_consensus.cc:493] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.556326 21090 raft_consensus.cc:515] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.558594 21090 leader_election.cc:290] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.560730 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
W20260709 13:05:10.562345 20931 leader_election.cc:343] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.563922 21085 tablet_bootstrap.cc:492] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:10.564455 21085 ts_tablet_manager.cc:1403] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.039s	user 0.004s	sys 0.016s
I20260709 13:05:10.567337 21085 raft_consensus.cc:359] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.568066 21085 raft_consensus.cc:385] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.568348 21085 raft_consensus.cc:740] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.568792 21084 tablet_bootstrap.cc:492] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:10.569020 21085 consensus_queue.cc:260] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.569702 21084 ts_tablet_manager.cc:1403] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.008s
I20260709 13:05:10.569846 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.570451 20891 raft_consensus.cc:2468] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 0.
I20260709 13:05:10.571281 21085 ts_tablet_manager.cc:1434] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:05:10.571753 20930 leader_election.cc:304] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:10.573472 21084 raft_consensus.cc:359] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.574333 21084 raft_consensus.cc:385] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.574681 21084 raft_consensus.cc:740] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.575825 21090 raft_consensus.cc:2804] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.575532 21084 consensus_queue.cc:260] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.576186 21090 raft_consensus.cc:493] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.576550 21090 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.578222 21084 ts_tablet_manager.cc:1434] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:10.579239 21084 tablet_bootstrap.cc:492] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36: Bootstrap starting.
I20260709 13:05:10.583982 21085 tablet_bootstrap.cc:492] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca: Bootstrap starting.
I20260709 13:05:10.584676 21084 tablet_bootstrap.cc:654] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.590394 21085 tablet_bootstrap.cc:654] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:10.596218 20836 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:10.596910 21090 raft_consensus.cc:515] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.601001 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:10.601619 20891 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.610317 20891 raft_consensus.cc:2468] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 1.
I20260709 13:05:10.611585 20930 leader_election.cc:304] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:10.612938 21126 raft_consensus.cc:2804] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.618860 21090 leader_election.cc:290] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.622318 21117 raft_consensus.cc:493] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.622630 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:10.622833 21117 raft_consensus.cc:515] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.623500 21088 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:10.625229 21117 leader_election.cc:290] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
W20260709 13:05:10.628997 20931 leader_election.cc:343] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:10.633441 21083 tablet_bootstrap.cc:492] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7: No bootstrap required, opened a new log
I20260709 13:05:10.633951 21083 ts_tablet_manager.cc:1403] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.030s
I20260709 13:05:10.634574 21084 tablet_bootstrap.cc:492] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36: No bootstrap required, opened a new log
I20260709 13:05:10.634976 21084 ts_tablet_manager.cc:1403] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36: Time spent bootstrapping tablet: real 0.056s	user 0.025s	sys 0.015s
I20260709 13:05:10.637105 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.637534 21085 tablet_bootstrap.cc:492] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca: No bootstrap required, opened a new log
I20260709 13:05:10.637727 20964 raft_consensus.cc:2468] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.637930 21085 ts_tablet_manager.cc:1403] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.010s
I20260709 13:05:10.630873 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.631362 21126 raft_consensus.cc:697] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 1 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:10.638906 21003 leader_election.cc:304] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:10.639688 21126 consensus_queue.cc:237] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.640071 21088 raft_consensus.cc:2804] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.640578 21088 raft_consensus.cc:493] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.641050 21088 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.646916 21084 raft_consensus.cc:359] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.647657 21084 raft_consensus.cc:385] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.648180 21084 raft_consensus.cc:740] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.647625 21085 raft_consensus.cc:359] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.653061 21085 raft_consensus.cc:385] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.653471 21085 raft_consensus.cc:740] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.654542 21085 consensus_queue.cc:260] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.656282 20891 raft_consensus.cc:2468] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.657698 21085 ts_tablet_manager.cc:1434] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.005s
I20260709 13:05:10.649029 21084 consensus_queue.cc:260] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.674571 21117 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.674849 21083 raft_consensus.cc:359] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.675799 21083 raft_consensus.cc:385] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.676157 21083 raft_consensus.cc:740] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.672281 21088 raft_consensus.cc:515] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.677217 21083 consensus_queue.cc:260] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.679209 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:10.679787 20891 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.680322 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:10.680896 20964 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.684818 21084 ts_tablet_manager.cc:1434] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36: Time spent starting tablet: real 0.050s	user 0.012s	sys 0.006s
I20260709 13:05:10.686568 20891 raft_consensus.cc:2468] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.687829 21004 leader_election.cc:304] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.689056 21117 raft_consensus.cc:2804] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.689714 21117 raft_consensus.cc:697] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:10.690605 21117 consensus_queue.cc:237] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.690665 20964 raft_consensus.cc:2468] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.697955 21083 ts_tablet_manager.cc:1434] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.007s
I20260709 13:05:10.701072 20786 catalog_manager.cc:5697] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 0 to 1, leader changed from <none> to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.703897 21088 leader_election.cc:290] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:10.707250 21116 raft_consensus.cc:493] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.707953 21116 raft_consensus.cc:515] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.712064 21116 leader_election.cc:290] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.713188 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96a051abc604b07b8932e56a0825414" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.714169 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96a051abc604b07b8932e56a0825414" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
I20260709 13:05:10.719722 21039 raft_consensus.cc:2393] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02d70c63ce4f4f7c819cf745c493f2ca in current term 1: Already voted for candidate a00abf1541f045ef8609dc0c9c56be36 in this term.
I20260709 13:05:10.720996 20856 leader_election.cc:304] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca; no voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:10.723255 21116 raft_consensus.cc:3060] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.726274 21092 raft_consensus.cc:493] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.726778 21092 raft_consensus.cc:515] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.729665 21092 leader_election.cc:290] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.737846 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" is_pre_election: true
I20260709 13:05:10.738520 21039 raft_consensus.cc:2468] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 0.
I20260709 13:05:10.739454 21092 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.740136 20856 leader_election.cc:304] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.740893 21122 raft_consensus.cc:2804] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.741266 21122 raft_consensus.cc:493] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.741588 21122 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.747534 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.748242 20966 raft_consensus.cc:2468] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 0.
I20260709 13:05:10.750216 21122 raft_consensus.cc:515] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.751576 21116 raft_consensus.cc:2749] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:10.709470 20788 catalog_manager.cc:5697] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.756819 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:10.759749 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:10.761340 21039 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.764845 21122 leader_election.cc:290] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:10.765395 20966 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.779198 21148 raft_consensus.cc:493] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.779733 21148 raft_consensus.cc:515] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.774755 21039 raft_consensus.cc:2468] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 1.
I20260709 13:05:10.782737 20856 leader_election.cc:304] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.783568 21116 raft_consensus.cc:2804] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.784066 21116 raft_consensus.cc:697] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:10.784436 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.785115 20891 raft_consensus.cc:2468] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.784914 21116 consensus_queue.cc:237] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.786103 21126 consensus_queue.cc:1048] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.786410 21004 leader_election.cc:304] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.786710 20966 raft_consensus.cc:2468] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 1.
I20260709 13:05:10.787340 21148 leader_election.cc:290] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:10.787392 21117 raft_consensus.cc:2804] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.787871 21117 raft_consensus.cc:493] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.788306 21117 raft_consensus.cc:3060] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.791505 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.792192 20966 raft_consensus.cc:2468] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.800339 21122 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:10.806000 21117 raft_consensus.cc:515] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.809384 21117 leader_election.cc:290] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:10.809799 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:10.810225 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:10.810575 20890 raft_consensus.cc:3060] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.810807 20964 raft_consensus.cc:3060] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.812448 21117 raft_consensus.cc:493] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.812932 21117 raft_consensus.cc:515] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.817162 21117 leader_election.cc:290] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:10.818194 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b100f77bb0514dcd86148e34472f6bda" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36" is_pre_election: true
I20260709 13:05:10.819816 20966 raft_consensus.cc:2468] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.821607 21003 leader_election.cc:304] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:10.822111 21126 consensus_queue.cc:1048] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:10.822697 20890 raft_consensus.cc:2468] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.823879 21004 leader_election.cc:304] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.824771 21148 raft_consensus.cc:2804] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:10.825136 21148 raft_consensus.cc:493] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.825465 21148 raft_consensus.cc:3060] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.826860 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b100f77bb0514dcd86148e34472f6bda" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" is_pre_election: true
I20260709 13:05:10.827513 21117 raft_consensus.cc:2804] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.828583 21117 raft_consensus.cc:697] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:10.828265 20891 raft_consensus.cc:2468] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 0.
I20260709 13:05:10.829860 21117 consensus_queue.cc:237] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.839545 20964 raft_consensus.cc:2468] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.841706 21148 raft_consensus.cc:515] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.844432 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b100f77bb0514dcd86148e34472f6bda" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:10.844810 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b100f77bb0514dcd86148e34472f6bda" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:10.845647 20964 raft_consensus.cc:3060] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.845153 20891 raft_consensus.cc:3060] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.847393 21148 leader_election.cc:290] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:10.854004 20966 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:10.858174 20964 raft_consensus.cc:2468] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.859866 20891 raft_consensus.cc:2468] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 1.
I20260709 13:05:10.861397 21004 leader_election.cc:304] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:10.862231 21148 raft_consensus.cc:2804] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:10.862763 21148 raft_consensus.cc:697] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:10.863571 21148 consensus_queue.cc:237] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:10.868337 21148 consensus_queue.cc:1048] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.875946 20787 catalog_manager.cc:5697] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 1 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.889715 20786 catalog_manager.cc:5697] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.891996 20786 catalog_manager.cc:5697] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.901247 21088 consensus_queue.cc:1048] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.050117 21126 consensus_queue.cc:1048] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.059652 21039 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.069823 21145 consensus_queue.cc:1048] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.161188 21088 consensus_queue.cc:1048] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.171576 21148 consensus_queue.cc:1048] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.203796 21122 consensus_queue.cc:1048] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.228354 21092 consensus_queue.cc:1048] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.251045 21039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
mode: GRACEFUL
new_leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:05:11.251744 21039 raft_consensus.cc:606] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Received request to transfer leadership to TS 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:11.267002 20966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
mode: GRACEFUL
new_leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:47486
I20260709 13:05:11.267611 20966 raft_consensus.cc:606] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 1 LEADER]: Received request to transfer leadership to TS 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:11.272881 21039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
mode: GRACEFUL
new_leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:05:11.273473 21039 raft_consensus.cc:606] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Received request to transfer leadership to TS 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:11.278220 21039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
mode: GRACEFUL
new_leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:05:11.278752 21039 raft_consensus.cc:606] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Received request to transfer leadership to TS 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:11.286849 21039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
mode: GRACEFUL
new_leader_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:05:11.287410 21039 raft_consensus.cc:606] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Received request to transfer leadership to TS a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:11.302122 20891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
mode: GRACEFUL
new_leader_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:05:11.302747 20891 raft_consensus.cc:606] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Received request to transfer leadership to TS a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:11.307891 20891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
mode: GRACEFUL
new_leader_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:05:11.308506 20891 raft_consensus.cc:606] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Received request to transfer leadership to TS a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:11.361260 21148 consensus_queue.cc:1048] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.374809 21148 consensus_queue.cc:1048] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.375168 21117 consensus_queue.cc:1048] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:11.388099 21088 raft_consensus.cc:993] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7: : Instructing follower a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:11.388568 21088 raft_consensus.cc:1081] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Signalling peer a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:11.394263 21174 consensus_queue.cc:1048] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:11.395285 20964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:47464
I20260709 13:05:11.396891 20964 raft_consensus.cc:493] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.397993 20964 raft_consensus.cc:3060] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.405925 20964 raft_consensus.cc:515] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.409176 20964 leader_election.cc:290] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 2 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:11.409375 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:11.409945 21039 raft_consensus.cc:3055] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:11.410260 21039 raft_consensus.cc:740] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:11.411046 21039 consensus_queue.cc:260] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.412014 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eceed2523ae416aa7c7781653e88593" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:11.412456 21039 raft_consensus.cc:3060] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.412647 20891 raft_consensus.cc:3060] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.419358 20891 raft_consensus.cc:2468] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 2.
I20260709 13:05:11.420532 21039 raft_consensus.cc:2468] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 2.
I20260709 13:05:11.420816 20930 leader_election.cc:304] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:11.421656 21090 raft_consensus.cc:2804] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.422160 21090 raft_consensus.cc:697] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:11.422951 21090 consensus_queue.cc:237] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.430548 20786 catalog_manager.cc:5697] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 1 to 2, leader changed from 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3) to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.518198 21174 raft_consensus.cc:993] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7: : Instructing follower 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:11.518697 21148 raft_consensus.cc:1081] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Signalling peer 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:11.520591 20891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:44090
I20260709 13:05:11.521212 20891 raft_consensus.cc:493] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.521577 20891 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.528302 20891 raft_consensus.cc:515] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:11.530519 20891 leader_election.cc:290] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 2 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:11.531595 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:11.531816 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:11.532264 20964 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.532320 21039 raft_consensus.cc:3055] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:11.532836 21039 raft_consensus.cc:740] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:11.533725 21039 consensus_queue.cc:260] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:11.534991 21039 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.538831 20964 raft_consensus.cc:2468] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 2.
I20260709 13:05:11.540114 20854 leader_election.cc:304] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:11.540915 21122 raft_consensus.cc:2804] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.541378 21122 raft_consensus.cc:697] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:11.541857 21039 raft_consensus.cc:2468] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 2.
I20260709 13:05:11.542276 21122 consensus_queue.cc:237] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:11.548501 20786 catalog_manager.cc:5697] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 1 to 2, leader changed from 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3) to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 2 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:11.578871 21126 raft_consensus.cc:993] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36: : Instructing follower 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:11.579341 21090 raft_consensus.cc:1081] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 1 LEADER]: Signalling peer 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:11.580971 20891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:44104
I20260709 13:05:11.581547 20891 raft_consensus.cc:493] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.581923 20891 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.588562 20891 raft_consensus.cc:515] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.591040 20891 leader_election.cc:290] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 2 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:11.591553 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:11.592546 20964 raft_consensus.cc:3055] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:11.592780 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:11.592988 20964 raft_consensus.cc:740] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:11.593935 20964 consensus_queue.cc:260] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.595463 20964 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.601827 20964 raft_consensus.cc:2468] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 2.
I20260709 13:05:11.605348 20854 leader_election.cc:304] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:11.606551 21122 raft_consensus.cc:2804] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.607780 21122 raft_consensus.cc:697] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:11.608660 21122 consensus_queue.cc:237] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.617681 20786 catalog_manager.cc:5697] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 1 to 2, leader changed from a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2) to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 2 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.639864 21148 raft_consensus.cc:993] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7: : Instructing follower 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:11.640336 21174 raft_consensus.cc:1081] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Signalling peer 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:11.642071 20891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:44090
I20260709 13:05:11.642627 20891 raft_consensus.cc:493] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.642995 20891 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.651310 20891 raft_consensus.cc:515] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.653712 20891 leader_election.cc:290] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 2 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:11.654109 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:11.654328 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:11.654711 20964 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.654881 21039 raft_consensus.cc:3055] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:11.655231 21039 raft_consensus.cc:740] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:11.656070 21039 consensus_queue.cc:260] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.657220 21039 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.660524 21088 raft_consensus.cc:993] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7: : Instructing follower 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:11.661000 21088 raft_consensus.cc:1081] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Signalling peer 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:11.662079 20964 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 2.
I20260709 13:05:11.663309 20854 leader_election.cc:304] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:11.663678 20890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:44090
I20260709 13:05:11.664260 20890 raft_consensus.cc:493] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.664629 20890 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.665126 21122 raft_consensus.cc:2804] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.665877 21122 raft_consensus.cc:697] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:11.666846 21122 consensus_queue.cc:237] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.667761 21039 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 2.
I20260709 13:05:11.673769 20890 raft_consensus.cc:515] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.675889 20890 leader_election.cc:290] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 2 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:11.675988 20786 catalog_manager.cc:5697] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 1 to 2, leader changed from 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3) to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 2 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.677489 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:11.677733 20964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:11.678073 21039 raft_consensus.cc:3055] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:11.678296 20964 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.678419 21039 raft_consensus.cc:740] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:11.680294 21039 consensus_queue.cc:260] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.681571 21039 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.683184 21120 raft_consensus.cc:993] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca: : Instructing follower a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:11.683631 21120 raft_consensus.cc:1081] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Signalling peer a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:11.685595 20966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:47474
I20260709 13:05:11.686149 20966 raft_consensus.cc:493] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.686527 20966 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.688189 21039 raft_consensus.cc:2468] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 2.
I20260709 13:05:11.689494 20856 leader_election.cc:304] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:11.690457 21122 raft_consensus.cc:2804] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.691201 21122 raft_consensus.cc:697] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:11.692090 21122 consensus_queue.cc:237] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.694331 20966 raft_consensus.cc:515] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.697791 20964 raft_consensus.cc:2468] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 2.
I20260709 13:05:11.699543 20966 leader_election.cc:290] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 2 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:11.700929 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:11.700680 20786 catalog_manager.cc:5697] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 1 to 2, leader changed from 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3) to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 2 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.701514 20890 raft_consensus.cc:3055] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:11.701464 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:11.701946 20890 raft_consensus.cc:740] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:11.702137 21039 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.702749 20890 consensus_queue.cc:260] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.703998 20890 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.709127 21039 raft_consensus.cc:2468] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 2.
I20260709 13:05:11.710381 20931 leader_election.cc:304] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:11.711292 21126 raft_consensus.cc:2804] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.711745 21126 raft_consensus.cc:697] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:11.712543 21126 consensus_queue.cc:237] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.713084 20890 raft_consensus.cc:2468] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 2.
I20260709 13:05:11.720203 20786 catalog_manager.cc:5697] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 1 to 2, leader changed from 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1) to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.815517 21092 raft_consensus.cc:993] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca: : Instructing follower a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:11.815960 21092 raft_consensus.cc:1081] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Signalling peer a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:11.817658 20966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:47474
I20260709 13:05:11.818188 20966 raft_consensus.cc:493] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.818544 20966 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.823056 20966 raft_consensus.cc:515] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.824852 20966 leader_election.cc:290] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 2 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:11.826133 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:11.826706 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:11.826831 20890 raft_consensus.cc:3055] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:11.827320 21039 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.827363 20890 raft_consensus.cc:740] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:11.827811 20891 raft_consensus.cc:1275] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:11.828703 20890 consensus_queue.cc:260] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.829530 21126 consensus_queue.cc:1048] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.830132 20890 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:11.839334 21040 raft_consensus.cc:1275] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:11.840981 21090 consensus_queue.cc:1048] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.846069 21039 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 2.
I20260709 13:05:11.847373 20931 leader_election.cc:304] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:11.848315 21090 raft_consensus.cc:2804] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:11.849502 21090 raft_consensus.cc:697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:11.851223 21090 consensus_queue.cc:237] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:11.856972 20890 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 2.
I20260709 13:05:11.861368 20786 catalog_manager.cc:5697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 1 to 2, leader changed from 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1) to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:11.956343 20966 raft_consensus.cc:1275] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:11.957688 21092 consensus_queue.cc:1048] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.966333 21040 raft_consensus.cc:1275] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:11.969723 21122 consensus_queue.cc:1048] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.989460 20966 raft_consensus.cc:1275] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:11.990826 21122 consensus_queue.cc:1048] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.998546 21040 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.006021 21040 raft_consensus.cc:1275] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.007131 21120 consensus_queue.cc:1048] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.055577 20966 raft_consensus.cc:1275] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.056878 21120 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.066093 21040 raft_consensus.cc:1275] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.067730 21122 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.075636 20966 raft_consensus.cc:1275] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.077032 21122 consensus_queue.cc:1048] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.085700 21040 raft_consensus.cc:1275] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.088333 21120 consensus_queue.cc:1048] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.164533 21040 raft_consensus.cc:1275] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.165951 21090 consensus_queue.cc:1048] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.173817 20890 raft_consensus.cc:1275] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.175509 21090 consensus_queue.cc:1048] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:12.237795 21040 raft_consensus.cc:1275] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.239140 21090 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:12.241796 20890 raft_consensus.cc:1275] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:12.243176 21090 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.342866 20756 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:14.343730 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:14.365990 20966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
mode: GRACEFUL
new_leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
 from {username='slave'} at 127.0.0.1:47492
I20260709 13:05:14.366596 20966 raft_consensus.cc:606] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Received request to transfer leadership to TS 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:14.378250 20890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
mode: GRACEFUL
new_leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
 from {username='slave'} at 127.0.0.1:44130
I20260709 13:05:14.378759 20890 raft_consensus.cc:606] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Received request to transfer leadership to TS 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:14.379887 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:14.380390 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:14.383579 21126 raft_consensus.cc:993] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36: : Instructing follower 066999ebce2948d5bc6a9a0f38a6f8a7 to start an election
I20260709 13:05:14.383962 21126 raft_consensus.cc:1081] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Signalling peer 066999ebce2948d5bc6a9a0f38a6f8a7 to start an election
I20260709 13:05:14.385284 21039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
 from {username='slave'} at 127.0.0.1:55760
I20260709 13:05:14.385722 21039 raft_consensus.cc:493] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:14.385998 21039 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.390906 21039 raft_consensus.cc:515] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:14.393126 21039 leader_election.cc:290] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 3 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:14.393503 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:14.393675 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:14.394109 20890 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.394155 20966 raft_consensus.cc:3055] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.394748 20966 raft_consensus.cc:740] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:14.395581 20966 consensus_queue.cc:260] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:14.396847 20966 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.401023 20890 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 3.
I20260709 13:05:14.402266 21004 leader_election.cc:304] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:14.402930 21174 raft_consensus.cc:2804] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:14.403247 20966 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 3.
I20260709 13:05:14.404268 21174 raft_consensus.cc:697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:14.405059 21174 consensus_queue.cc:237] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:14.411644 20787 catalog_manager.cc:5697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 2 to 3, leader changed from a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2) to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.660892 21120 raft_consensus.cc:993] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca: : Instructing follower 066999ebce2948d5bc6a9a0f38a6f8a7 to start an election
I20260709 13:05:14.661307 21198 raft_consensus.cc:1081] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Signalling peer 066999ebce2948d5bc6a9a0f38a6f8a7 to start an election
I20260709 13:05:14.662793 21039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
 from {username='slave'} at 127.0.0.1:55752
I20260709 13:05:14.663214 21039 raft_consensus.cc:493] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:14.663480 21039 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.668272 21039 raft_consensus.cc:515] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:14.669865 21039 leader_election.cc:290] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 3 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:14.670873 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:14.671020 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:14.671427 20890 raft_consensus.cc:3055] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.671588 20966 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.671759 20890 raft_consensus.cc:740] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:14.672524 20890 consensus_queue.cc:260] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:14.673599 20890 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.676546 20966 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 3.
I20260709 13:05:14.678007 21003 leader_election.cc:304] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:14.678745 21174 raft_consensus.cc:2804] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:14.679139 20890 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 3.
I20260709 13:05:14.679256 21174 raft_consensus.cc:697] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:14.680125 21174 consensus_queue.cc:237] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:14.686779 20787 catalog_manager.cc:5697] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 2 to 3, leader changed from 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1) to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.853467 20890 raft_consensus.cc:1275] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Refusing update from remote peer 066999ebce2948d5bc6a9a0f38a6f8a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:14.854789 21174 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:14.864809 20966 raft_consensus.cc:1275] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Refusing update from remote peer 066999ebce2948d5bc6a9a0f38a6f8a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:14.866582 21192 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:15.085085 20890 raft_consensus.cc:1275] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Refusing update from remote peer 066999ebce2948d5bc6a9a0f38a6f8a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.086628 21192 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:15.095901 20966 raft_consensus.cc:1275] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Refusing update from remote peer 066999ebce2948d5bc6a9a0f38a6f8a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.097371 21207 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:15.381297 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:15.390946 20890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
mode: GRACEFUL
new_leader_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:05:15.391501 20890 raft_consensus.cc:606] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Received request to transfer leadership to TS a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:15.396522 20890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
mode: GRACEFUL
new_leader_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:05:15.397145 20890 raft_consensus.cc:606] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Received request to transfer leadership to TS a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:15.402053 21039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
mode: GRACEFUL
new_leader_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:05:15.402478 21039 raft_consensus.cc:606] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Received request to transfer leadership to TS a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:15.406729 20890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
mode: GRACEFUL
new_leader_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:44118
I20260709 13:05:15.407162 20890 raft_consensus.cc:606] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Received request to transfer leadership to TS a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:15.416843 21039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
mode: GRACEFUL
new_leader_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:05:15.417332 21039 raft_consensus.cc:606] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Received request to transfer leadership to TS a00abf1541f045ef8609dc0c9c56be36
I20260709 13:05:15.470770 21202 raft_consensus.cc:993] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7: : Instructing follower a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.471258 21202 raft_consensus.cc:1081] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Signalling peer a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.472929 20966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:47464
I20260709 13:05:15.473471 20966 raft_consensus.cc:493] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.473762 20966 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.477695 20966 raft_consensus.cc:515] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.479081 20966 leader_election.cc:290] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 4 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:15.480149 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:15.480111 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:15.480855 21039 raft_consensus.cc:3055] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:15.480866 20890 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.481310 21039 raft_consensus.cc:740] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:15.482074 21039 consensus_queue.cc:260] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.483206 21039 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.487749 20890 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 4.
I20260709 13:05:15.489065 20930 leader_election.cc:304] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:15.489233 21039 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 4.
I20260709 13:05:15.489887 21126 raft_consensus.cc:2804] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:15.490906 21126 raft_consensus.cc:697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:15.491708 21126 consensus_queue.cc:237] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.493737 21210 raft_consensus.cc:993] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca: : Instructing follower a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.494191 21198 raft_consensus.cc:1081] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Signalling peer a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.495805 20966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:47474
I20260709 13:05:15.496445 20966 raft_consensus.cc:493] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.496810 20966 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.499612 20786 catalog_manager.cc:5697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 3 to 4, leader changed from 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3) to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.501245 20966 raft_consensus.cc:515] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:15.503700 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:15.504261 21039 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.504459 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:15.505587 20890 raft_consensus.cc:3055] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.506019 20890 raft_consensus.cc:740] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:15.507023 20890 consensus_queue.cc:260] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:15.509455 20890 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.513708 20966 leader_election.cc:290] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 3 election: Requested vote from peers 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779), 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547)
I20260709 13:05:15.515532 21039 raft_consensus.cc:2468] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 3.
I20260709 13:05:15.516566 20931 leader_election.cc:304] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:15.517331 21126 raft_consensus.cc:2804] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.517838 21126 raft_consensus.cc:697] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:15.518623 21126 consensus_queue.cc:237] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:15.519241 20890 raft_consensus.cc:2468] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 3.
I20260709 13:05:15.525702 20786 catalog_manager.cc:5697] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 2 to 3, leader changed from 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1) to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.629900 21207 raft_consensus.cc:993] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7: : Instructing follower a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.630383 21202 raft_consensus.cc:1081] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Signalling peer a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.631806 20966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:47464
I20260709 13:05:15.632237 20966 raft_consensus.cc:493] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.632534 20966 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.636471 20966 raft_consensus.cc:515] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.638054 20966 leader_election.cc:290] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 4 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:15.638859 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:15.639108 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:15.639418 20890 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.639740 21039 raft_consensus.cc:3055] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:15.640059 21039 raft_consensus.cc:740] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:15.640743 21039 consensus_queue.cc:260] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.641530 21039 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:15.643778 20890 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 4.
I20260709 13:05:15.644731 20930 leader_election.cc:304] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:15.645399 21126 raft_consensus.cc:2804] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:15.645543 21039 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 4.
I20260709 13:05:15.645807 21126 raft_consensus.cc:697] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:15.646705 21126 consensus_queue.cc:237] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.653084 20786 catalog_manager.cc:5697] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 3 to 4, leader changed from 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3) to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.720212 21210 raft_consensus.cc:993] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca: : Instructing follower a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.720688 21198 raft_consensus.cc:1081] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Signalling peer a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.722182 20966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:47474
I20260709 13:05:15.722666 20966 raft_consensus.cc:493] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.722965 20966 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.727133 20966 raft_consensus.cc:515] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.728837 20966 leader_election.cc:290] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 3 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:15.729803 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:15.729969 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905bf4fa78f24c14b6b49baa0f13df43" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:15.730403 20890 raft_consensus.cc:3055] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.730530 21039 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.730736 20890 raft_consensus.cc:740] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:15.731521 20890 consensus_queue.cc:260] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.732712 20890 raft_consensus.cc:3060] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.736454 21039 raft_consensus.cc:2468] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 3.
I20260709 13:05:15.737735 20931 leader_election.cc:304] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:15.738484 21126 raft_consensus.cc:2804] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.739012 21126 raft_consensus.cc:697] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:15.738991 20890 raft_consensus.cc:2468] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 3.
I20260709 13:05:15.739988 21126 consensus_queue.cc:237] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.746407 20786 catalog_manager.cc:5697] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 2 to 3, leader changed from 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1) to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.856863 21210 raft_consensus.cc:993] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca: : Instructing follower a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.857363 21198 raft_consensus.cc:1081] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Signalling peer a00abf1541f045ef8609dc0c9c56be36 to start an election
I20260709 13:05:15.858911 20966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
 from {username='slave'} at 127.0.0.1:47474
I20260709 13:05:15.859392 20966 raft_consensus.cc:493] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:15.859678 20966 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.863611 20966 raft_consensus.cc:515] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.865188 20966 leader_election.cc:290] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 3 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:15.866044 20890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:15.866312 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "a00abf1541f045ef8609dc0c9c56be36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:15.866626 20890 raft_consensus.cc:3055] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.866959 21039 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.867069 20890 raft_consensus.cc:740] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:15.867861 20890 consensus_queue.cc:260] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.868814 20890 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.871263 21039 raft_consensus.cc:2468] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 3.
I20260709 13:05:15.872252 20931 leader_election.cc:304] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066999ebce2948d5bc6a9a0f38a6f8a7, a00abf1541f045ef8609dc0c9c56be36; no voters: 
I20260709 13:05:15.872855 20890 raft_consensus.cc:2468] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a00abf1541f045ef8609dc0c9c56be36 in term 3.
I20260709 13:05:15.872943 21126 raft_consensus.cc:2804] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.873638 21126 raft_consensus.cc:697] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Becoming Leader. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:15.874452 21126 consensus_queue.cc:237] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:15.880235 20786 catalog_manager.cc:5697] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 reported cstate change: term changed from 2 to 3, leader changed from 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1) to a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "a00abf1541f045ef8609dc0c9c56be36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.926797 20890 raft_consensus.cc:1275] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.927986 21126 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:15.940541 21039 raft_consensus.cc:1275] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:15.941915 21209 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:16.087962 20890 raft_consensus.cc:1275] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:16.089392 21209 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:16.097689 21039 raft_consensus.cc:1275] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:16.100876 21219 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:16.113611 20890 raft_consensus.cc:1275] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.114773 21219 consensus_queue.cc:1048] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:16.124799 21039 raft_consensus.cc:1275] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.126031 21219 consensus_queue.cc:1048] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:16.279958 20890 raft_consensus.cc:1275] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.281265 21219 consensus_queue.cc:1048] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:16.289289 21039 raft_consensus.cc:1275] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.290830 21126 consensus_queue.cc:1048] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:16.306408 20890 raft_consensus.cc:1275] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.307607 21126 consensus_queue.cc:1048] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:16.316035 21039 raft_consensus.cc:1275] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Refusing update from remote peer a00abf1541f045ef8609dc0c9c56be36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.317667 21229 consensus_queue.cc:1048] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.423940 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:18.431311 20966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
mode: GRACEFUL
new_leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:47492
I20260709 13:05:18.432102 20966 raft_consensus.cc:606] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Received request to transfer leadership to TS 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:18.434724 20966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
mode: GRACEFUL
new_leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:47492
I20260709 13:05:18.435171 20966 raft_consensus.cc:606] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Received request to transfer leadership to TS 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:18.437320 20966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
mode: GRACEFUL
new_leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
 from {username='slave'} at 127.0.0.1:47492
I20260709 13:05:18.437819 20966 raft_consensus.cc:606] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Received request to transfer leadership to TS 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:18.439980 20966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
mode: GRACEFUL
new_leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:47492
I20260709 13:05:18.440402 20966 raft_consensus.cc:606] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Received request to transfer leadership to TS 02d70c63ce4f4f7c819cf745c493f2ca
I20260709 13:05:18.442673 20966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b"
dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
mode: GRACEFUL
new_leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
 from {username='slave'} at 127.0.0.1:47492
I20260709 13:05:18.443037 20966 raft_consensus.cc:606] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Received request to transfer leadership to TS 066999ebce2948d5bc6a9a0f38a6f8a7
I20260709 13:05:18.443962 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:18.444329 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:18.527171 21209 raft_consensus.cc:993] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36: : Instructing follower 066999ebce2948d5bc6a9a0f38a6f8a7 to start an election
I20260709 13:05:18.527737 21233 raft_consensus.cc:1081] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Signalling peer 066999ebce2948d5bc6a9a0f38a6f8a7 to start an election
I20260709 13:05:18.529422 21039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
 from {username='slave'} at 127.0.0.1:55760
I20260709 13:05:18.529903 21039 raft_consensus.cc:493] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.530185 21039 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.535101 21039 raft_consensus.cc:515] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.536787 21039 leader_election.cc:290] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 5 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:18.537890 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:18.537932 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa10d1f4f0424a628ccf25828250db75" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:18.538707 20891 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.538869 20966 raft_consensus.cc:3055] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:18.539244 20966 raft_consensus.cc:740] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:18.539963 20966 consensus_queue.cc:260] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.541236 20966 raft_consensus.cc:3060] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.544847 20891 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 5.
I20260709 13:05:18.546111 21004 leader_election.cc:304] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:18.546896 20966 raft_consensus.cc:2468] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 5.
I20260709 13:05:18.547057 21232 raft_consensus.cc:2804] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:18.548269 21232 raft_consensus.cc:697] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:18.549198 21232 consensus_queue.cc:237] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.555915 20787 catalog_manager.cc:5697] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 4 to 5, leader changed from a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2) to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 5 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.569396 21209 raft_consensus.cc:993] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36: : Instructing follower 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:18.569761 21209 raft_consensus.cc:1081] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Signalling peer 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:18.571275 20891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:44104
I20260709 13:05:18.571842 20891 raft_consensus.cc:493] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.572145 20891 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.576388 20891 raft_consensus.cc:515] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.578166 20891 leader_election.cc:290] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 3 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:18.579110 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:18.579416 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9166d7d114455cb73fd4861d14f1c0" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:18.579721 20966 raft_consensus.cc:3055] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:18.579957 21039 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.580083 20966 raft_consensus.cc:740] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:18.580909 20966 consensus_queue.cc:260] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.581915 20966 raft_consensus.cc:3060] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.584975 21039 raft_consensus.cc:2468] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 3.
I20260709 13:05:18.586351 20856 leader_election.cc:304] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:18.587169 20966 raft_consensus.cc:2468] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 3.
I20260709 13:05:18.588404 21240 raft_consensus.cc:2804] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:18.589653 21240 raft_consensus.cc:697] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:18.590597 21240 consensus_queue.cc:237] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.598129 21233 raft_consensus.cc:993] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36: : Instructing follower 066999ebce2948d5bc6a9a0f38a6f8a7 to start an election
I20260709 13:05:18.598654 21209 raft_consensus.cc:1081] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Signalling peer 066999ebce2948d5bc6a9a0f38a6f8a7 to start an election
I20260709 13:05:18.598049 20787 catalog_manager.cc:5697] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 2 to 3, leader changed from a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2) to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 3 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.600229 21039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b"
dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
 from {username='slave'} at 127.0.0.1:55760
I20260709 13:05:18.600801 21039 raft_consensus.cc:493] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.601042 21039 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.605276 21039 raft_consensus.cc:515] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.607061 21039 leader_election.cc:290] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 4 election: Requested vote from peers 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547), a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817)
I20260709 13:05:18.607816 20891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
I20260709 13:05:18.607975 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2575610c4604ceb82419f6bf47acc9b" candidate_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:18.608301 20891 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.608485 20966 raft_consensus.cc:3055] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:18.608911 20966 raft_consensus.cc:740] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:18.609500 20966 consensus_queue.cc:260] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.610599 20966 raft_consensus.cc:3060] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.613000 20891 raft_consensus.cc:2468] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 4.
I20260709 13:05:18.613979 21004 leader_election.cc:304] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:18.614754 21232 raft_consensus.cc:2804] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:18.615195 21232 raft_consensus.cc:697] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 LEADER]: Becoming Leader. State: Replica: 066999ebce2948d5bc6a9a0f38a6f8a7, State: Running, Role: LEADER
I20260709 13:05:18.615351 20966 raft_consensus.cc:2468] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066999ebce2948d5bc6a9a0f38a6f8a7 in term 4.
I20260709 13:05:18.616034 21232 consensus_queue.cc:237] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.623440 20787 catalog_manager.cc:5697] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 reported cstate change: term changed from 3 to 4, leader changed from a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2) to 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3). New cstate: current_term: 4 leader_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.649612 21233 raft_consensus.cc:993] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36: : Instructing follower 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:18.650110 21209 raft_consensus.cc:1081] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Signalling peer 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:18.651614 20891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:44104
I20260709 13:05:18.652021 20891 raft_consensus.cc:493] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.652253 20891 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.656020 20891 raft_consensus.cc:515] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:18.657403 20891 leader_election.cc:290] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 4 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:18.658258 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:18.658361 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acccd54ce09c4f69840b3b1f3abb77ec" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:18.658730 20966 raft_consensus.cc:3055] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:18.658893 21039 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.659024 20966 raft_consensus.cc:740] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:18.659670 20966 consensus_queue.cc:260] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:18.660490 20966 raft_consensus.cc:3060] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:18.663632 21039 raft_consensus.cc:2468] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 4.
I20260709 13:05:18.664702 20966 raft_consensus.cc:2468] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 4.
I20260709 13:05:18.664705 20856 leader_election.cc:304] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:18.665664 21240 raft_consensus.cc:2804] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:18.666146 21240 raft_consensus.cc:697] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:18.666915 21240 consensus_queue.cc:237] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } }
I20260709 13:05:18.673964 20787 catalog_manager.cc:5697] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 3 to 4, leader changed from a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2) to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 4 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.830899 21233 raft_consensus.cc:993] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36: : Instructing follower 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:18.831364 21209 raft_consensus.cc:1081] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Signalling peer 02d70c63ce4f4f7c819cf745c493f2ca to start an election
I20260709 13:05:18.832890 20891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8"
dest_uuid: "02d70c63ce4f4f7c819cf745c493f2ca"
 from {username='slave'} at 127.0.0.1:44104
I20260709 13:05:18.833357 20891 raft_consensus.cc:493] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.833595 20891 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.837572 20891 raft_consensus.cc:515] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.839073 20891 leader_election.cc:290] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 5 election: Requested vote from peers a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2:42817), 066999ebce2948d5bc6a9a0f38a6f8a7 (127.20.69.3:44779)
I20260709 13:05:18.839895 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a00abf1541f045ef8609dc0c9c56be36"
I20260709 13:05:18.840149 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "838c1f51e25a4ccdb9ba4d3ab7fd63e8" candidate_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7"
I20260709 13:05:18.840512 20966 raft_consensus.cc:3055] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:18.840679 21039 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.840889 20966 raft_consensus.cc:740] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a00abf1541f045ef8609dc0c9c56be36, State: Running, Role: LEADER
I20260709 13:05:18.841610 20966 consensus_queue.cc:260] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.842442 20966 raft_consensus.cc:3060] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:18.845005 21039 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 5.
I20260709 13:05:18.845949 20856 leader_election.cc:304] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02d70c63ce4f4f7c819cf745c493f2ca, 066999ebce2948d5bc6a9a0f38a6f8a7; no voters: 
I20260709 13:05:18.846752 21240 raft_consensus.cc:2804] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:18.846731 20966 raft_consensus.cc:2468] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02d70c63ce4f4f7c819cf745c493f2ca in term 5.
I20260709 13:05:18.847311 21240 raft_consensus.cc:697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 LEADER]: Becoming Leader. State: Replica: 02d70c63ce4f4f7c819cf745c493f2ca, State: Running, Role: LEADER
I20260709 13:05:18.848096 21240 consensus_queue.cc:237] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } }
I20260709 13:05:18.854173 20787 catalog_manager.cc:5697] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca reported cstate change: term changed from 4 to 5, leader changed from a00abf1541f045ef8609dc0c9c56be36 (127.20.69.2) to 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1). New cstate: current_term: 5 leader_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.976141 20966 raft_consensus.cc:1275] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.977377 21240 consensus_queue.cc:1048] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.987756 21039 raft_consensus.cc:1275] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.999348 21250 consensus_queue.cc:1048] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:19.008050 20966 raft_consensus.cc:1275] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Refusing update from remote peer 066999ebce2948d5bc6a9a0f38a6f8a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:19.009193 21232 consensus_queue.cc:1048] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:19.011667 20891 raft_consensus.cc:1275] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 FOLLOWER]: Refusing update from remote peer 066999ebce2948d5bc6a9a0f38a6f8a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:19.013603 21232 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:19.026125 20891 raft_consensus.cc:1275] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Refusing update from remote peer 066999ebce2948d5bc6a9a0f38a6f8a7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:19.031553 21234 consensus_queue.cc:1048] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02d70c63ce4f4f7c819cf745c493f2ca" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 43547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:19.042169 20966 raft_consensus.cc:1275] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 5 FOLLOWER]: Refusing update from remote peer 066999ebce2948d5bc6a9a0f38a6f8a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:19.043673 21234 consensus_queue.cc:1048] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:19.210386 21039 raft_consensus.cc:1275] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:19.211870 21250 consensus_queue.cc:1048] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:19.221110 20966 raft_consensus.cc:1275] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:19.222697 21249 consensus_queue.cc:1048] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:19.445102 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:19.451172 21039 raft_consensus.cc:1275] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:19.451323 20756 tablet_server.cc:179] TabletServer@127.20.69.1:0 shutting down...
I20260709 13:05:19.452976 21251 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "066999ebce2948d5bc6a9a0f38a6f8a7" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 44779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:19.470630 20966 raft_consensus.cc:1275] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 5 FOLLOWER]: Refusing update from remote peer 02d70c63ce4f4f7c819cf745c493f2ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:19.471916 21251 consensus_queue.cc:1048] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a00abf1541f045ef8609dc0c9c56be36" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:19.503968 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:19.504920 20756 tablet_replica.cc:333] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.506098 20756 raft_consensus.cc:2243] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.506839 20756 raft_consensus.cc:2272] T b2575610c4604ceb82419f6bf47acc9b P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.510443 20756 tablet_replica.cc:333] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.511230 20756 raft_consensus.cc:2243] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.512187 20756 raft_consensus.cc:2272] T 6e9166d7d114455cb73fd4861d14f1c0 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.514549 20756 tablet_replica.cc:333] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.515300 20756 raft_consensus.cc:2243] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.515816 20756 raft_consensus.cc:2272] T b100f77bb0514dcd86148e34472f6bda P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:19.515794 20930 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:05:19.518589 20756 tablet_replica.cc:333] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.519361 20756 raft_consensus.cc:2243] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:19.519452 20930 consensus_peers.cc:597] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 -> Peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Couldn't send request to peer 02d70c63ce4f4f7c819cf745c493f2ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.519888 20756 raft_consensus.cc:2272] T 7eceed2523ae416aa7c7781653e88593 P 02d70c63ce4f4f7c819cf745c493f2ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.521762 20756 tablet_replica.cc:333] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.522317 20756 raft_consensus.cc:2243] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.522778 20756 raft_consensus.cc:2272] T aa10d1f4f0424a628ccf25828250db75 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.524960 20756 tablet_replica.cc:333] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.525453 20756 raft_consensus.cc:2243] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.526172 20756 raft_consensus.cc:2272] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 02d70c63ce4f4f7c819cf745c493f2ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.528136 20756 tablet_replica.cc:333] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.528723 20756 raft_consensus.cc:2243] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.529160 20756 raft_consensus.cc:2272] T 905bf4fa78f24c14b6b49baa0f13df43 P 02d70c63ce4f4f7c819cf745c493f2ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.530658 20756 tablet_replica.cc:333] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.531095 20756 raft_consensus.cc:2243] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.531469 20756 raft_consensus.cc:2272] T d96a051abc604b07b8932e56a0825414 P 02d70c63ce4f4f7c819cf745c493f2ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.533346 20756 tablet_replica.cc:333] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca: stopping tablet replica
I20260709 13:05:19.533844 20756 raft_consensus.cc:2243] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.534567 20756 raft_consensus.cc:2272] T acccd54ce09c4f69840b3b1f3abb77ec P 02d70c63ce4f4f7c819cf745c493f2ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.709075 20756 tablet_server.cc:196] TabletServer@127.20.69.1:0 shutdown complete.
W20260709 13:05:19.710544 21004 consensus_peers.cc:597] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 -> Peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Couldn't send request to peer 02d70c63ce4f4f7c819cf745c493f2ca. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:43547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.727152 20756 tablet_server.cc:179] TabletServer@127.20.69.2:0 shutting down...
I20260709 13:05:19.754426 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:19.755189 20756 tablet_replica.cc:333] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.756168 20756 raft_consensus.cc:2243] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.757073 20756 raft_consensus.cc:2272] T 7eceed2523ae416aa7c7781653e88593 P a00abf1541f045ef8609dc0c9c56be36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.759256 20756 tablet_replica.cc:333] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.759934 20756 raft_consensus.cc:2243] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.760397 20756 raft_consensus.cc:2272] T b100f77bb0514dcd86148e34472f6bda P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.762398 20756 tablet_replica.cc:333] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.762876 20756 raft_consensus.cc:2243] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.763271 20756 raft_consensus.cc:2272] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P a00abf1541f045ef8609dc0c9c56be36 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.765259 20756 tablet_replica.cc:333] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.765744 20756 raft_consensus.cc:2243] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.766147 20756 raft_consensus.cc:2272] T 6e9166d7d114455cb73fd4861d14f1c0 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.768060 20756 tablet_replica.cc:333] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.768567 20756 raft_consensus.cc:2243] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.769060 20756 raft_consensus.cc:2272] T b2575610c4604ceb82419f6bf47acc9b P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.771170 20756 tablet_replica.cc:333] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.771654 20756 raft_consensus.cc:2243] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.772034 20756 raft_consensus.cc:2272] T acccd54ce09c4f69840b3b1f3abb77ec P a00abf1541f045ef8609dc0c9c56be36 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.774109 20756 tablet_replica.cc:333] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.774657 20756 raft_consensus.cc:2243] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.775393 20756 raft_consensus.cc:2272] T 905bf4fa78f24c14b6b49baa0f13df43 P a00abf1541f045ef8609dc0c9c56be36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.777149 20756 tablet_replica.cc:333] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.777596 20756 raft_consensus.cc:2243] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.778241 20756 raft_consensus.cc:2272] T d96a051abc604b07b8932e56a0825414 P a00abf1541f045ef8609dc0c9c56be36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.779853 20756 tablet_replica.cc:333] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36: stopping tablet replica
I20260709 13:05:19.780287 20756 raft_consensus.cc:2243] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.780721 20756 raft_consensus.cc:2272] T aa10d1f4f0424a628ccf25828250db75 P a00abf1541f045ef8609dc0c9c56be36 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.809022 20756 tablet_server.cc:196] TabletServer@127.20.69.2:0 shutdown complete.
I20260709 13:05:19.826686 20756 tablet_server.cc:179] TabletServer@127.20.69.3:0 shutting down...
W20260709 13:05:19.844157 21004 consensus_peers.cc:597] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 -> Peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Couldn't send request to peer 02d70c63ce4f4f7c819cf745c493f2ca. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:43547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.852897 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:19.853655 20756 tablet_replica.cc:333] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.854241 20756 raft_consensus.cc:2243] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.854981 20756 raft_consensus.cc:2272] T b100f77bb0514dcd86148e34472f6bda P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.856812 20756 tablet_replica.cc:333] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.857349 20756 raft_consensus.cc:2243] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.857782 20756 raft_consensus.cc:2272] T 7eceed2523ae416aa7c7781653e88593 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.859824 20756 tablet_replica.cc:333] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.860553 20756 raft_consensus.cc:2243] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.861183 20756 raft_consensus.cc:2272] T 905bf4fa78f24c14b6b49baa0f13df43 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.863161 20756 tablet_replica.cc:333] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.863675 20756 raft_consensus.cc:2243] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:19.863685 21004 consensus_peers.cc:597] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 -> Peer 02d70c63ce4f4f7c819cf745c493f2ca (127.20.69.1:43547): Couldn't send request to peer 02d70c63ce4f4f7c819cf745c493f2ca. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:43547: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.864190 20756 raft_consensus.cc:2272] T acccd54ce09c4f69840b3b1f3abb77ec P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.866281 20756 tablet_replica.cc:333] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.866765 20756 raft_consensus.cc:2243] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.867151 20756 raft_consensus.cc:2272] T d96a051abc604b07b8932e56a0825414 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.868741 20756 tablet_replica.cc:333] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.869199 20756 raft_consensus.cc:2243] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.869830 20756 raft_consensus.cc:2272] T b2575610c4604ceb82419f6bf47acc9b P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.871596 20756 tablet_replica.cc:333] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.872069 20756 raft_consensus.cc:2243] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.872439 20756 raft_consensus.cc:2272] T 6e9166d7d114455cb73fd4861d14f1c0 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.874367 20756 tablet_replica.cc:333] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.874838 20756 raft_consensus.cc:2243] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.875507 20756 raft_consensus.cc:2272] T aa10d1f4f0424a628ccf25828250db75 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.877472 20756 tablet_replica.cc:333] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7: stopping tablet replica
I20260709 13:05:19.877926 20756 raft_consensus.cc:2243] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:19.878330 20756 raft_consensus.cc:2272] T 838c1f51e25a4ccdb9ba4d3ab7fd63e8 P 066999ebce2948d5bc6a9a0f38a6f8a7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.904732 20756 tablet_server.cc:196] TabletServer@127.20.69.3:0 shutdown complete.
I20260709 13:05:19.920481 20756 master.cc:562] Master@127.20.69.62:38109 shutting down...
I20260709 13:05:19.998410 20756 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:19.998944 20756 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:19.999233 20756 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3d4d29c6015d45b887cc41223332693b: stopping tablet replica
I20260709 13:05:20.018746 20756 master.cc:584] Master@127.20.69.62:38109 shutdown complete.
02d70c63ce4f4f7c819cf745c493f2ca  4
066999ebce2948d5bc6a9a0f38a6f8a7  1
a00abf1541f045ef8609dc0c9c56be36  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13021 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:20.061300 20756 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.69.62:36565
I20260709 13:05:20.062399 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:20.068282 21269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:20.068323 21270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:20.069099 21272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:20.069717 20756 server_base.cc:1061] running on GCE node
I20260709 13:05:20.070590 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:20.070801 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:20.070967 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602320070946 us; error 0 us; skew 500 ppm
I20260709 13:05:20.071483 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:20.074019 20756 webserver.cc:533] Webserver started at http://127.20.69.62:43495/ using document root <none> and password file <none>
I20260709 13:05:20.074558 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:20.074767 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:20.075055 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:20.076205 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/master-0-root/instance:
uuid: "19723f0c96ec4dde8e09fa20010465a0"
format_stamp: "Formatted at 2026-07-09 13:05:20 on dist-test-slave-56lb"
I20260709 13:05:20.081350 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:05:20.085081 21277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.085985 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:20.086256 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/master-0-root
uuid: "19723f0c96ec4dde8e09fa20010465a0"
format_stamp: "Formatted at 2026-07-09 13:05:20 on dist-test-slave-56lb"
I20260709 13:05:20.086494 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:20.102927 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:20.104182 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:20.142673 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.62:36565
I20260709 13:05:20.142771 21328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.62:36565 every 8 connection(s)
I20260709 13:05:20.146869 21329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.156388 21329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0: Bootstrap starting.
I20260709 13:05:20.161140 21329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.165511 21329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0: No bootstrap required, opened a new log
I20260709 13:05:20.167623 21329 raft_consensus.cc:359] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723f0c96ec4dde8e09fa20010465a0" member_type: VOTER }
I20260709 13:05:20.168017 21329 raft_consensus.cc:385] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.168198 21329 raft_consensus.cc:740] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19723f0c96ec4dde8e09fa20010465a0, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.168785 21329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723f0c96ec4dde8e09fa20010465a0" member_type: VOTER }
I20260709 13:05:20.169220 21329 raft_consensus.cc:399] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:20.169407 21329 raft_consensus.cc:493] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:20.169615 21329 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.173668 21329 raft_consensus.cc:515] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723f0c96ec4dde8e09fa20010465a0" member_type: VOTER }
I20260709 13:05:20.174168 21329 leader_election.cc:304] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19723f0c96ec4dde8e09fa20010465a0; no voters: 
I20260709 13:05:20.175247 21329 leader_election.cc:290] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:20.175685 21332 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.177029 21332 raft_consensus.cc:697] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 1 LEADER]: Becoming Leader. State: Replica: 19723f0c96ec4dde8e09fa20010465a0, State: Running, Role: LEADER
I20260709 13:05:20.177733 21332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723f0c96ec4dde8e09fa20010465a0" member_type: VOTER }
I20260709 13:05:20.178174 21329 sys_catalog.cc:565] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:20.183017 21334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19723f0c96ec4dde8e09fa20010465a0. Latest consensus state: current_term: 1 leader_uuid: "19723f0c96ec4dde8e09fa20010465a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723f0c96ec4dde8e09fa20010465a0" member_type: VOTER } }
I20260709 13:05:20.183056 21333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19723f0c96ec4dde8e09fa20010465a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723f0c96ec4dde8e09fa20010465a0" member_type: VOTER } }
I20260709 13:05:20.184217 21333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:20.184214 21334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:20.187575 21341 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:20.196197 21341 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:20.197219 20756 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:20.205565 21341 catalog_manager.cc:1383] Generated new cluster ID: 8aa74cc4cc33413f937447e010f9b12a
I20260709 13:05:20.205901 21341 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:20.240113 21341 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:20.241400 21341 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:20.255232 21341 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0: Generated new TSK 0
I20260709 13:05:20.255822 21341 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:20.263855 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:20.271136 21350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:20.271759 21351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:20.273972 20756 server_base.cc:1061] running on GCE node
W20260709 13:05:20.274354 21353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:20.275242 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:20.275460 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:20.275650 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602320275629 us; error 0 us; skew 500 ppm
I20260709 13:05:20.276263 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:20.278656 20756 webserver.cc:533] Webserver started at http://127.20.69.1:43191/ using document root <none> and password file <none>
I20260709 13:05:20.279161 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:20.279345 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:20.279650 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:20.280916 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-0-root/instance:
uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
format_stamp: "Formatted at 2026-07-09 13:05:20 on dist-test-slave-56lb"
I20260709 13:05:20.285523 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:05:20.289022 21358 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.289921 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:05:20.290221 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
format_stamp: "Formatted at 2026-07-09 13:05:20 on dist-test-slave-56lb"
I20260709 13:05:20.290506 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:20.340276 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:20.341615 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:20.343189 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:20.345547 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:20.345788 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.346046 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:20.346258 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.386795 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:33931
I20260709 13:05:20.386907 21420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:33931 every 8 connection(s)
I20260709 13:05:20.391928 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:20.398552 21425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:20.400501 21426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:20.402987 20756 server_base.cc:1061] running on GCE node
W20260709 13:05:20.403524 21428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:20.404544 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:20.404855 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:20.405056 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602320405037 us; error 0 us; skew 500 ppm
I20260709 13:05:20.405601 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:20.408097 21421 heartbeater.cc:344] Connected to a master server at 127.20.69.62:36565
I20260709 13:05:20.408515 21421 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:20.408732 20756 webserver.cc:533] Webserver started at http://127.20.69.2:45015/ using document root <none> and password file <none>
I20260709 13:05:20.409260 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:20.409463 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:20.409387 21421 heartbeater.cc:507] Master 127.20.69.62:36565 requested a full tablet report, sending...
I20260709 13:05:20.409916 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:20.411243 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-1-root/instance:
uuid: "dc41728103cd424b8cdd745adb367a42"
format_stamp: "Formatted at 2026-07-09 13:05:20 on dist-test-slave-56lb"
I20260709 13:05:20.411902 21294 ts_manager.cc:194] Registered new tserver with Master: e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931)
I20260709 13:05:20.413715 21294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48970
I20260709 13:05:20.416193 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:05:20.419620 21433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.420503 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:05:20.420917 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-1-root
uuid: "dc41728103cd424b8cdd745adb367a42"
format_stamp: "Formatted at 2026-07-09 13:05:20 on dist-test-slave-56lb"
I20260709 13:05:20.421216 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:20.434932 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:20.436112 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:20.437758 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:20.439972 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:20.440202 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.440446 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:20.440650 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.480299 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.2:39945
I20260709 13:05:20.480399 21495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.2:39945 every 8 connection(s)
I20260709 13:05:20.485188 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:20.492327 21499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:20.494347 21500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:20.495961 20756 server_base.cc:1061] running on GCE node
W20260709 13:05:20.496515 21503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:20.497561 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:20.497753 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:20.497991 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602320497968 us; error 0 us; skew 500 ppm
I20260709 13:05:20.498262 21496 heartbeater.cc:344] Connected to a master server at 127.20.69.62:36565
I20260709 13:05:20.498625 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:20.498641 21496 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:20.499697 21496 heartbeater.cc:507] Master 127.20.69.62:36565 requested a full tablet report, sending...
I20260709 13:05:20.501613 20756 webserver.cc:533] Webserver started at http://127.20.69.3:37447/ using document root <none> and password file <none>
I20260709 13:05:20.501967 21294 ts_manager.cc:194] Registered new tserver with Master: dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:20.502128 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:20.502413 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:20.502719 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:20.503494 21294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48982
I20260709 13:05:20.503875 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-2-root/instance:
uuid: "004fd42abde5482da3997bab9fe56615"
format_stamp: "Formatted at 2026-07-09 13:05:20 on dist-test-slave-56lb"
I20260709 13:05:20.508370 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:20.511590 21507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.512387 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:20.512732 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-2-root
uuid: "004fd42abde5482da3997bab9fe56615"
format_stamp: "Formatted at 2026-07-09 13:05:20 on dist-test-slave-56lb"
I20260709 13:05:20.513019 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602306874617-20756-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:20.525779 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:20.527004 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:20.528484 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:20.530716 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:20.530900 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.531208 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:20.531363 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:20.572433 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.3:32929
I20260709 13:05:20.572558 21569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.3:32929 every 8 connection(s)
I20260709 13:05:20.586556 21570 heartbeater.cc:344] Connected to a master server at 127.20.69.62:36565
I20260709 13:05:20.586926 21570 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:20.587621 21570 heartbeater.cc:507] Master 127.20.69.62:36565 requested a full tablet report, sending...
I20260709 13:05:20.589715 21294 ts_manager.cc:194] Registered new tserver with Master: 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:20.590087 20756 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014570157s
I20260709 13:05:20.591233 21294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48984
I20260709 13:05:20.616777 21294 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48988:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:20.619560 21294 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:20.712527 21461 tablet_service.cc:1511] Processing CreateTablet for tablet 2f938f9320cd4696afb373e1b555bcf9 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:20.714025 21461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f938f9320cd4696afb373e1b555bcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.718423 21535 tablet_service.cc:1511] Processing CreateTablet for tablet 2f938f9320cd4696afb373e1b555bcf9 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:20.719872 21535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f938f9320cd4696afb373e1b555bcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.719760 21531 tablet_service.cc:1511] Processing CreateTablet for tablet ef2b074ee0cd40c299dd960c5376d6aa (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:20.721231 21531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2b074ee0cd40c299dd960c5376d6aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.722710 21534 tablet_service.cc:1511] Processing CreateTablet for tablet 657fe6d93a3f4035a5f6b309528e7e40 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:20.724189 21534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657fe6d93a3f4035a5f6b309528e7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.724064 21527 tablet_service.cc:1511] Processing CreateTablet for tablet 2c89536001064080a0ae61e149ab6639 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:20.724356 21457 tablet_service.cc:1511] Processing CreateTablet for tablet ef2b074ee0cd40c299dd960c5376d6aa (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:20.725459 21527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c89536001064080a0ae61e149ab6639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.725791 21533 tablet_service.cc:1511] Processing CreateTablet for tablet 4caa0632fc084a3ba00e4591c1164fe4 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:20.727212 21533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caa0632fc084a3ba00e4591c1164fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.728397 21455 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0ac16069ee4b28816ccd74228908d8 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:20.729773 21529 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0ac16069ee4b28816ccd74228908d8 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:20.730705 21454 tablet_service.cc:1511] Processing CreateTablet for tablet 010ac5750f72443592e91738f23651e4 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:20.730899 21459 tablet_service.cc:1511] Processing CreateTablet for tablet 4caa0632fc084a3ba00e4591c1164fe4 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:20.732457 21528 tablet_service.cc:1511] Processing CreateTablet for tablet 010ac5750f72443592e91738f23651e4 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:20.732816 21458 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbb0c6600224fbba0f8bf3ae60781b2 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:20.733211 21530 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5207661974b1f88fab5cb4f6fc58d (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:20.727206 21456 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5207661974b1f88fab5cb4f6fc58d (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:20.734689 21460 tablet_service.cc:1511] Processing CreateTablet for tablet 657fe6d93a3f4035a5f6b309528e7e40 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:20.729803 21532 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbb0c6600224fbba0f8bf3ae60781b2 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:20.732816 21453 tablet_service.cc:1511] Processing CreateTablet for tablet 2c89536001064080a0ae61e149ab6639 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:20.740424 21386 tablet_service.cc:1511] Processing CreateTablet for tablet 2f938f9320cd4696afb373e1b555bcf9 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:20.740674 21385 tablet_service.cc:1511] Processing CreateTablet for tablet 657fe6d93a3f4035a5f6b309528e7e40 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:20.741729 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f938f9320cd4696afb373e1b555bcf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.741868 21452 tablet_service.cc:1511] Processing CreateTablet for tablet 383e479ca3cf4a31919de3b97f703e46 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:20.740674 21526 tablet_service.cc:1511] Processing CreateTablet for tablet 383e479ca3cf4a31919de3b97f703e46 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:20.742784 21385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657fe6d93a3f4035a5f6b309528e7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.731133 21529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0ac16069ee4b28816ccd74228908d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.748023 21532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbb0c6600224fbba0f8bf3ae60781b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.748826 21526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383e479ca3cf4a31919de3b97f703e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.725747 21457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2b074ee0cd40c299dd960c5376d6aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.749950 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0ac16069ee4b28816ccd74228908d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.750532 21459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caa0632fc084a3ba00e4591c1164fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.753961 21384 tablet_service.cc:1511] Processing CreateTablet for tablet 4caa0632fc084a3ba00e4591c1164fe4 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:20.755462 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caa0632fc084a3ba00e4591c1164fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.755920 21458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbb0c6600224fbba0f8bf3ae60781b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.756956 21460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657fe6d93a3f4035a5f6b309528e7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.758674 21452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383e479ca3cf4a31919de3b97f703e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.759723 21453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c89536001064080a0ae61e149ab6639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.761808 21454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010ac5750f72443592e91738f23651e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.762265 21383 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbb0c6600224fbba0f8bf3ae60781b2 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:20.763655 21383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbb0c6600224fbba0f8bf3ae60781b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.766944 21382 tablet_service.cc:1511] Processing CreateTablet for tablet ef2b074ee0cd40c299dd960c5376d6aa (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:20.769416 21381 tablet_service.cc:1511] Processing CreateTablet for tablet 17d5207661974b1f88fab5cb4f6fc58d (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:20.772011 21380 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0ac16069ee4b28816ccd74228908d8 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:20.775496 21378 tablet_service.cc:1511] Processing CreateTablet for tablet 2c89536001064080a0ae61e149ab6639 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:20.783299 21382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2b074ee0cd40c299dd960c5376d6aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.786969 21379 tablet_service.cc:1511] Processing CreateTablet for tablet 010ac5750f72443592e91738f23651e4 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:20.790110 21377 tablet_service.cc:1511] Processing CreateTablet for tablet 383e479ca3cf4a31919de3b97f703e46 (DEFAULT_TABLE table=test-workload [id=6f73954cdedc4cfeb988ca405d75d03b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:20.796909 21528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010ac5750f72443592e91738f23651e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.800877 21456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5207661974b1f88fab5cb4f6fc58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.804874 21378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c89536001064080a0ae61e149ab6639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.837119 21585 tablet_bootstrap.cc:492] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:20.852033 21530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5207661974b1f88fab5cb4f6fc58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.852514 21379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010ac5750f72443592e91738f23651e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.852514 21586 tablet_bootstrap.cc:492] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:20.853200 21380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0ac16069ee4b28816ccd74228908d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.861030 21381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d5207661974b1f88fab5cb4f6fc58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.879758 21377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383e479ca3cf4a31919de3b97f703e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:20.897522 21586 tablet_bootstrap.cc:654] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.913769 21587 tablet_bootstrap.cc:492] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:20.920162 21585 tablet_bootstrap.cc:654] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.925310 21587 tablet_bootstrap.cc:654] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.943567 21586 tablet_bootstrap.cc:492] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:20.944077 21586 ts_tablet_manager.cc:1403] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.032s
I20260709 13:05:20.946861 21586 raft_consensus.cc:359] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:20.949368 21586 raft_consensus.cc:385] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.949786 21586 raft_consensus.cc:740] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.950738 21587 tablet_bootstrap.cc:492] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:20.951205 21587 ts_tablet_manager.cc:1403] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.009s
I20260709 13:05:20.950953 21586 consensus_queue.cc:260] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:20.954203 21587 raft_consensus.cc:359] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:20.954926 21587 raft_consensus.cc:385] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.955251 21587 raft_consensus.cc:740] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.955967 21587 consensus_queue.cc:260] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:20.956645 21585 tablet_bootstrap.cc:492] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:20.957238 21585 ts_tablet_manager.cc:1403] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.016s
I20260709 13:05:20.958081 21421 heartbeater.cc:499] Master 127.20.69.62:36565 was elected leader, sending a full tablet report...
I20260709 13:05:20.958341 21586 ts_tablet_manager.cc:1434] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.005s
I20260709 13:05:20.959417 21586 tablet_bootstrap.cc:492] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:20.960224 21585 raft_consensus.cc:359] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:20.961090 21585 raft_consensus.cc:385] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.961392 21585 raft_consensus.cc:740] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.962348 21585 consensus_queue.cc:260] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:20.965260 21587 ts_tablet_manager.cc:1434] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.009s
I20260709 13:05:20.966848 21586 tablet_bootstrap.cc:654] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.966921 21496 heartbeater.cc:499] Master 127.20.69.62:36565 was elected leader, sending a full tablet report...
I20260709 13:05:20.975983 21587 tablet_bootstrap.cc:492] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:20.982859 21587 tablet_bootstrap.cc:654] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.989248 21585 ts_tablet_manager.cc:1434] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.025s
I20260709 13:05:20.989511 21570 heartbeater.cc:499] Master 127.20.69.62:36565 was elected leader, sending a full tablet report...
I20260709 13:05:20.990255 21585 tablet_bootstrap.cc:492] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:20.991114 21586 tablet_bootstrap.cc:492] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:20.991714 21586 ts_tablet_manager.cc:1403] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.018s
I20260709 13:05:20.997084 21585 tablet_bootstrap.cc:654] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.996172 21586 raft_consensus.cc:359] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.000243 21586 raft_consensus.cc:385] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.000641 21586 raft_consensus.cc:740] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.001219 21587 tablet_bootstrap.cc:492] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.001736 21587 ts_tablet_manager.cc:1403] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 13:05:21.001309 21586 consensus_queue.cc:260] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.003248 21586 ts_tablet_manager.cc:1434] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 13:05:21.004076 21586 tablet_bootstrap.cc:492] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:21.004735 21587 raft_consensus.cc:359] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.005461 21587 raft_consensus.cc:385] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.005788 21587 raft_consensus.cc:740] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.006558 21587 consensus_queue.cc:260] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.009086 21587 ts_tablet_manager.cc:1434] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:21.009987 21587 tablet_bootstrap.cc:492] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:21.010106 21586 tablet_bootstrap.cc:654] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.010787 21585 tablet_bootstrap.cc:492] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.011339 21585 ts_tablet_manager.cc:1403] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:05:21.015149 21585 raft_consensus.cc:359] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.016220 21585 raft_consensus.cc:385] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.016723 21585 raft_consensus.cc:740] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.016952 21587 tablet_bootstrap.cc:654] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.018117 21585 consensus_queue.cc:260] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.021653 21585 ts_tablet_manager.cc:1434] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:05:21.023119 21585 tablet_bootstrap.cc:492] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:21.032270 21585 tablet_bootstrap.cc:654] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.057101 21586 tablet_bootstrap.cc:492] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:21.057627 21586 ts_tablet_manager.cc:1403] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.054s	user 0.041s	sys 0.011s
I20260709 13:05:21.058043 21587 tablet_bootstrap.cc:492] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.058543 21587 ts_tablet_manager.cc:1403] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.024s
I20260709 13:05:21.058972 21585 tablet_bootstrap.cc:492] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.059387 21585 ts_tablet_manager.cc:1403] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.024s
I20260709 13:05:21.060514 21586 raft_consensus.cc:359] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.061296 21586 raft_consensus.cc:385] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.061317 21587 raft_consensus.cc:359] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.061726 21586 raft_consensus.cc:740] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.061589 21585 raft_consensus.cc:359] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.062144 21587 raft_consensus.cc:385] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.062366 21585 raft_consensus.cc:385] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.062477 21587 raft_consensus.cc:740] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.062726 21585 raft_consensus.cc:740] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.062690 21586 consensus_queue.cc:260] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.063458 21587 consensus_queue.cc:260] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.063645 21585 consensus_queue.cc:260] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.065088 21586 ts_tablet_manager.cc:1434] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:05:21.066090 21586 tablet_bootstrap.cc:492] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:21.068006 21585 ts_tablet_manager.cc:1434] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:21.068995 21585 tablet_bootstrap.cc:492] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:21.071679 21587 ts_tablet_manager.cc:1434] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:05:21.072585 21586 tablet_bootstrap.cc:654] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.072783 21587 tablet_bootstrap.cc:492] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:21.075732 21585 tablet_bootstrap.cc:654] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.081665 21587 tablet_bootstrap.cc:654] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.090680 21591 raft_consensus.cc:493] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.091413 21591 raft_consensus.cc:515] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.103075 21591 leader_election.cc:290] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.171695 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.172905 21586 tablet_bootstrap.cc:492] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:21.173079 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.173477 21586 ts_tablet_manager.cc:1403] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.108s	user 0.032s	sys 0.070s
I20260709 13:05:21.173844 21585 tablet_bootstrap.cc:492] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.173733 21471 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 0.
I20260709 13:05:21.174279 21585 ts_tablet_manager.cc:1403] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.105s	user 0.048s	sys 0.049s
W20260709 13:05:21.175103 21362 leader_election.cc:343] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.175400 21587 tablet_bootstrap.cc:492] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.175876 21587 ts_tablet_manager.cc:1403] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.103s	user 0.040s	sys 0.056s
I20260709 13:05:21.176090 21361 leader_election.cc:304] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 004fd42abde5482da3997bab9fe56615
I20260709 13:05:21.176360 21586 raft_consensus.cc:359] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.177174 21586 raft_consensus.cc:385] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.177294 21591 raft_consensus.cc:2804] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.177527 21586 raft_consensus.cc:740] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.177253 21585 raft_consensus.cc:359] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.177917 21591 raft_consensus.cc:493] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.178064 21585 raft_consensus.cc:385] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.178294 21591 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.178392 21585 raft_consensus.cc:740] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.178368 21586 consensus_queue.cc:260] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.178784 21587 raft_consensus.cc:359] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.179522 21587 raft_consensus.cc:385] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.179575 21585 consensus_queue.cc:260] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.179976 21587 raft_consensus.cc:740] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.181216 21587 consensus_queue.cc:260] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.182240 21585 ts_tablet_manager.cc:1434] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:21.183251 21585 tablet_bootstrap.cc:492] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:21.187810 21587 ts_tablet_manager.cc:1434] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:21.189473 21587 tablet_bootstrap.cc:492] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:21.190704 21585 tablet_bootstrap.cc:654] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:21.192269 21342 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:21.194423 21593 raft_consensus.cc:493] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.195060 21593 raft_consensus.cc:515] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.198316 21592 raft_consensus.cc:493] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.198540 21587 tablet_bootstrap.cc:654] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.198796 21592 raft_consensus.cc:515] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.200170 21593 leader_election.cc:290] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:21.202714 21592 leader_election.cc:290] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.207593 21591 raft_consensus.cc:515] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.214290 21587 tablet_bootstrap.cc:492] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.232664 21593 raft_consensus.cc:493] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.232888 21587 ts_tablet_manager.cc:1403] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.008s
I20260709 13:05:21.234078 21586 ts_tablet_manager.cc:1434] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.060s	user 0.018s	sys 0.030s
I20260709 13:05:21.234629 21591 leader_election.cc:290] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.235013 21586 tablet_bootstrap.cc:492] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:21.235071 21605 raft_consensus.cc:493] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.235571 21605 raft_consensus.cc:515] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.235867 21587 raft_consensus.cc:359] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.236878 21593 raft_consensus.cc:515] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.237612 21605 leader_election.cc:290] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.239336 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:21.239647 21585 tablet_bootstrap.cc:492] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.239907 21471 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.240108 21585 ts_tablet_manager.cc:1403] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.010s
I20260709 13:05:21.241744 21586 tablet_bootstrap.cc:654] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.243155 21585 raft_consensus.cc:359] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:21.243917 21585 raft_consensus.cc:385] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.244213 21585 raft_consensus.cc:740] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.245697 21587 raft_consensus.cc:385] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.245533 21585 consensus_queue.cc:260] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:21.245879 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.246106 21587 raft_consensus.cc:740] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.247766 21585 ts_tablet_manager.cc:1434] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:05:21.247397 21587 consensus_queue.cc:260] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.249783 21587 ts_tablet_manager.cc:1434] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:05:21.250784 21587 tablet_bootstrap.cc:492] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:21.251411 21585 tablet_bootstrap.cc:492] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
W20260709 13:05:21.252919 21361 leader_election.cc:343] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.258348 21585 tablet_bootstrap.cc:654] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.269433 21471 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 1.
I20260709 13:05:21.270351 21585 tablet_bootstrap.cc:492] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.270900 21585 ts_tablet_manager.cc:1403] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 13:05:21.273931 21585 raft_consensus.cc:359] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.270725 21361 leader_election.cc:304] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.275213 21585 raft_consensus.cc:385] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.275257 21605 raft_consensus.cc:2804] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.275689 21585 raft_consensus.cc:740] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.276288 21593 leader_election.cc:290] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:21.226657 21613 raft_consensus.cc:493] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.276208 21605 raft_consensus.cc:697] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:21.276685 21585 consensus_queue.cc:260] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.278267 21605 consensus_queue.cc:237] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.277053 21613 raft_consensus.cc:515] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:21.274230 21611 raft_consensus.cc:493] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.283808 21587 tablet_bootstrap.cc:654] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.283753 21613 leader_election.cc:290] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929), e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931)
I20260709 13:05:21.284888 21585 ts_tablet_manager.cc:1434] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:21.286624 21585 tablet_bootstrap.cc:492] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:21.288429 21612 raft_consensus.cc:493] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.293231 21585 tablet_bootstrap.cc:654] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.294831 21612 raft_consensus.cc:515] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.297189 21612 leader_election.cc:290] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:21.297992 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:21.298848 21545 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.307205 21585 tablet_bootstrap.cc:492] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.307466 21545 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 1.
I20260709 13:05:21.307900 21585 ts_tablet_manager.cc:1403] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:05:21.310439 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.311084 21585 raft_consensus.cc:359] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.311117 21545 raft_consensus.cc:2468] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 0.
I20260709 13:05:21.311928 21585 raft_consensus.cc:385] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.312351 21585 raft_consensus.cc:740] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.312772 21362 leader_election.cc:304] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: dc41728103cd424b8cdd745adb367a42
I20260709 13:05:21.313624 21591 raft_consensus.cc:2804] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.313371 21585 consensus_queue.cc:260] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.313987 21591 raft_consensus.cc:493] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.314464 21591 raft_consensus.cc:3060] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.321841 21591 raft_consensus.cc:515] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.324945 21585 ts_tablet_manager.cc:1434] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.006s
I20260709 13:05:21.327802 21585 tablet_bootstrap.cc:492] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:21.328292 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:21.326735 21591 leader_election.cc:290] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.330178 21291 catalog_manager.cc:5697] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:21.332525 21361 leader_election.cc:343] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.333113 21593 raft_consensus.cc:493] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.333669 21593 raft_consensus.cc:515] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:21.283851 21611 raft_consensus.cc:515] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.335652 21593 leader_election.cc:290] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931)
I20260709 13:05:21.336159 21593 raft_consensus.cc:493] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.336624 21593 raft_consensus.cc:515] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.338408 21593 leader_election.cc:290] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:21.338376 21611 leader_election.cc:290] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.340649 21585 tablet_bootstrap.cc:654] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.342873 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.343593 21471 raft_consensus.cc:2468] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 0.
I20260709 13:05:21.345072 21361 leader_election.cc:304] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.349161 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.349459 21611 raft_consensus.cc:2804] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.349977 21611 raft_consensus.cc:493] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.350450 21611 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.353295 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
W20260709 13:05:21.354449 21436 leader_election.cc:343] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.356385 21436 leader_election.cc:343] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.360095 21587 tablet_bootstrap.cc:492] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.361490 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.362346 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.362690 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.362881 21544 raft_consensus.cc:2468] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 0.
I20260709 13:05:21.361827 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:21.363705 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
W20260709 13:05:21.363842 21437 leader_election.cc:343] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.364563 21396 raft_consensus.cc:2393] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 004fd42abde5482da3997bab9fe56615 in current term 1: Already voted for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in this term.
I20260709 13:05:21.364455 21437 leader_election.cc:304] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc41728103cd424b8cdd745adb367a42; no voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.365424 21587 ts_tablet_manager.cc:1403] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.002s
I20260709 13:05:21.365926 21437 leader_election.cc:304] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.363981 21543 raft_consensus.cc:3060] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.366827 21586 tablet_bootstrap.cc:492] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:21.366534 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.367383 21586 ts_tablet_manager.cc:1403] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.133s	user 0.050s	sys 0.053s
I20260709 13:05:21.368819 21592 raft_consensus.cc:2749] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.369063 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.369607 21592 raft_consensus.cc:2804] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.370007 21592 raft_consensus.cc:493] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.370388 21592 raft_consensus.cc:3060] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.371512 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.373306 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caa0632fc084a3ba00e4591c1164fe4" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.373966 21395 raft_consensus.cc:2468] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 0.
I20260709 13:05:21.374558 21587 raft_consensus.cc:359] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.375321 21587 raft_consensus.cc:385] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.375697 21587 raft_consensus.cc:740] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.376060 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.376557 21587 consensus_queue.cc:260] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.378121 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.380704 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.381801 21587 ts_tablet_manager.cc:1434] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:05:21.383167 21587 tablet_bootstrap.cc:492] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:21.382843 21586 raft_consensus.cc:359] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:21.388954 21586 raft_consensus.cc:385] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.389365 21586 raft_consensus.cc:740] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.390314 21543 raft_consensus.cc:2468] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 1.
I20260709 13:05:21.390621 21585 tablet_bootstrap.cc:492] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.391052 21585 ts_tablet_manager.cc:1403] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.016s
I20260709 13:05:21.390417 21586 consensus_queue.cc:260] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:21.391731 21592 raft_consensus.cc:515] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:21.394884 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.395737 21471 raft_consensus.cc:2393] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 004fd42abde5482da3997bab9fe56615 in current term 1: Already voted for candidate dc41728103cd424b8cdd745adb367a42 in this term.
I20260709 13:05:21.395848 21586 ts_tablet_manager.cc:1434] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:05:21.396986 21586 tablet_bootstrap.cc:492] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:21.397392 21592 leader_election.cc:290] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Requested vote from peers 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929), e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931)
I20260709 13:05:21.397529 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caa0632fc084a3ba00e4591c1164fe4" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.398203 21471 raft_consensus.cc:2468] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 0.
I20260709 13:05:21.398300 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:21.398886 21543 raft_consensus.cc:3060] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.398895 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:21.399570 21395 raft_consensus.cc:3060] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:21.400413 21510 leader_election.cc:343] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:21.401175 21510 leader_election.cc:343] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.401871 21510 leader_election.cc:304] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.396441 21587 tablet_bootstrap.cc:654] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.404765 21586 tablet_bootstrap.cc:654] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:21.404898 21362 leader_election.cc:343] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.405903 21362 leader_election.cc:304] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: dc41728103cd424b8cdd745adb367a42
I20260709 13:05:21.406051 21543 raft_consensus.cc:2468] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 1.
I20260709 13:05:21.407246 21605 raft_consensus.cc:2804] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.407351 21437 leader_election.cc:304] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:21.407809 21605 raft_consensus.cc:697] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:21.407394 21585 raft_consensus.cc:359] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.408319 21585 raft_consensus.cc:385] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.408385 21592 raft_consensus.cc:2804] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.408699 21585 raft_consensus.cc:740] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.408722 21605 consensus_queue.cc:237] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.409679 21592 raft_consensus.cc:697] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:21.409615 21585 consensus_queue.cc:260] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.410640 21592 consensus_queue.cc:237] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:21.412499 21585 ts_tablet_manager.cc:1434] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 13:05:21.416288 21585 tablet_bootstrap.cc:492] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:21.426158 21586 tablet_bootstrap.cc:492] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:21.426786 21586 ts_tablet_manager.cc:1403] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.010s
I20260709 13:05:21.426517 21611 raft_consensus.cc:515] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.430589 21395 raft_consensus.cc:2468] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 1.
W20260709 13:05:21.430745 21510 leader_election.cc:343] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.429961 21586 raft_consensus.cc:359] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.431201 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:21.432087 21620 raft_consensus.cc:2804] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.432256 21586 raft_consensus.cc:385] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.432399 21471 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.432528 21620 raft_consensus.cc:493] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.432686 21586 raft_consensus.cc:740] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.433019 21620 raft_consensus.cc:3060] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.433406 21587 tablet_bootstrap.cc:492] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.433954 21587 ts_tablet_manager.cc:1403] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 13:05:21.433614 21586 consensus_queue.cc:260] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.436089 21586 ts_tablet_manager.cc:1434] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:21.437148 21587 raft_consensus.cc:359] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.438011 21587 raft_consensus.cc:385] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.438370 21587 raft_consensus.cc:740] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.431246 21510 leader_election.cc:304] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 004fd42abde5482da3997bab9fe56615; no voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.439457 21612 raft_consensus.cc:2749] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.437145 21586 tablet_bootstrap.cc:492] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:21.441092 21471 raft_consensus.cc:2468] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 1.
I20260709 13:05:21.439265 21587 consensus_queue.cc:260] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.442349 21361 leader_election.cc:304] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
W20260709 13:05:21.442720 21510 leader_election.cc:343] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.443269 21605 raft_consensus.cc:2804] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.443455 21510 leader_election.cc:304] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 004fd42abde5482da3997bab9fe56615; no voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.443809 21605 raft_consensus.cc:697] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
W20260709 13:05:21.444661 21510 leader_election.cc:343] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.444739 21605 consensus_queue.cc:237] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.445237 21510 leader_election.cc:304] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 004fd42abde5482da3997bab9fe56615; no voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.445998 21593 raft_consensus.cc:2749] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.446592 21593 raft_consensus.cc:2749] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.444621 21587 ts_tablet_manager.cc:1434] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:05:21.448565 21510 leader_election.cc:304] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 004fd42abde5482da3997bab9fe56615; no voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.449450 21612 raft_consensus.cc:2749] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.450997 21586 tablet_bootstrap.cc:654] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.439260 21585 tablet_bootstrap.cc:654] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.454882 21587 tablet_bootstrap.cc:492] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:21.458148 21291 catalog_manager.cc:5697] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.460743 21611 leader_election.cc:290] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.460151 21620 raft_consensus.cc:515] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.461783 21587 tablet_bootstrap.cc:654] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.461818 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
W20260709 13:05:21.463377 21362 leader_election.cc:343] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.464851 21620 leader_election.cc:290] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:21.465664 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caa0632fc084a3ba00e4591c1164fe4" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:21.466503 21395 raft_consensus.cc:3060] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.468022 21585 tablet_bootstrap.cc:492] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.468667 21585 ts_tablet_manager.cc:1403] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.001s
I20260709 13:05:21.472224 21585 raft_consensus.cc:359] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.473187 21585 raft_consensus.cc:385] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.473536 21585 raft_consensus.cc:740] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.474471 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caa0632fc084a3ba00e4591c1164fe4" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:21.475325 21471 raft_consensus.cc:3060] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.475699 21585 consensus_queue.cc:260] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.477190 21586 tablet_bootstrap.cc:492] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:21.477756 21586 ts_tablet_manager.cc:1403] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.020s
I20260709 13:05:21.480845 21586 raft_consensus.cc:359] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.481639 21586 raft_consensus.cc:385] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.481997 21586 raft_consensus.cc:740] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.482520 21585 ts_tablet_manager.cc:1434] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:05:21.482865 21586 consensus_queue.cc:260] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.483549 21585 tablet_bootstrap.cc:492] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615: Bootstrap starting.
I20260709 13:05:21.485280 21586 ts_tablet_manager.cc:1434] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:21.486377 21586 tablet_bootstrap.cc:492] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:21.486936 21395 raft_consensus.cc:2468] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 1.
I20260709 13:05:21.490113 21585 tablet_bootstrap.cc:654] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.497273 21586 tablet_bootstrap.cc:654] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.501704 21585 tablet_bootstrap.cc:492] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615: No bootstrap required, opened a new log
I20260709 13:05:21.502287 21585 ts_tablet_manager.cc:1403] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:05:21.504880 21289 catalog_manager.cc:5697] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.511528 21586 tablet_bootstrap.cc:492] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:21.512115 21586 ts_tablet_manager.cc:1403] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:05:21.515280 21586 raft_consensus.cc:359] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.516079 21586 raft_consensus.cc:385] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.516458 21586 raft_consensus.cc:740] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.516222 21585 raft_consensus.cc:359] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.516970 21585 raft_consensus.cc:385] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.517270 21585 raft_consensus.cc:740] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.517459 21586 consensus_queue.cc:260] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.518091 21585 consensus_queue.cc:260] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.520426 21586 ts_tablet_manager.cc:1434] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:21.521461 21586 tablet_bootstrap.cc:492] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:21.522967 21585 ts_tablet_manager.cc:1434] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:05:21.527024 21586 tablet_bootstrap.cc:654] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.528152 21471 raft_consensus.cc:2468] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 1.
I20260709 13:05:21.530237 21510 leader_election.cc:304] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.531121 21620 raft_consensus.cc:2804] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.531788 21620 raft_consensus.cc:697] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 1 LEADER]: Becoming Leader. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:21.532935 21620 consensus_queue.cc:237] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.534533 21587 tablet_bootstrap.cc:492] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.535010 21587 ts_tablet_manager.cc:1403] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.080s	user 0.036s	sys 0.030s
I20260709 13:05:21.537781 21587 raft_consensus.cc:359] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.538488 21587 raft_consensus.cc:385] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.538803 21587 raft_consensus.cc:740] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.539551 21587 consensus_queue.cc:260] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.541888 21587 ts_tablet_manager.cc:1434] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:05:21.542869 21587 tablet_bootstrap.cc:492] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:21.546330 21592 raft_consensus.cc:493] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.546973 21592 raft_consensus.cc:515] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.549141 21294 catalog_manager.cc:5697] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.549088 21586 tablet_bootstrap.cc:492] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:21.554270 21586 ts_tablet_manager.cc:1403] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.002s
I20260709 13:05:21.554323 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.555569 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.556214 21543 raft_consensus.cc:2468] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 0.
I20260709 13:05:21.551748 21592 leader_election.cc:290] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.553653 21587 tablet_bootstrap.cc:654] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.557320 21586 raft_consensus.cc:359] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.558123 21586 raft_consensus.cc:385] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.558463 21586 raft_consensus.cc:740] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.559173 21586 consensus_queue.cc:260] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.561277 21586 ts_tablet_manager.cc:1434] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260709 13:05:21.561215 21436 leader_election.cc:343] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.562328 21586 tablet_bootstrap.cc:492] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873: Bootstrap starting.
I20260709 13:05:21.563239 21437 leader_election.cc:304] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.564217 21592 raft_consensus.cc:2804] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.564572 21592 raft_consensus.cc:493] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.564960 21592 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.568055 21586 tablet_bootstrap.cc:654] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.572590 21592 raft_consensus.cc:515] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.574255 21291 catalog_manager.cc:5697] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 reported cstate change: term changed from 0 to 1, leader changed from <none> to 004fd42abde5482da3997bab9fe56615 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "004fd42abde5482da3997bab9fe56615" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.576723 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
W20260709 13:05:21.578691 21436 leader_election.cc:343] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.580780 21592 leader_election.cc:290] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.583065 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:21.583711 21543 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.593457 21543 raft_consensus.cc:2468] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 1.
I20260709 13:05:21.595204 21437 leader_election.cc:304] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.596377 21592 raft_consensus.cc:2804] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.596873 21592 raft_consensus.cc:697] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:21.597218 21586 tablet_bootstrap.cc:492] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873: No bootstrap required, opened a new log
I20260709 13:05:21.597394 21587 tablet_bootstrap.cc:492] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.597664 21586 ts_tablet_manager.cc:1403] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.017s
I20260709 13:05:21.597774 21587 ts_tablet_manager.cc:1403] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.023s
I20260709 13:05:21.597702 21592 consensus_queue.cc:237] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.600425 21586 raft_consensus.cc:359] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.600575 21587 raft_consensus.cc:359] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.601184 21586 raft_consensus.cc:385] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.601598 21586 raft_consensus.cc:740] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.602274 21586 consensus_queue.cc:260] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.601228 21587 raft_consensus.cc:385] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.604036 21586 ts_tablet_manager.cc:1434] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:21.604151 21587 raft_consensus.cc:740] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.604987 21587 consensus_queue.cc:260] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.606438 21587 ts_tablet_manager.cc:1434] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:05:21.607157 21587 tablet_bootstrap.cc:492] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42: Bootstrap starting.
I20260709 13:05:21.607635 21291 catalog_manager.cc:5697] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.611827 21587 tablet_bootstrap.cc:654] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.617738 21587 tablet_bootstrap.cc:492] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42: No bootstrap required, opened a new log
I20260709 13:05:21.618217 21587 ts_tablet_manager.cc:1403] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:05:21.620095 21587 raft_consensus.cc:359] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.620723 21587 raft_consensus.cc:385] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.621011 21587 raft_consensus.cc:740] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.621698 21587 consensus_queue.cc:260] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.623180 21613 raft_consensus.cc:493] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.623729 21587 ts_tablet_manager.cc:1434] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:05:21.623632 21613 raft_consensus.cc:515] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.625797 21613 leader_election.cc:290] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.626519 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.626849 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.627631 21543 raft_consensus.cc:2393] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc41728103cd424b8cdd745adb367a42 in current term 1: Already voted for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in this term.
I20260709 13:05:21.628542 21437 leader_election.cc:304] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc41728103cd424b8cdd745adb367a42; no voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.629259 21613 raft_consensus.cc:3060] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.630651 21592 raft_consensus.cc:493] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.631132 21592 raft_consensus.cc:515] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.632817 21592 leader_election.cc:290] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.633459 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383e479ca3cf4a31919de3b97f703e46" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.634104 21395 raft_consensus.cc:2468] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 0.
I20260709 13:05:21.635022 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383e479ca3cf4a31919de3b97f703e46" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.635169 21436 leader_election.cc:304] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.635506 21613 raft_consensus.cc:2749] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.635643 21543 raft_consensus.cc:2468] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 0.
I20260709 13:05:21.636190 21592 raft_consensus.cc:2804] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.636574 21592 raft_consensus.cc:493] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.636972 21592 raft_consensus.cc:3060] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.641386 21592 raft_consensus.cc:515] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.642939 21592 leader_election.cc:290] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.643777 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383e479ca3cf4a31919de3b97f703e46" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:21.644042 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383e479ca3cf4a31919de3b97f703e46" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:21.644380 21395 raft_consensus.cc:3060] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.644537 21543 raft_consensus.cc:3060] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.651206 21543 raft_consensus.cc:2468] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 1.
I20260709 13:05:21.651206 21395 raft_consensus.cc:2468] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 1.
I20260709 13:05:21.652765 21611 raft_consensus.cc:493] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.652722 21436 leader_election.cc:304] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.653328 21611 raft_consensus.cc:515] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.653976 21592 raft_consensus.cc:2804] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.654419 21592 raft_consensus.cc:697] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:21.655184 21611 leader_election.cc:290] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.655205 21592 consensus_queue.cc:237] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.655928 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.656515 21471 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 0.
I20260709 13:05:21.656709 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.657658 21361 leader_election.cc:304] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.657748 21543 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 0.
I20260709 13:05:21.658529 21611 raft_consensus.cc:2804] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.658947 21611 raft_consensus.cc:493] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.659389 21611 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.665100 21611 raft_consensus.cc:515] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.667204 21611 leader_election.cc:290] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.666786 21290 catalog_manager.cc:5697] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.667932 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:21.668322 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:21.668491 21471 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.668880 21543 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.674885 21471 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 1.
I20260709 13:05:21.676059 21361 leader_election.cc:304] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.676404 21543 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 1.
I20260709 13:05:21.676761 21611 raft_consensus.cc:2804] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.677768 21611 raft_consensus.cc:697] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:21.678454 21611 consensus_queue.cc:237] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.685972 21290 catalog_manager.cc:5697] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.689297 21592 raft_consensus.cc:493] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.689818 21592 raft_consensus.cc:515] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.692588 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" is_pre_election: true
I20260709 13:05:21.692818 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.693269 21395 raft_consensus.cc:2468] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 0.
I20260709 13:05:21.693328 21543 raft_consensus.cc:2468] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 0.
I20260709 13:05:21.694396 21592 leader_election.cc:290] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.694623 21436 leader_election.cc:304] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.695436 21592 raft_consensus.cc:2804] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.695737 21592 raft_consensus.cc:493] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.696007 21592 raft_consensus.cc:3060] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.700503 21592 raft_consensus.cc:515] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.702169 21592 leader_election.cc:290] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.703123 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:21.703097 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:21.703855 21395 raft_consensus.cc:3060] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.703871 21543 raft_consensus.cc:3060] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.710449 21611 consensus_queue.cc:1048] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.710613 21543 raft_consensus.cc:2468] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 1.
I20260709 13:05:21.710613 21395 raft_consensus.cc:2468] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 1.
I20260709 13:05:21.711869 21437 leader_election.cc:304] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:21.712654 21592 raft_consensus.cc:2804] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.714504 21592 raft_consensus.cc:697] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:21.715530 21592 consensus_queue.cc:237] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.724648 21290 catalog_manager.cc:5697] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.730080 21611 consensus_queue.cc:1048] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.754650 21611 raft_consensus.cc:493] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.755092 21611 raft_consensus.cc:515] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.757153 21611 leader_election.cc:290] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.758330 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.758330 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.759119 21471 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 0.
I20260709 13:05:21.759119 21543 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 0.
I20260709 13:05:21.760489 21361 leader_election.cc:304] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.761655 21611 raft_consensus.cc:2804] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.761987 21611 raft_consensus.cc:493] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.762287 21611 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.768640 21611 raft_consensus.cc:515] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.770330 21611 leader_election.cc:290] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.771423 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:21.771339 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:21.772027 21543 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.772100 21471 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.776993 21471 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 1.
I20260709 13:05:21.776991 21543 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 1.
I20260709 13:05:21.778213 21361 leader_election.cc:304] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:21.778906 21611 raft_consensus.cc:2804] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.779428 21611 raft_consensus.cc:697] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:21.780114 21611 consensus_queue.cc:237] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.787798 21290 catalog_manager.cc:5697] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.789943 21611 raft_consensus.cc:493] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.790387 21611 raft_consensus.cc:515] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:21.792689 21611 leader_election.cc:290] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:21.792963 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc41728103cd424b8cdd745adb367a42" is_pre_election: true
I20260709 13:05:21.793187 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004fd42abde5482da3997bab9fe56615" is_pre_election: true
I20260709 13:05:21.793853 21543 raft_consensus.cc:2393] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7c6bfc6cfc443fbb61cb94d0474c873 in current term 1: Already voted for candidate dc41728103cd424b8cdd745adb367a42 in this term.
I20260709 13:05:21.795009 21362 leader_election.cc:304] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42
I20260709 13:05:21.795802 21611 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.800477 21611 raft_consensus.cc:2749] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.854058 21592 consensus_queue.cc:1048] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.855800 21592 consensus_queue.cc:1048] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.881037 21611 consensus_queue.cc:1048] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.889447 21543 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.898200 21591 consensus_queue.cc:1048] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.917870 21471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
mode: GRACEFUL
new_leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:39692
I20260709 13:05:21.918341 21471 raft_consensus.cc:606] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Received request to transfer leadership to TS e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.933578 21543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4caa0632fc084a3ba00e4591c1164fe4"
dest_uuid: "004fd42abde5482da3997bab9fe56615"
mode: GRACEFUL
new_leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:05:21.934108 21543 raft_consensus.cc:606] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 1 LEADER]: Received request to transfer leadership to TS e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.941558 21471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
mode: GRACEFUL
new_leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:39692
I20260709 13:05:21.942107 21471 raft_consensus.cc:606] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Received request to transfer leadership to TS e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:21.952543 21591 consensus_queue.cc:1048] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.955474 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:53452
I20260709 13:05:21.956130 21395 raft_consensus.cc:606] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Received request to transfer leadership to TS dc41728103cd424b8cdd745adb367a42
I20260709 13:05:21.962450 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:53452
I20260709 13:05:21.963081 21395 raft_consensus.cc:606] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Received request to transfer leadership to TS dc41728103cd424b8cdd745adb367a42
I20260709 13:05:21.965273 21611 consensus_queue.cc:1048] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.979681 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c89536001064080a0ae61e149ab6639"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:53452
I20260709 13:05:21.980234 21395 raft_consensus.cc:606] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Received request to transfer leadership to TS dc41728103cd424b8cdd745adb367a42
I20260709 13:05:21.985186 21620 consensus_queue.cc:1048] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.986001 21471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "383e479ca3cf4a31919de3b97f703e46"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
mode: GRACEFUL
new_leader_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:39692
I20260709 13:05:21.986523 21471 raft_consensus.cc:606] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Received request to transfer leadership to TS 004fd42abde5482da3997bab9fe56615
I20260709 13:05:21.992468 21612 raft_consensus.cc:993] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615: : Instructing follower e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:21.993287 21620 raft_consensus.cc:1081] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 1 LEADER]: Signalling peer e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:21.995047 21396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4caa0632fc084a3ba00e4591c1164fe4"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:53436
I20260709 13:05:21.995651 21396 raft_consensus.cc:493] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.996006 21396 raft_consensus.cc:3060] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.001935 21663 consensus_queue.cc:1048] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.002193 21396 raft_consensus.cc:515] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.004698 21396 leader_election.cc:290] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 2 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:22.005125 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caa0632fc084a3ba00e4591c1164fe4" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:22.005682 21471 raft_consensus.cc:3060] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.006415 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caa0632fc084a3ba00e4591c1164fe4" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:22.006937 21543 raft_consensus.cc:3055] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.007002 21395 raft_consensus.cc:1240] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Rejecting Update request from peer 004fd42abde5482da3997bab9fe56615 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.007372 21543 raft_consensus.cc:740] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:22.008169 21543 consensus_queue.cc:260] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.009114 21543 raft_consensus.cc:3060] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.011904 21471 raft_consensus.cc:2468] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 2.
I20260709 13:05:22.012857 21470 raft_consensus.cc:1240] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Rejecting Update request from peer 004fd42abde5482da3997bab9fe56615 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:05:22.013283 21361 leader_election.cc:304] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:22.014333 21611 raft_consensus.cc:2804] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:22.014909 21611 raft_consensus.cc:697] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:22.017786 21611 consensus_queue.cc:237] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.018489 21543 raft_consensus.cc:2468] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 2.
W20260709 13:05:22.009351 21663 consensus_queue.cc:1175] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 004fd42abde5482da3997bab9fe56615 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:22.024973 21290 catalog_manager.cc:5697] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 1 to 2, leader changed from 004fd42abde5482da3997bab9fe56615 (127.20.69.3) to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.036697 21592 consensus_queue.cc:1048] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.047307 21644 consensus_queue.cc:1048] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.098875 21611 consensus_queue.cc:1048] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.100497 21611 consensus_queue.cc:1048] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.106530 21591 raft_consensus.cc:993] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:22.106983 21605 raft_consensus.cc:1081] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Signalling peer dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:22.110664 21470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:39672
I20260709 13:05:22.111277 21470 raft_consensus.cc:493] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.111644 21470 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.118901 21470 raft_consensus.cc:515] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.119938 21471 raft_consensus.cc:1240] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Rejecting Update request from peer e7c6bfc6cfc443fbb61cb94d0474c873 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.121707 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:22.122330 21395 raft_consensus.cc:3055] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.122442 21470 leader_election.cc:290] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 2 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:22.122681 21395 raft_consensus.cc:740] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:22.123544 21395 consensus_queue.cc:260] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.124718 21395 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.125797 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:22.126389 21543 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.130882 21395 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 2.
I20260709 13:05:22.131619 21543 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 2.
I20260709 13:05:22.131942 21436 leader_election.cc:304] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:22.132943 21644 raft_consensus.cc:2804] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:22.133463 21644 raft_consensus.cc:697] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:22.134123 21644 consensus_queue.cc:237] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.140051 21290 catalog_manager.cc:5697] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 1 to 2, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.157086 21644 consensus_queue.cc:1048] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.163321 21592 raft_consensus.cc:993] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42: : Instructing follower e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:22.163810 21592 raft_consensus.cc:1081] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Signalling peer e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:22.166213 21396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:53446
I20260709 13:05:22.166905 21396 raft_consensus.cc:493] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.167275 21396 raft_consensus.cc:3060] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.170558 21670 consensus_queue.cc:1048] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.171092 21613 consensus_queue.cc:1048] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.176079 21396 raft_consensus.cc:515] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.181792 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:22.182202 21395 raft_consensus.cc:1240] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Rejecting Update request from peer dc41728103cd424b8cdd745adb367a42 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.182405 21470 raft_consensus.cc:3055] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.182796 21470 raft_consensus.cc:740] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:22.183624 21470 consensus_queue.cc:260] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.184801 21470 raft_consensus.cc:3060] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.191200 21611 consensus_queue.cc:1048] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.191402 21613 consensus_queue.cc:1048] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.202757 21611 consensus_queue.cc:1048] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.206946 21644 raft_consensus.cc:993] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42: : Instructing follower 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:22.207535 21644 raft_consensus.cc:1081] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Signalling peer 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:22.209374 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "383e479ca3cf4a31919de3b97f703e46"
dest_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:39946
I20260709 13:05:22.209947 21543 raft_consensus.cc:493] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.210572 21543 raft_consensus.cc:3060] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.217983 21470 raft_consensus.cc:2468] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 2.
I20260709 13:05:22.219115 21361 leader_election.cc:304] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:22.220081 21611 raft_consensus.cc:2804] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:22.219879 21543 raft_consensus.cc:515] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.220670 21611 raft_consensus.cc:697] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:22.221621 21611 consensus_queue.cc:237] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.228005 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383e479ca3cf4a31919de3b97f703e46" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:22.228245 21543 leader_election.cc:290] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 2 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:22.228655 21395 raft_consensus.cc:3060] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.228943 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383e479ca3cf4a31919de3b97f703e46" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:22.229492 21471 raft_consensus.cc:3055] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.229830 21471 raft_consensus.cc:740] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:22.232486 21471 consensus_queue.cc:260] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.233858 21471 raft_consensus.cc:3060] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.235850 21395 raft_consensus.cc:2468] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 2.
I20260709 13:05:22.237075 21510 leader_election.cc:304] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:22.236505 21290 catalog_manager.cc:5697] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 1 to 2, leader changed from dc41728103cd424b8cdd745adb367a42 (127.20.69.2) to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.237942 21620 raft_consensus.cc:2804] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:22.238409 21620 raft_consensus.cc:697] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Becoming Leader. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:22.239190 21620 consensus_queue.cc:237] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.241344 21471 raft_consensus.cc:2468] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 2.
I20260709 13:05:22.242295 21605 raft_consensus.cc:993] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:22.242740 21605 raft_consensus.cc:1081] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Signalling peer dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:22.243916 21396 leader_election.cc:290] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 2 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:22.245007 21471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:39672
I20260709 13:05:22.247113 21471 raft_consensus.cc:493] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.247488 21471 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.245710 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2b074ee0cd40c299dd960c5376d6aa" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:22.248355 21543 raft_consensus.cc:3060] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.250303 21289 catalog_manager.cc:5697] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 reported cstate change: term changed from 1 to 2, leader changed from dc41728103cd424b8cdd745adb367a42 (127.20.69.2) to 004fd42abde5482da3997bab9fe56615 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "004fd42abde5482da3997bab9fe56615" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.255313 21543 raft_consensus.cc:2468] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 2.
I20260709 13:05:22.258041 21471 raft_consensus.cc:515] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.259112 21470 raft_consensus.cc:1240] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Rejecting Update request from peer e7c6bfc6cfc443fbb61cb94d0474c873 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.260183 21471 leader_election.cc:290] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 2 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:22.261039 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:22.261292 21611 consensus_queue.cc:1059] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.261916 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:22.262192 21396 raft_consensus.cc:3055] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.262495 21543 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.262545 21396 raft_consensus.cc:740] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:22.263453 21396 consensus_queue.cc:260] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.264705 21396 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.265576 21613 raft_consensus.cc:993] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42: : Instructing follower e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:22.265988 21644 raft_consensus.cc:1081] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Signalling peer e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:22.267364 21395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:53446
I20260709 13:05:22.267812 21395 raft_consensus.cc:493] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.268115 21395 raft_consensus.cc:3060] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.269567 21543 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 2.
I20260709 13:05:22.270812 21437 leader_election.cc:304] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:22.271557 21396 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 2.
I20260709 13:05:22.271591 21644 raft_consensus.cc:2804] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:22.272135 21605 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:05:22.272214 21644 raft_consensus.cc:697] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:22.273162 21644 consensus_queue.cc:237] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.273734 21395 raft_consensus.cc:515] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:22.275736 21395 leader_election.cc:290] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 2 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:22.276703 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:22.276840 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f938f9320cd4696afb373e1b555bcf9" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:22.277326 21543 raft_consensus.cc:3060] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.277289 21471 raft_consensus.cc:3055] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.277842 21471 raft_consensus.cc:740] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:22.278673 21471 consensus_queue.cc:260] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:22.279923 21471 raft_consensus.cc:3060] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.282625 21543 raft_consensus.cc:2468] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 2.
I20260709 13:05:22.283766 21362 leader_election.cc:304] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:22.283330 21289 catalog_manager.cc:5697] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 1 to 2, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.284559 21605 raft_consensus.cc:2804] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:22.285068 21605 raft_consensus.cc:697] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:22.285394 21471 raft_consensus.cc:2468] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 2.
I20260709 13:05:22.285889 21605 consensus_queue.cc:237] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } }
I20260709 13:05:22.293475 21290 catalog_manager.cc:5697] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 1 to 2, leader changed from dc41728103cd424b8cdd745adb367a42 (127.20.69.2) to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.423079 21605 raft_consensus.cc:993] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:22.423571 21668 raft_consensus.cc:1081] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Signalling peer dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:22.425091 21471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c89536001064080a0ae61e149ab6639"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:39672
I20260709 13:05:22.425580 21471 raft_consensus.cc:493] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:22.425889 21471 raft_consensus.cc:3060] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.430641 21471 raft_consensus.cc:515] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.432266 21471 leader_election.cc:290] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 2 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:22.433136 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:22.433318 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c89536001064080a0ae61e149ab6639" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:22.433820 21543 raft_consensus.cc:3060] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.433802 21395 raft_consensus.cc:3055] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.434326 21395 raft_consensus.cc:740] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:22.435128 21395 consensus_queue.cc:260] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.436311 21395 raft_consensus.cc:3060] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.440240 21543 raft_consensus.cc:2468] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 2.
I20260709 13:05:22.441422 21437 leader_election.cc:304] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:22.442202 21644 raft_consensus.cc:2804] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:22.442615 21644 raft_consensus.cc:697] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:22.442876 21395 raft_consensus.cc:2468] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 2.
I20260709 13:05:22.443436 21644 consensus_queue.cc:237] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:22.449829 21290 catalog_manager.cc:5697] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 1 to 2, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.470265 21471 raft_consensus.cc:1275] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.471534 21668 consensus_queue.cc:1048] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.483340 21543 raft_consensus.cc:1275] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.484645 21668 consensus_queue.cc:1048] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.523610 21543 raft_consensus.cc:1275] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.524989 21644 consensus_queue.cc:1048] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.533629 21395 raft_consensus.cc:1275] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.535173 21613 consensus_queue.cc:1048] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.621827 21471 raft_consensus.cc:1275] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.623324 21620 consensus_queue.cc:1048] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.630645 21395 raft_consensus.cc:1275] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.632110 21663 consensus_queue.cc:1048] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.642370 21471 raft_consensus.cc:1275] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.643761 21668 consensus_queue.cc:1048] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.651844 21543 raft_consensus.cc:1275] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.653370 21611 consensus_queue.cc:1048] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.744370 21395 raft_consensus.cc:1275] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.745949 21592 consensus_queue.cc:1048] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.753785 21543 raft_consensus.cc:1275] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.755345 21613 consensus_queue.cc:1048] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.867560 21543 raft_consensus.cc:1275] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.869367 21591 consensus_queue.cc:1048] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.875993 21471 raft_consensus.cc:1275] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.879395 21611 consensus_queue.cc:1048] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.901675 21543 raft_consensus.cc:1275] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.902915 21613 consensus_queue.cc:1048] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.909965 21395 raft_consensus.cc:1275] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:22.912062 21592 consensus_queue.cc:1048] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:25.020041 20756 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:25.020766 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:25.037441 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:53462
I20260709 13:05:25.037942 21395 raft_consensus.cc:606] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Received request to transfer leadership to TS 004fd42abde5482da3997bab9fe56615
I20260709 13:05:25.040446 21395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:53462
I20260709 13:05:25.041118 21395 raft_consensus.cc:606] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Received request to transfer leadership to TS 004fd42abde5482da3997bab9fe56615
I20260709 13:05:25.042220 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:25.042717 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:25.172535 21591 raft_consensus.cc:993] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:25.173010 21591 raft_consensus.cc:1081] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Signalling peer 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:25.174407 21545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2"
dest_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:39944
I20260709 13:05:25.174887 21545 raft_consensus.cc:493] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.175253 21545 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.180568 21545 raft_consensus.cc:515] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:25.182250 21545 leader_election.cc:290] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 2 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:25.183135 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:25.183336 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:25.183671 21395 raft_consensus.cc:3055] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.183887 21470 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.184024 21395 raft_consensus.cc:740] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:25.184866 21395 consensus_queue.cc:260] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:25.185768 21395 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.190191 21470 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 2.
I20260709 13:05:25.190551 21395 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 2.
I20260709 13:05:25.191406 21510 leader_election.cc:304] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:25.192166 21663 raft_consensus.cc:2804] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:25.193148 21663 raft_consensus.cc:697] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Becoming Leader. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:25.193907 21663 consensus_queue.cc:237] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:25.201190 21289 catalog_manager.cc:5697] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 reported cstate change: term changed from 1 to 2, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to 004fd42abde5482da3997bab9fe56615 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "004fd42abde5482da3997bab9fe56615" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.372361 21683 raft_consensus.cc:993] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:25.372870 21591 raft_consensus.cc:1081] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Signalling peer 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:25.374342 21545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40"
dest_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:39944
I20260709 13:05:25.374889 21545 raft_consensus.cc:493] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:25.375265 21545 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.380934 21545 raft_consensus.cc:515] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:25.382433 21545 leader_election.cc:290] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 2 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:25.383278 21395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:25.383545 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:25.383831 21395 raft_consensus.cc:3055] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:25.384199 21395 raft_consensus.cc:740] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:25.384171 21470 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.385079 21395 consensus_queue.cc:260] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:25.385910 21395 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.389361 21470 raft_consensus.cc:2468] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 2.
I20260709 13:05:25.390588 21395 raft_consensus.cc:2468] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 2.
I20260709 13:05:25.391017 21510 leader_election.cc:304] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:25.391886 21663 raft_consensus.cc:2804] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:25.392416 21663 raft_consensus.cc:697] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Becoming Leader. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:25.393405 21663 consensus_queue.cc:237] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:25.400029 21289 catalog_manager.cc:5697] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 reported cstate change: term changed from 1 to 2, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to 004fd42abde5482da3997bab9fe56615 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "004fd42abde5482da3997bab9fe56615" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.598543 21395 raft_consensus.cc:1275] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:25.599949 21663 consensus_queue.cc:1048] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:25.609668 21470 raft_consensus.cc:1275] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:25.611176 21693 consensus_queue.cc:1048] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:25.851382 21396 raft_consensus.cc:1275] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:25.852682 21693 consensus_queue.cc:1048] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:25.861940 21470 raft_consensus.cc:1275] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:25.863651 21663 consensus_queue.cc:1048] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.043471 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:26.056452 21545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40"
dest_uuid: "004fd42abde5482da3997bab9fe56615"
mode: GRACEFUL
new_leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:05:26.057018 21545 raft_consensus.cc:606] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Received request to transfer leadership to TS e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:26.064716 21545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2"
dest_uuid: "004fd42abde5482da3997bab9fe56615"
mode: GRACEFUL
new_leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:39960
I20260709 13:05:26.065228 21545 raft_consensus.cc:606] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Received request to transfer leadership to TS e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:26.073071 21470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
mode: GRACEFUL
new_leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:39692
I20260709 13:05:26.073642 21470 raft_consensus.cc:606] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Received request to transfer leadership to TS e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:26.078390 21470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
mode: GRACEFUL
new_leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:39692
I20260709 13:05:26.078930 21470 raft_consensus.cc:606] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Received request to transfer leadership to TS e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:26.084349 21470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "010ac5750f72443592e91738f23651e4"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
mode: GRACEFUL
new_leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:39692
I20260709 13:05:26.085041 21470 raft_consensus.cc:606] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Received request to transfer leadership to TS e7c6bfc6cfc443fbb61cb94d0474c873
I20260709 13:05:26.261642 21613 raft_consensus.cc:993] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42: : Instructing follower e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.262161 21699 raft_consensus.cc:1081] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Signalling peer e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.263844 21396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:53446
I20260709 13:05:26.264329 21396 raft_consensus.cc:493] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.264714 21396 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.269249 21396 raft_consensus.cc:515] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.270973 21396 leader_election.cc:290] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 3 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:26.271719 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:26.272054 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:26.272281 21471 raft_consensus.cc:3055] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:26.272660 21471 raft_consensus.cc:740] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:26.272710 21545 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.273531 21471 consensus_queue.cc:260] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.274807 21471 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.280107 21545 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 3.
I20260709 13:05:26.281071 21471 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 3.
I20260709 13:05:26.281276 21362 leader_election.cc:304] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:26.282030 21700 raft_consensus.cc:2804] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:26.282429 21700 raft_consensus.cc:697] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:26.283140 21700 consensus_queue.cc:237] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.289414 21294 catalog_manager.cc:5697] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 2 to 3, leader changed from dc41728103cd424b8cdd745adb367a42 (127.20.69.2) to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.307721 21684 raft_consensus.cc:993] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615: : Instructing follower e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.308149 21684 raft_consensus.cc:1081] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Signalling peer e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.309600 21396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:53436
I20260709 13:05:26.310173 21396 raft_consensus.cc:493] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.310436 21396 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.315100 21396 raft_consensus.cc:515] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.316707 21396 leader_election.cc:290] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 3 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:26.317814 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:26.317845 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657fe6d93a3f4035a5f6b309528e7e40" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:26.318364 21471 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.318452 21545 raft_consensus.cc:3055] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:26.318850 21545 raft_consensus.cc:740] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:26.319552 21545 consensus_queue.cc:260] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.320462 21545 raft_consensus.cc:3060] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.323591 21471 raft_consensus.cc:2468] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 3.
I20260709 13:05:26.324754 21361 leader_election.cc:304] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:26.325536 21700 raft_consensus.cc:2804] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:26.326004 21700 raft_consensus.cc:697] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:26.326361 21545 raft_consensus.cc:2468] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 3.
I20260709 13:05:26.326851 21699 raft_consensus.cc:993] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42: : Instructing follower e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.327351 21699 raft_consensus.cc:1081] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Signalling peer e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.326905 21700 consensus_queue.cc:237] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.329149 21396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "010ac5750f72443592e91738f23651e4"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:53446
I20260709 13:05:26.329710 21396 raft_consensus.cc:493] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.330065 21396 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.334542 21294 catalog_manager.cc:5697] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 2 to 3, leader changed from 004fd42abde5482da3997bab9fe56615 (127.20.69.3) to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.336268 21396 raft_consensus.cc:515] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.339354 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:26.339725 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:26.339951 21471 raft_consensus.cc:3055] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:26.340320 21471 raft_consensus.cc:740] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:26.340374 21545 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.341146 21471 consensus_queue.cc:260] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.341822 21471 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.346709 21545 raft_consensus.cc:2468] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 2.
I20260709 13:05:26.346925 21471 raft_consensus.cc:2468] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 2.
I20260709 13:05:26.347474 21396 leader_election.cc:290] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 2 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:26.347888 21362 leader_election.cc:304] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:26.349166 21700 raft_consensus.cc:2804] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:26.349669 21700 raft_consensus.cc:697] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:26.350443 21700 consensus_queue.cc:237] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.356956 21294 catalog_manager.cc:5697] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 1 to 2, leader changed from dc41728103cd424b8cdd745adb367a42 (127.20.69.2) to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.378844 21699 raft_consensus.cc:993] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42: : Instructing follower e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.379320 21613 raft_consensus.cc:1081] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Signalling peer e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.381017 21396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:53446
I20260709 13:05:26.381474 21396 raft_consensus.cc:493] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.381737 21396 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.386370 21396 raft_consensus.cc:515] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.388080 21396 leader_election.cc:290] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 3 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:26.389097 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:26.389003 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:26.389770 21471 raft_consensus.cc:3055] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:26.389752 21545 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.390255 21471 raft_consensus.cc:740] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:26.390990 21471 consensus_queue.cc:260] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.392048 21471 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.396767 21545 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 3.
I20260709 13:05:26.397899 21362 leader_election.cc:304] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:26.398175 21471 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 3.
I20260709 13:05:26.398595 21700 raft_consensus.cc:2804] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:26.399101 21700 raft_consensus.cc:697] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:26.399812 21700 consensus_queue.cc:237] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.406256 21294 catalog_manager.cc:5697] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 2 to 3, leader changed from dc41728103cd424b8cdd745adb367a42 (127.20.69.2) to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.560211 21663 raft_consensus.cc:993] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615: : Instructing follower e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.560650 21684 raft_consensus.cc:1081] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Signalling peer e7c6bfc6cfc443fbb61cb94d0474c873 to start an election
I20260709 13:05:26.562083 21396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
 from {username='slave'} at 127.0.0.1:53436
I20260709 13:05:26.562602 21396 raft_consensus.cc:493] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.562917 21396 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.567603 21396 raft_consensus.cc:515] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.569252 21396 leader_election.cc:290] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 3 election: Requested vote from peers dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:26.570243 21471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:26.570354 21545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:26.570811 21471 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.570895 21545 raft_consensus.cc:3055] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:26.571247 21545 raft_consensus.cc:740] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:26.571903 21545 consensus_queue.cc:260] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.572877 21545 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.575335 21471 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 3.
I20260709 13:05:26.576460 21361 leader_election.cc:304] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc41728103cd424b8cdd745adb367a42, e7c6bfc6cfc443fbb61cb94d0474c873; no voters: 
I20260709 13:05:26.577370 21700 raft_consensus.cc:2804] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:26.577837 21700 raft_consensus.cc:697] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Becoming Leader. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:26.578122 21545 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c6bfc6cfc443fbb61cb94d0474c873 in term 3.
I20260709 13:05:26.578658 21700 consensus_queue.cc:237] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:26.585072 21294 catalog_manager.cc:5697] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 reported cstate change: term changed from 2 to 3, leader changed from 004fd42abde5482da3997bab9fe56615 (127.20.69.3) to e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.688145 21471 raft_consensus.cc:1275] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:26.689430 21700 consensus_queue.cc:1048] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:26.707796 21545 raft_consensus.cc:1275] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:26.709043 21700 consensus_queue.cc:1048] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:26.812809 21471 raft_consensus.cc:1275] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:26.814042 21700 consensus_queue.cc:1048] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:26.819692 21545 raft_consensus.cc:1275] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.821054 21543 raft_consensus.cc:1275] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:26.822310 21709 consensus_queue.cc:1048] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.822643 21713 consensus_queue.cc:1048] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:26.836472 21471 raft_consensus.cc:1275] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.837843 21709 consensus_queue.cc:1048] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.983238 21471 raft_consensus.cc:1275] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:26.984493 21709 consensus_queue.cc:1048] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:26.993742 21545 raft_consensus.cc:1275] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:26.995108 21713 consensus_queue.cc:1048] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:27.140110 21545 raft_consensus.cc:1275] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:27.142992 21713 consensus_queue.cc:1048] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:27.158421 21471 raft_consensus.cc:1275] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Refusing update from remote peer e7c6bfc6cfc443fbb61cb94d0474c873: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:27.162083 21713 consensus_queue.cc:1048] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:28.532454 21325 debug-util.cc:398] Leaking SignalData structure 0x7b0800056b60 after lost signal to thread 20759
W20260709 13:05:28.533363 21325 debug-util.cc:398] Leaking SignalData structure 0x7b0800052240 after lost signal to thread 21328
W20260709 13:05:28.534353 21325 debug-util.cc:398] Leaking SignalData structure 0x7b08001e23c0 after lost signal to thread 21420
W20260709 13:05:28.535216 21325 debug-util.cc:398] Leaking SignalData structure 0x7b0800168160 after lost signal to thread 21495
W20260709 13:05:28.536046 21325 debug-util.cc:398] Leaking SignalData structure 0x7b0800123a20 after lost signal to thread 21569
I20260709 13:05:29.240686 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:29.252929 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "010ac5750f72443592e91738f23651e4"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:53462
I20260709 13:05:29.253798 21396 raft_consensus.cc:606] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Received request to transfer leadership to TS dc41728103cd424b8cdd745adb367a42
I20260709 13:05:29.256902 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:53462
I20260709 13:05:29.257485 21396 raft_consensus.cc:606] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Received request to transfer leadership to TS 004fd42abde5482da3997bab9fe56615
I20260709 13:05:29.260080 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:53462
I20260709 13:05:29.260676 21396 raft_consensus.cc:606] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Received request to transfer leadership to TS 004fd42abde5482da3997bab9fe56615
I20260709 13:05:29.263031 21396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8"
dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
mode: GRACEFUL
new_leader_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:53462
I20260709 13:05:29.263586 21396 raft_consensus.cc:606] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Received request to transfer leadership to TS dc41728103cd424b8cdd745adb367a42
I20260709 13:05:29.264855 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:29.265342 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:29.387048 21713 raft_consensus.cc:993] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:29.387625 21713 raft_consensus.cc:1081] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Signalling peer 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:29.389544 21544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2"
dest_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:39944
I20260709 13:05:29.390220 21544 raft_consensus.cc:493] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:29.390638 21544 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.399456 21544 raft_consensus.cc:515] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.402024 21544 leader_election.cc:290] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 4 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:29.403369 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:29.403431 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbb0c6600224fbba0f8bf3ae60781b2" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:29.404409 21396 raft_consensus.cc:3055] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:29.404531 21470 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.404855 21396 raft_consensus.cc:740] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:29.405947 21396 consensus_queue.cc:260] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.407446 21396 raft_consensus.cc:3060] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.412671 21470 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 4.
I20260709 13:05:29.414389 21510 leader_election.cc:304] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:29.415578 21684 raft_consensus.cc:2804] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:29.417301 21684 raft_consensus.cc:697] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 4 LEADER]: Becoming Leader. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:29.417292 21396 raft_consensus.cc:2468] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 4.
I20260709 13:05:29.418912 21684 consensus_queue.cc:237] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.429499 21290 catalog_manager.cc:5697] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 reported cstate change: term changed from 3 to 4, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to 004fd42abde5482da3997bab9fe56615 (127.20.69.3). New cstate: current_term: 4 leader_uuid: "004fd42abde5482da3997bab9fe56615" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.445427 21591 raft_consensus.cc:993] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:29.445865 21713 raft_consensus.cc:1081] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Signalling peer dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:29.447330 21470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "010ac5750f72443592e91738f23651e4"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:39672
I20260709 13:05:29.447824 21470 raft_consensus.cc:493] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:29.448141 21470 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:29.452914 21470 raft_consensus.cc:515] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.455147 21470 leader_election.cc:290] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 3 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:29.455562 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:29.455878 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010ac5750f72443592e91738f23651e4" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:29.456254 21396 raft_consensus.cc:3055] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:29.456378 21544 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:29.456689 21396 raft_consensus.cc:740] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:29.457561 21396 consensus_queue.cc:260] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.458768 21396 raft_consensus.cc:3060] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:29.461309 21544 raft_consensus.cc:2468] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 3.
I20260709 13:05:29.462723 21437 leader_election.cc:304] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:29.463697 21613 raft_consensus.cc:2804] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:29.465095 21613 raft_consensus.cc:697] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 3 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:29.465979 21613 consensus_queue.cc:237] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.466859 21396 raft_consensus.cc:2468] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 3.
I20260709 13:05:29.473100 21290 catalog_manager.cc:5697] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 2 to 3, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.613109 21591 raft_consensus.cc:993] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:29.613580 21713 raft_consensus.cc:1081] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Signalling peer 004fd42abde5482da3997bab9fe56615 to start an election
I20260709 13:05:29.615351 21544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d"
dest_uuid: "004fd42abde5482da3997bab9fe56615"
 from {username='slave'} at 127.0.0.1:39944
I20260709 13:05:29.615872 21544 raft_consensus.cc:493] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:29.616206 21544 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.621099 21544 raft_consensus.cc:515] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.622843 21544 leader_election.cc:290] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 4 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), dc41728103cd424b8cdd745adb367a42 (127.20.69.2:39945)
I20260709 13:05:29.623592 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:29.624161 21396 raft_consensus.cc:3055] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:29.624092 21470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d5207661974b1f88fab5cb4f6fc58d" candidate_uuid: "004fd42abde5482da3997bab9fe56615" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc41728103cd424b8cdd745adb367a42"
I20260709 13:05:29.624539 21396 raft_consensus.cc:740] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:29.624755 21470 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.625371 21396 consensus_queue.cc:260] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.626539 21396 raft_consensus.cc:3060] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.631693 21470 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 4.
I20260709 13:05:29.633015 21396 raft_consensus.cc:2468] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004fd42abde5482da3997bab9fe56615 in term 4.
I20260709 13:05:29.633369 21510 leader_election.cc:304] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:29.634248 21684 raft_consensus.cc:2804] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:29.634707 21684 raft_consensus.cc:697] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 4 LEADER]: Becoming Leader. State: Replica: 004fd42abde5482da3997bab9fe56615, State: Running, Role: LEADER
I20260709 13:05:29.635529 21684 consensus_queue.cc:237] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.643692 21290 catalog_manager.cc:5697] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 reported cstate change: term changed from 3 to 4, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to 004fd42abde5482da3997bab9fe56615 (127.20.69.3). New cstate: current_term: 4 leader_uuid: "004fd42abde5482da3997bab9fe56615" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.701303 21591 raft_consensus.cc:993] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873: : Instructing follower dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:29.701769 21713 raft_consensus.cc:1081] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Signalling peer dc41728103cd424b8cdd745adb367a42 to start an election
I20260709 13:05:29.703413 21470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8"
dest_uuid: "dc41728103cd424b8cdd745adb367a42"
 from {username='slave'} at 127.0.0.1:39672
I20260709 13:05:29.703927 21470 raft_consensus.cc:493] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:29.704253 21470 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.708920 21470 raft_consensus.cc:515] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.710878 21470 leader_election.cc:290] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 4 election: Requested vote from peers e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931), 004fd42abde5482da3997bab9fe56615 (127.20.69.3:32929)
I20260709 13:05:29.711293 21396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873"
I20260709 13:05:29.711498 21544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ac16069ee4b28816ccd74228908d8" candidate_uuid: "dc41728103cd424b8cdd745adb367a42" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "004fd42abde5482da3997bab9fe56615"
I20260709 13:05:29.711896 21396 raft_consensus.cc:3055] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:29.712069 21544 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.712267 21396 raft_consensus.cc:740] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e7c6bfc6cfc443fbb61cb94d0474c873, State: Running, Role: LEADER
I20260709 13:05:29.713162 21396 consensus_queue.cc:260] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.714270 21396 raft_consensus.cc:3060] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.717712 21544 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 4.
I20260709 13:05:29.718984 21437 leader_election.cc:304] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004fd42abde5482da3997bab9fe56615, dc41728103cd424b8cdd745adb367a42; no voters: 
I20260709 13:05:29.719941 21613 raft_consensus.cc:2804] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:29.720378 21613 raft_consensus.cc:697] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 4 LEADER]: Becoming Leader. State: Replica: dc41728103cd424b8cdd745adb367a42, State: Running, Role: LEADER
I20260709 13:05:29.721486 21396 raft_consensus.cc:2468] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc41728103cd424b8cdd745adb367a42 in term 4.
I20260709 13:05:29.721225 21613 consensus_queue.cc:237] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } }
I20260709 13:05:29.729821 21290 catalog_manager.cc:5697] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 reported cstate change: term changed from 3 to 4, leader changed from e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1) to dc41728103cd424b8cdd745adb367a42 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "dc41728103cd424b8cdd745adb367a42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.848165 21544 raft_consensus.cc:1275] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:29.849581 21613 consensus_queue.cc:1048] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.861574 21396 raft_consensus.cc:1275] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:29.863646 21727 consensus_queue.cc:1048] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.889119 21470 raft_consensus.cc:1275] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:29.890372 21684 consensus_queue.cc:1048] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:29.899524 21396 raft_consensus.cc:1275] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:29.901079 21684 consensus_queue.cc:1048] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.150787 21470 raft_consensus.cc:1275] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:30.152187 21738 consensus_queue.cc:1048] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc41728103cd424b8cdd745adb367a42" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.164381 21396 raft_consensus.cc:1275] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Refusing update from remote peer 004fd42abde5482da3997bab9fe56615: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:30.165951 21684 consensus_queue.cc:1048] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.238567 21544 raft_consensus.cc:1275] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:30.239930 21733 consensus_queue.cc:1048] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004fd42abde5482da3997bab9fe56615" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.253091 21396 raft_consensus.cc:1275] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Refusing update from remote peer dc41728103cd424b8cdd745adb367a42: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:30.254522 21733 consensus_queue.cc:1048] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c6bfc6cfc443fbb61cb94d0474c873" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:30.266194 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:30.272889 20756 tablet_server.cc:179] TabletServer@127.20.69.1:0 shutting down...
I20260709 13:05:30.310319 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:30.311148 20756 tablet_replica.cc:333] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.311869 20756 raft_consensus.cc:2243] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.312305 20756 raft_consensus.cc:2272] T 010ac5750f72443592e91738f23651e4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.316653 20756 tablet_replica.cc:333] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.317627 20756 raft_consensus.cc:2243] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.318858 20756 raft_consensus.cc:2272] T ef2b074ee0cd40c299dd960c5376d6aa P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.323132 20756 tablet_replica.cc:333] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.325920 20756 raft_consensus.cc:2243] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.326583 20756 raft_consensus.cc:2272] T 17d5207661974b1f88fab5cb4f6fc58d P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.330557 20756 tablet_replica.cc:333] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.331179 20756 raft_consensus.cc:2243] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.331657 20756 raft_consensus.cc:2272] T 383e479ca3cf4a31919de3b97f703e46 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.333715 20756 tablet_replica.cc:333] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.334244 20756 raft_consensus.cc:2243] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.334651 20756 raft_consensus.cc:2272] T 1f0ac16069ee4b28816ccd74228908d8 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.337062 20756 tablet_replica.cc:333] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.337644 20756 raft_consensus.cc:2243] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.338119 20756 raft_consensus.cc:2272] T 2c89536001064080a0ae61e149ab6639 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.340013 20756 tablet_replica.cc:333] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.340533 20756 raft_consensus.cc:2243] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.341361 20756 raft_consensus.cc:2272] T 657fe6d93a3f4035a5f6b309528e7e40 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.343219 20756 tablet_replica.cc:333] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.343729 20756 raft_consensus.cc:2243] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.344481 20756 raft_consensus.cc:2272] T 2f938f9320cd4696afb373e1b555bcf9 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.346244 20756 tablet_replica.cc:333] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.346686 20756 raft_consensus.cc:2243] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.347097 20756 raft_consensus.cc:2272] T 1dbb0c6600224fbba0f8bf3ae60781b2 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.349263 20756 tablet_replica.cc:333] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873: stopping tablet replica
I20260709 13:05:30.349745 20756 raft_consensus.cc:2243] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.350560 20756 raft_consensus.cc:2272] T 4caa0632fc084a3ba00e4591c1164fe4 P e7c6bfc6cfc443fbb61cb94d0474c873 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:30.367286 21436 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:05:30.376754 21436 consensus_peers.cc:597] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 -> Peer e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931): Couldn't send request to peer e7c6bfc6cfc443fbb61cb94d0474c873. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:33931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.388782 20756 tablet_server.cc:196] TabletServer@127.20.69.1:0 shutdown complete.
W20260709 13:05:30.413909 21510 consensus_peers.cc:597] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 -> Peer e7c6bfc6cfc443fbb61cb94d0474c873 (127.20.69.1:33931): Couldn't send request to peer e7c6bfc6cfc443fbb61cb94d0474c873. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:33931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.418541 20756 tablet_server.cc:179] TabletServer@127.20.69.2:0 shutting down...
I20260709 13:05:30.452999 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:30.453725 20756 tablet_replica.cc:333] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.454367 20756 raft_consensus.cc:2243] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.454892 20756 raft_consensus.cc:2272] T ef2b074ee0cd40c299dd960c5376d6aa P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.456985 20756 tablet_replica.cc:333] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.457554 20756 raft_consensus.cc:2243] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.458014 20756 raft_consensus.cc:2272] T 4caa0632fc084a3ba00e4591c1164fe4 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.459965 20756 tablet_replica.cc:333] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.460474 20756 raft_consensus.cc:2243] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.461267 20756 raft_consensus.cc:2272] T 1f0ac16069ee4b28816ccd74228908d8 P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.463982 20756 tablet_replica.cc:333] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.464502 20756 raft_consensus.cc:2243] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.465032 20756 raft_consensus.cc:2272] T 383e479ca3cf4a31919de3b97f703e46 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.466886 20756 tablet_replica.cc:333] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.467540 20756 raft_consensus.cc:2243] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.468329 20756 raft_consensus.cc:2272] T 2c89536001064080a0ae61e149ab6639 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.470111 20756 tablet_replica.cc:333] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.470592 20756 raft_consensus.cc:2243] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.471038 20756 raft_consensus.cc:2272] T 657fe6d93a3f4035a5f6b309528e7e40 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.472900 20756 tablet_replica.cc:333] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.473387 20756 raft_consensus.cc:2243] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.474123 20756 raft_consensus.cc:2272] T 010ac5750f72443592e91738f23651e4 P dc41728103cd424b8cdd745adb367a42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.476763 20756 tablet_replica.cc:333] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.477260 20756 raft_consensus.cc:2243] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.477725 20756 raft_consensus.cc:2272] T 17d5207661974b1f88fab5cb4f6fc58d P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.479938 20756 tablet_replica.cc:333] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.480476 20756 raft_consensus.cc:2243] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.480986 20756 raft_consensus.cc:2272] T 1dbb0c6600224fbba0f8bf3ae60781b2 P dc41728103cd424b8cdd745adb367a42 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.483042 20756 tablet_replica.cc:333] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42: stopping tablet replica
I20260709 13:05:30.483516 20756 raft_consensus.cc:2243] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.483973 20756 raft_consensus.cc:2272] T 2f938f9320cd4696afb373e1b555bcf9 P dc41728103cd424b8cdd745adb367a42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.506147 20756 tablet_server.cc:196] TabletServer@127.20.69.2:0 shutdown complete.
I20260709 13:05:30.527985 20756 tablet_server.cc:179] TabletServer@127.20.69.3:0 shutting down...
I20260709 13:05:30.561653 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:30.562363 20756 tablet_replica.cc:333] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.562959 20756 raft_consensus.cc:2243] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.563740 20756 raft_consensus.cc:2272] T 17d5207661974b1f88fab5cb4f6fc58d P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.565888 20756 tablet_replica.cc:333] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.566504 20756 raft_consensus.cc:2243] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.566936 20756 raft_consensus.cc:2272] T 010ac5750f72443592e91738f23651e4 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.569187 20756 tablet_replica.cc:333] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.569794 20756 raft_consensus.cc:2243] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.570261 20756 raft_consensus.cc:2272] T 657fe6d93a3f4035a5f6b309528e7e40 P 004fd42abde5482da3997bab9fe56615 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.572135 20756 tablet_replica.cc:333] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.572737 20756 raft_consensus.cc:2243] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.573530 20756 raft_consensus.cc:2272] T 383e479ca3cf4a31919de3b97f703e46 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.575218 20756 tablet_replica.cc:333] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.575721 20756 raft_consensus.cc:2243] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.576135 20756 raft_consensus.cc:2272] T 2c89536001064080a0ae61e149ab6639 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.577955 20756 tablet_replica.cc:333] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.578434 20756 raft_consensus.cc:2243] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.578823 20756 raft_consensus.cc:2272] T 1f0ac16069ee4b28816ccd74228908d8 P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.581100 20756 tablet_replica.cc:333] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.581619 20756 raft_consensus.cc:2243] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.582015 20756 raft_consensus.cc:2272] T ef2b074ee0cd40c299dd960c5376d6aa P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.583706 20756 tablet_replica.cc:333] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.584159 20756 raft_consensus.cc:2243] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.584901 20756 raft_consensus.cc:2272] T 1dbb0c6600224fbba0f8bf3ae60781b2 P 004fd42abde5482da3997bab9fe56615 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.586686 20756 tablet_replica.cc:333] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.587154 20756 raft_consensus.cc:2243] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.587567 20756 raft_consensus.cc:2272] T 2f938f9320cd4696afb373e1b555bcf9 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.589283 20756 tablet_replica.cc:333] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615: stopping tablet replica
I20260709 13:05:30.589720 20756 raft_consensus.cc:2243] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.590245 20756 raft_consensus.cc:2272] T 4caa0632fc084a3ba00e4591c1164fe4 P 004fd42abde5482da3997bab9fe56615 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.611546 20756 tablet_server.cc:196] TabletServer@127.20.69.3:0 shutdown complete.
I20260709 13:05:30.643117 20756 master.cc:562] Master@127.20.69.62:36565 shutting down...
I20260709 13:05:30.668939 20756 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.669497 20756 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.669852 20756 tablet_replica.cc:333] T 00000000000000000000000000000000 P 19723f0c96ec4dde8e09fa20010465a0: stopping tablet replica
I20260709 13:05:31.028368 20756 master.cc:584] Master@127.20.69.62:36565 shutdown complete.
004fd42abde5482da3997bab9fe56615  1
dc41728103cd424b8cdd745adb367a42  4
e7c6bfc6cfc443fbb61cb94d0474c873  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11010 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:05:31.071446 20756 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.69.62:45563
I20260709 13:05:31.072562 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:31.078227 21748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.078924 21749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.079905 21751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.081205 20756 server_base.cc:1061] running on GCE node
I20260709 13:05:31.082088 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:31.082314 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:31.082491 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602331082468 us; error 0 us; skew 500 ppm
I20260709 13:05:31.082999 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:31.085579 20756 webserver.cc:533] Webserver started at http://127.20.69.62:41155/ using document root <none> and password file <none>
I20260709 13:05:31.086279 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:31.086537 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:31.086927 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:31.088184 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/master-0-root/instance:
uuid: "2e9dea115c0a415895e1d51deced12f4"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-56lb"
I20260709 13:05:31.093281 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:05:31.097088 21756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.097994 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:31.098266 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/master-0-root
uuid: "2e9dea115c0a415895e1d51deced12f4"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-56lb"
I20260709 13:05:31.098522 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:31.121604 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:31.122793 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:31.161154 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.62:45563
I20260709 13:05:31.161249 21807 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.62:45563 every 8 connection(s)
I20260709 13:05:31.165005 21808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.174647 21808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Bootstrap starting.
I20260709 13:05:31.179288 21808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:31.183789 21808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: No bootstrap required, opened a new log
I20260709 13:05:31.185937 21808 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9dea115c0a415895e1d51deced12f4" member_type: VOTER }
I20260709 13:05:31.186317 21808 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:31.186583 21808 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e9dea115c0a415895e1d51deced12f4, State: Initialized, Role: FOLLOWER
I20260709 13:05:31.187263 21808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9dea115c0a415895e1d51deced12f4" member_type: VOTER }
I20260709 13:05:31.187736 21808 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:31.187935 21808 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:31.188237 21808 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:31.192363 21808 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9dea115c0a415895e1d51deced12f4" member_type: VOTER }
I20260709 13:05:31.192945 21808 leader_election.cc:304] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e9dea115c0a415895e1d51deced12f4; no voters: 
I20260709 13:05:31.194103 21808 leader_election.cc:290] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:31.194537 21811 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:31.195842 21811 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 1 LEADER]: Becoming Leader. State: Replica: 2e9dea115c0a415895e1d51deced12f4, State: Running, Role: LEADER
I20260709 13:05:31.196568 21811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9dea115c0a415895e1d51deced12f4" member_type: VOTER }
I20260709 13:05:31.197160 21808 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:31.201154 21813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e9dea115c0a415895e1d51deced12f4. Latest consensus state: current_term: 1 leader_uuid: "2e9dea115c0a415895e1d51deced12f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9dea115c0a415895e1d51deced12f4" member_type: VOTER } }
I20260709 13:05:31.202767 21813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:31.202149 21812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e9dea115c0a415895e1d51deced12f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e9dea115c0a415895e1d51deced12f4" member_type: VOTER } }
I20260709 13:05:31.203847 21812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:31.204710 21819 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:31.210711 21819 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:31.211771 20756 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:31.219619 21819 catalog_manager.cc:1383] Generated new cluster ID: 3ace76bcb00d48a086746ea3332ef5a7
I20260709 13:05:31.219954 21819 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:31.241212 21819 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:31.242630 21819 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:31.256424 21819 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Generated new TSK 0
I20260709 13:05:31.257099 21819 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:31.278632 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:31.284682 21829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.285681 21830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.287401 21832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.287997 20756 server_base.cc:1061] running on GCE node
I20260709 13:05:31.289021 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:31.289227 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:31.289420 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602331289405 us; error 0 us; skew 500 ppm
I20260709 13:05:31.289934 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:31.292339 20756 webserver.cc:533] Webserver started at http://127.20.69.1:43997/ using document root <none> and password file <none>
I20260709 13:05:31.292919 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:31.293095 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:31.293332 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:31.294390 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/instance:
uuid: "95296a4420ed41b69191d3d4353cf2b0"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-56lb"
I20260709 13:05:31.299177 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:31.302572 21837 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.303346 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:31.303699 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "95296a4420ed41b69191d3d4353cf2b0"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-56lb"
I20260709 13:05:31.304018 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:31.330013 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:31.331367 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:31.333001 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:31.335489 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:31.335733 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.335994 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:31.336198 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.378419 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:38039
I20260709 13:05:31.378520 21899 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:38039 every 8 connection(s)
I20260709 13:05:31.383802 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:31.391083 21905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.391286 21904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.394842 21907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.395706 20756 server_base.cc:1061] running on GCE node
I20260709 13:05:31.396787 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:31.396910 21900 heartbeater.cc:344] Connected to a master server at 127.20.69.62:45563
W20260709 13:05:31.397064 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:31.397300 21900 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:31.397296 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602331397272 us; error 0 us; skew 500 ppm
I20260709 13:05:31.398205 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:31.398307 21900 heartbeater.cc:507] Master 127.20.69.62:45563 requested a full tablet report, sending...
I20260709 13:05:31.400846 21773 ts_manager.cc:194] Registered new tserver with Master: 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:31.401376 20756 webserver.cc:533] Webserver started at http://127.20.69.2:35293/ using document root <none> and password file <none>
I20260709 13:05:31.401887 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:31.402099 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:31.402372 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:31.402954 21773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49086
I20260709 13:05:31.403612 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/instance:
uuid: "61893f17f34b4cc9b898114d3c0a7023"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-56lb"
I20260709 13:05:31.408744 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:05:31.412163 21912 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.413038 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:05:31.413306 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root
uuid: "61893f17f34b4cc9b898114d3c0a7023"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-56lb"
I20260709 13:05:31.413546 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:31.435675 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:31.436916 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:31.438364 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:31.440662 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:31.440871 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.441157 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:31.441323 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.481645 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.2:44983
I20260709 13:05:31.481782 21974 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.2:44983 every 8 connection(s)
I20260709 13:05:31.486624 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:31.494027 21978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:31.496615 21979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.499868 20756 server_base.cc:1061] running on GCE node
W20260709 13:05:31.500995 21982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:31.501295 21975 heartbeater.cc:344] Connected to a master server at 127.20.69.62:45563
I20260709 13:05:31.501786 21975 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:31.502189 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:31.502457 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:31.502732 21975 heartbeater.cc:507] Master 127.20.69.62:45563 requested a full tablet report, sending...
I20260709 13:05:31.502787 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602331502766 us; error 0 us; skew 500 ppm
I20260709 13:05:31.503743 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:31.505749 21773 ts_manager.cc:194] Registered new tserver with Master: 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:31.507898 21773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49094
I20260709 13:05:31.510118 20756 webserver.cc:533] Webserver started at http://127.20.69.3:39801/ using document root <none> and password file <none>
I20260709 13:05:31.510815 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:31.511050 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:31.511369 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:31.512936 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/instance:
uuid: "51e52b544fab4275aab4f7fbe81942d2"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-56lb"
I20260709 13:05:31.518045 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:31.521740 21986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.522713 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:05:31.522992 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root
uuid: "51e52b544fab4275aab4f7fbe81942d2"
format_stamp: "Formatted at 2026-07-09 13:05:31 on dist-test-slave-56lb"
I20260709 13:05:31.523252 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:31.540277 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:31.541682 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:31.610049 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:31.613449 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:31.613780 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:05:31.614082 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:31.614341 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:31.715144 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.3:35687
I20260709 13:05:31.715235 22048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.3:35687 every 8 connection(s)
I20260709 13:05:31.730013 22049 heartbeater.cc:344] Connected to a master server at 127.20.69.62:45563
I20260709 13:05:31.730441 22049 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:31.731191 22049 heartbeater.cc:507] Master 127.20.69.62:45563 requested a full tablet report, sending...
I20260709 13:05:31.733228 21773 ts_manager.cc:194] Registered new tserver with Master: 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:31.734346 20756 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015980967s
I20260709 13:05:31.734572 21773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49096
I20260709 13:05:31.760793 21773 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49108:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:31.766901 21773 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:31.976224 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 06e4c126dc6f477daa840b84b452bb59 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:31.977110 21934 tablet_service.cc:1511] Processing CreateTablet for tablet 41144a85d9d645d9a3eb3ef87b761a44 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:31.977728 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4c126dc6f477daa840b84b452bb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.978453 21934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41144a85d9d645d9a3eb3ef87b761a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.980338 21933 tablet_service.cc:1511] Processing CreateTablet for tablet 7baa5a75e229412297990ddc378b6aad (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:31.981753 21933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7baa5a75e229412297990ddc378b6aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.981601 21935 tablet_service.cc:1511] Processing CreateTablet for tablet 81a928ac9f854ce1bcb7c9b78983b84f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:31.982453 21865 tablet_service.cc:1511] Processing CreateTablet for tablet 06e4c126dc6f477daa840b84b452bb59 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:31.983755 21865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4c126dc6f477daa840b84b452bb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.983820 21936 tablet_service.cc:1511] Processing CreateTablet for tablet f33dbfc0299d475ebf12544cb959443d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:31.984640 21859 tablet_service.cc:1511] Processing CreateTablet for tablet 41144a85d9d645d9a3eb3ef87b761a44 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:31.985154 21936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33dbfc0299d475ebf12544cb959443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.985020 21864 tablet_service.cc:1511] Processing CreateTablet for tablet e067dbcd1ae14ea1a16378539be836cb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:31.985976 21859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41144a85d9d645d9a3eb3ef87b761a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.987164 21863 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9fbee4e9e94929bc4675f1e7f4384d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:31.988445 21863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9fbee4e9e94929bc4675f1e7f4384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.989699 21860 tablet_service.cc:1511] Processing CreateTablet for tablet 81a928ac9f854ce1bcb7c9b78983b84f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:31.989759 21858 tablet_service.cc:1511] Processing CreateTablet for tablet 7baa5a75e229412297990ddc378b6aad (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:31.991183 21860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a928ac9f854ce1bcb7c9b78983b84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.992455 21939 tablet_service.cc:1511] Processing CreateTablet for tablet e067dbcd1ae14ea1a16378539be836cb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:31.988224 21862 tablet_service.cc:1511] Processing CreateTablet for tablet 65033a7eefd242a796408c7d54fed332 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:31.989699 21937 tablet_service.cc:1511] Processing CreateTablet for tablet 65033a7eefd242a796408c7d54fed332 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:31.993852 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e067dbcd1ae14ea1a16378539be836cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.990751 21938 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9fbee4e9e94929bc4675f1e7f4384d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:31.994872 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9fbee4e9e94929bc4675f1e7f4384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.992470 21861 tablet_service.cc:1511] Processing CreateTablet for tablet f33dbfc0299d475ebf12544cb959443d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:31.996723 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e067dbcd1ae14ea1a16378539be836cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.998888 21935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a928ac9f854ce1bcb7c9b78983b84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.000164 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65033a7eefd242a796408c7d54fed332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.000905 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33dbfc0299d475ebf12544cb959443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.001590 21937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65033a7eefd242a796408c7d54fed332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.005205 21858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7baa5a75e229412297990ddc378b6aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.011885 22067 tablet_bootstrap.cc:492] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:32.019377 22014 tablet_service.cc:1511] Processing CreateTablet for tablet 06e4c126dc6f477daa840b84b452bb59 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:32.020934 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4c126dc6f477daa840b84b452bb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.027408 22013 tablet_service.cc:1511] Processing CreateTablet for tablet e067dbcd1ae14ea1a16378539be836cb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:32.028810 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e067dbcd1ae14ea1a16378539be836cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.040225 22012 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9fbee4e9e94929bc4675f1e7f4384d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:32.041731 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9fbee4e9e94929bc4675f1e7f4384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.042377 22067 tablet_bootstrap.cc:654] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.046690 21863 tablet_service.cc:1511] Processing CreateTablet for tablet 20e7b7ab39a74ba88aa5a6259c522f73 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:32.048132 21863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e7b7ab39a74ba88aa5a6259c522f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.048013 22010 tablet_service.cc:1511] Processing CreateTablet for tablet f33dbfc0299d475ebf12544cb959443d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:32.048254 22007 tablet_service.cc:1511] Processing CreateTablet for tablet 7baa5a75e229412297990ddc378b6aad (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:32.049522 22010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33dbfc0299d475ebf12544cb959443d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.052973 22007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7baa5a75e229412297990ddc378b6aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.052659 22009 tablet_service.cc:1511] Processing CreateTablet for tablet 81a928ac9f854ce1bcb7c9b78983b84f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:32.054170 22009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81a928ac9f854ce1bcb7c9b78983b84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.055950 21932 tablet_service.cc:1511] Processing CreateTablet for tablet 20e7b7ab39a74ba88aa5a6259c522f73 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:32.057395 21932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e7b7ab39a74ba88aa5a6259c522f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.057897 22008 tablet_service.cc:1511] Processing CreateTablet for tablet 41144a85d9d645d9a3eb3ef87b761a44 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:32.059273 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41144a85d9d645d9a3eb3ef87b761a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.046732 22011 tablet_service.cc:1511] Processing CreateTablet for tablet 65033a7eefd242a796408c7d54fed332 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:32.062084 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65033a7eefd242a796408c7d54fed332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.085776 22006 tablet_service.cc:1511] Processing CreateTablet for tablet 20e7b7ab39a74ba88aa5a6259c522f73 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:32.087358 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e7b7ab39a74ba88aa5a6259c522f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.091741 21857 tablet_service.cc:1511] Processing CreateTablet for tablet b7a6203a9eab4b71b33f702b49f0945f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:32.094802 21857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a6203a9eab4b71b33f702b49f0945f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.104141 22005 tablet_service.cc:1511] Processing CreateTablet for tablet b7a6203a9eab4b71b33f702b49f0945f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:32.105631 22005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a6203a9eab4b71b33f702b49f0945f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.113716 21940 tablet_service.cc:1511] Processing CreateTablet for tablet b7a6203a9eab4b71b33f702b49f0945f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:32.118000 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a6203a9eab4b71b33f702b49f0945f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.138917 21859 tablet_service.cc:1511] Processing CreateTablet for tablet ad0b6a949ee94dddab00a0afe84da820 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:32.139680 21933 tablet_service.cc:1511] Processing CreateTablet for tablet ad0b6a949ee94dddab00a0afe84da820 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:32.142143 21859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0b6a949ee94dddab00a0afe84da820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.141342 22067 tablet_bootstrap.cc:492] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:32.142307 21933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0b6a949ee94dddab00a0afe84da820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.143581 22067 ts_tablet_manager.cc:1403] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.014s
I20260709 13:05:32.158761 22067 raft_consensus.cc:359] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.159552 22067 raft_consensus.cc:385] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.159861 22067 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.160754 22067 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.165683 21863 tablet_service.cc:1511] Processing CreateTablet for tablet 5af1794ba4454baf843df541f302e8e0 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:32.169286 22069 tablet_bootstrap.cc:492] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:32.169317 21933 tablet_service.cc:1511] Processing CreateTablet for tablet 5af1794ba4454baf843df541f302e8e0 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:32.171100 21933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af1794ba4454baf843df541f302e8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.171017 22006 tablet_service.cc:1511] Processing CreateTablet for tablet 5af1794ba4454baf843df541f302e8e0 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:32.173125 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af1794ba4454baf843df541f302e8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.174499 21863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af1794ba4454baf843df541f302e8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.183749 21900 heartbeater.cc:499] Master 127.20.69.62:45563 was elected leader, sending a full tablet report...
I20260709 13:05:32.184348 22067 ts_tablet_manager.cc:1434] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.003s
I20260709 13:05:32.185741 22067 tablet_bootstrap.cc:492] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:32.186076 22007 tablet_service.cc:1511] Processing CreateTablet for tablet ad0b6a949ee94dddab00a0afe84da820 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:32.186568 21857 tablet_service.cc:1511] Processing CreateTablet for tablet 590d7eea40954779924038b15b716b58 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:32.187485 22007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0b6a949ee94dddab00a0afe84da820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.187884 21857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590d7eea40954779924038b15b716b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.194507 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 590d7eea40954779924038b15b716b58 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:32.195768 22069 tablet_bootstrap.cc:654] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.195907 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590d7eea40954779924038b15b716b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.198098 21938 tablet_service.cc:1511] Processing CreateTablet for tablet a3f11dd69f214cd6b7b169181c1a910b (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:32.199434 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f11dd69f214cd6b7b169181c1a910b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.199330 21859 tablet_service.cc:1511] Processing CreateTablet for tablet a3f11dd69f214cd6b7b169181c1a910b (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:32.200682 21859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f11dd69f214cd6b7b169181c1a910b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.202869 21932 tablet_service.cc:1511] Processing CreateTablet for tablet 761d07666b514c36bcf7826ed77f8d8b (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:32.206830 21932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761d07666b514c36bcf7826ed77f8d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.206871 21939 tablet_service.cc:1511] Processing CreateTablet for tablet e3fd785266e045ce9ae6bb7160866b9d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:32.208292 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fd785266e045ce9ae6bb7160866b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.207980 22005 tablet_service.cc:1511] Processing CreateTablet for tablet a3f11dd69f214cd6b7b169181c1a910b (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:32.209398 22005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f11dd69f214cd6b7b169181c1a910b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.209499 21937 tablet_service.cc:1511] Processing CreateTablet for tablet 2f51668452ae440fa9267f7cb2f597c9 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:32.210781 21937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f51668452ae440fa9267f7cb2f597c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.211366 21865 tablet_service.cc:1511] Processing CreateTablet for tablet 761d07666b514c36bcf7826ed77f8d8b (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:32.212618 21865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761d07666b514c36bcf7826ed77f8d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.212913 22010 tablet_service.cc:1511] Processing CreateTablet for tablet 761d07666b514c36bcf7826ed77f8d8b (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:32.213497 21858 tablet_service.cc:1511] Processing CreateTablet for tablet e3fd785266e045ce9ae6bb7160866b9d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:32.214143 22010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761d07666b514c36bcf7826ed77f8d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.214725 21858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fd785266e045ce9ae6bb7160866b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.217352 22011 tablet_service.cc:1511] Processing CreateTablet for tablet e3fd785266e045ce9ae6bb7160866b9d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:32.217424 21862 tablet_service.cc:1511] Processing CreateTablet for tablet 2f51668452ae440fa9267f7cb2f597c9 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:32.218806 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fd785266e045ce9ae6bb7160866b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.218883 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f51668452ae440fa9267f7cb2f597c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.206739 22012 tablet_service.cc:1511] Processing CreateTablet for tablet 590d7eea40954779924038b15b716b58 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:32.221873 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590d7eea40954779924038b15b716b58. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:32.225623 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:32.242026 21861 tablet_service.cc:1511] Processing CreateTablet for tablet c64648f65a9248d0b9e34c739a250e4c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:32.242026 21936 tablet_service.cc:1511] Processing CreateTablet for tablet c64648f65a9248d0b9e34c739a250e4c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:32.242921 22014 tablet_service.cc:1511] Processing CreateTablet for tablet c64648f65a9248d0b9e34c739a250e4c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:32.246517 21936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64648f65a9248d0b9e34c739a250e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.246507 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64648f65a9248d0b9e34c739a250e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.247397 21864 tablet_service.cc:1511] Processing CreateTablet for tablet 130319e952f14561b08ef212107e1666 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:32.249873 21935 tablet_service.cc:1511] Processing CreateTablet for tablet 130319e952f14561b08ef212107e1666 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:32.251127 21935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130319e952f14561b08ef212107e1666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.250880 21860 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:32.252010 22009 tablet_service.cc:1511] Processing CreateTablet for tablet 130319e952f14561b08ef212107e1666 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:32.255488 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64648f65a9248d0b9e34c739a250e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.256111 22009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130319e952f14561b08ef212107e1666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.260967 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130319e952f14561b08ef212107e1666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.261660 21860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.269761 22013 tablet_service.cc:1511] Processing CreateTablet for tablet 2f51668452ae440fa9267f7cb2f597c9 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:32.272045 21934 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:32.273835 21934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.274555 22008 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:32.282009 22067 tablet_bootstrap.cc:654] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.291226 22071 tablet_bootstrap.cc:492] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:32.297204 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f51668452ae440fa9267f7cb2f597c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.297864 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.317214 21863 tablet_service.cc:1511] Processing CreateTablet for tablet 9152786e68fb4b41a29fa44da39a923a (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:32.318979 21863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9152786e68fb4b41a29fa44da39a923a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.367544 22067 tablet_bootstrap.cc:492] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:32.368306 22067 ts_tablet_manager.cc:1403] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.183s	user 0.011s	sys 0.004s
I20260709 13:05:32.389201 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 9152786e68fb4b41a29fa44da39a923a (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:32.390398 22071 tablet_bootstrap.cc:654] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.390575 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9152786e68fb4b41a29fa44da39a923a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.390843 22069 tablet_bootstrap.cc:492] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:32.399050 21861 tablet_service.cc:1511] Processing CreateTablet for tablet 7dafb6252675441ca7ff8bf9e864644c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:32.399681 22014 tablet_service.cc:1511] Processing CreateTablet for tablet 9152786e68fb4b41a29fa44da39a923a (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:32.401073 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dafb6252675441ca7ff8bf9e864644c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.401329 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9152786e68fb4b41a29fa44da39a923a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.399058 22069 ts_tablet_manager.cc:1403] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.230s	user 0.022s	sys 0.016s
I20260709 13:05:32.408382 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 7dafb6252675441ca7ff8bf9e864644c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:32.409252 22069 raft_consensus.cc:359] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.410132 22069 raft_consensus.cc:385] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.410460 22069 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.409799 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dafb6252675441ca7ff8bf9e864644c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.412890 22069 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.392917 22067 raft_consensus.cc:359] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.414489 22067 raft_consensus.cc:385] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.414985 22067 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.416163 22067 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.418278 22067 ts_tablet_manager.cc:1434] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.047s	user 0.001s	sys 0.006s
I20260709 13:05:32.418702 22011 tablet_service.cc:1511] Processing CreateTablet for tablet 7dafb6252675441ca7ff8bf9e864644c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:32.420102 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dafb6252675441ca7ff8bf9e864644c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.420881 22071 tablet_bootstrap.cc:492] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:32.421371 22071 ts_tablet_manager.cc:1403] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.169s	user 0.007s	sys 0.007s
I20260709 13:05:32.422480 22067 tablet_bootstrap.cc:492] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:32.424431 22071 raft_consensus.cc:359] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.436744 22071 raft_consensus.cc:385] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.437095 22071 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.437023 21864 tablet_service.cc:1511] Processing CreateTablet for tablet 54fabc2ab3354c0ab4e0d3f4670eb221 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:32.438287 22071 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.441329 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 54fabc2ab3354c0ab4e0d3f4670eb221 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:32.442760 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fabc2ab3354c0ab4e0d3f4670eb221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.442767 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fabc2ab3354c0ab4e0d3f4670eb221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.457072 22011 tablet_service.cc:1511] Processing CreateTablet for tablet 54fabc2ab3354c0ab4e0d3f4670eb221 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:32.459022 22067 tablet_bootstrap.cc:654] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.465525 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fabc2ab3354c0ab4e0d3f4670eb221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.465317 21862 tablet_service.cc:1511] Processing CreateTablet for tablet f5f518749c784001a1f5106719d0b72f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:32.467975 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f518749c784001a1f5106719d0b72f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.466256 22070 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.470626 22070 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.476415 22070 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:32.466864 22071 ts_tablet_manager.cc:1434] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.006s
I20260709 13:05:32.477972 22049 heartbeater.cc:499] Master 127.20.69.62:45563 was elected leader, sending a full tablet report...
I20260709 13:05:32.489357 22071 tablet_bootstrap.cc:492] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:32.505082 22069 ts_tablet_manager.cc:1434] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.099s	user 0.018s	sys 0.031s
I20260709 13:05:32.505681 21939 tablet_service.cc:1511] Processing CreateTablet for tablet f5f518749c784001a1f5106719d0b72f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:32.506031 21975 heartbeater.cc:499] Master 127.20.69.62:45563 was elected leader, sending a full tablet report...
I20260709 13:05:32.507275 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f518749c784001a1f5106719d0b72f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.516748 22069 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:32.518500 22011 tablet_service.cc:1511] Processing CreateTablet for tablet f5f518749c784001a1f5106719d0b72f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:32.520166 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f518749c784001a1f5106719d0b72f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.523471 22069 tablet_bootstrap.cc:654] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.525700 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 04a8fcd2517b44a4895a7b0ec8966a41 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:32.527048 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a8fcd2517b44a4895a7b0ec8966a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.524078 21861 tablet_service.cc:1511] Processing CreateTablet for tablet 04a8fcd2517b44a4895a7b0ec8966a41 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:32.529628 22014 tablet_service.cc:1511] Processing CreateTablet for tablet 04a8fcd2517b44a4895a7b0ec8966a41 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:32.529438 22071 tablet_bootstrap.cc:654] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.529378 21865 tablet_service.cc:1511] Processing CreateTablet for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:32.537361 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a8fcd2517b44a4895a7b0ec8966a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.542716 22067 tablet_bootstrap.cc:492] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:32.543285 22067 ts_tablet_manager.cc:1403] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.004s
I20260709 13:05:32.536309 21938 tablet_service.cc:1511] Processing CreateTablet for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:32.546161 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.547310 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a8fcd2517b44a4895a7b0ec8966a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.546435 22067 raft_consensus.cc:359] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.553575 22067 raft_consensus.cc:385] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.553912 22067 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.554801 22067 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.561884 22067 ts_tablet_manager.cc:1434] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:05:32.562935 22067 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:32.566890 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:32.568562 21838 leader_election.cc:343] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.578370 22067 tablet_bootstrap.cc:654] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.581558 21865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.582213 22070 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.582958 22070 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.587703 21862 tablet_service.cc:1511] Processing CreateTablet for tablet 2eddf7375a2842f7bbfd9ab2061e0027 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:32.589084 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eddf7375a2842f7bbfd9ab2061e0027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.590689 22013 tablet_service.cc:1511] Processing CreateTablet for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:32.591127 22070 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:32.592029 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.592332 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:32.593835 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:32.595952 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:32.596359 21841 leader_election.cc:343] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:32.597082 21841 leader_election.cc:343] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:32.597208 21838 leader_election.cc:343] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.597960 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:32.599145 22070 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.594084 22071 tablet_bootstrap.cc:492] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:32.598152 21838 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:32.600356 22071 ts_tablet_manager.cc:1403] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.111s	user 0.006s	sys 0.008s
I20260709 13:05:32.601058 22070 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.603634 22071 raft_consensus.cc:359] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.618770 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 2eddf7375a2842f7bbfd9ab2061e0027 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:32.619165 22075 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.619757 22069 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:32.620303 22069 ts_tablet_manager.cc:1403] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.104s	user 0.024s	sys 0.017s
I20260709 13:05:32.619865 22075 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.620468 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eddf7375a2842f7bbfd9ab2061e0027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.623631 22069 raft_consensus.cc:359] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.624404 22069 raft_consensus.cc:385] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.632726 22069 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.604496 22071 raft_consensus.cc:385] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.633635 22071 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
W20260709 13:05:32.634425 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1260 after lost signal to thread 20759
I20260709 13:05:32.634209 22075 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:32.646972 22014 tablet_service.cc:1511] Processing CreateTablet for tablet 2eddf7375a2842f7bbfd9ab2061e0027 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:32.648319 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eddf7375a2842f7bbfd9ab2061e0027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.648687 22069 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.649780 22011 tablet_service.cc:1511] Processing CreateTablet for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:32.650982 22069 ts_tablet_manager.cc:1434] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:05:32.651069 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.652041 22069 tablet_bootstrap.cc:492] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:32.652486 21862 tablet_service.cc:1511] Processing CreateTablet for tablet b83eb73076f949419556cb7ef3746784 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:32.652783 22071 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.653766 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83eb73076f949419556cb7ef3746784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.655242 22071 ts_tablet_manager.cc:1434] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.055s	user 0.001s	sys 0.005s
I20260709 13:05:32.656231 22071 tablet_bootstrap.cc:492] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:32.661564 21861 tablet_service.cc:1511] Processing CreateTablet for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:32.662889 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.665382 21939 tablet_service.cc:1511] Processing CreateTablet for tablet b83eb73076f949419556cb7ef3746784 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:32.666630 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83eb73076f949419556cb7ef3746784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.667023 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:32.668334 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.672024 22075 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.672622 22075 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.675258 22075 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:32.685103 22070 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.684862 22011 tablet_service.cc:1511] Processing CreateTablet for tablet b83eb73076f949419556cb7ef3746784 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:32.685571 22070 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.686178 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83eb73076f949419556cb7ef3746784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.687677 22070 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:32.689286 21865 tablet_service.cc:1511] Processing CreateTablet for tablet 82fae287aad247d99c33e1a07c6e82a3 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:32.690227 22008 tablet_service.cc:1511] Processing CreateTablet for tablet 82fae287aad247d99c33e1a07c6e82a3 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:32.690727 21865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fae287aad247d99c33e1a07c6e82a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.691493 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fae287aad247d99c33e1a07c6e82a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.692368 21864 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdea259b2284b5c9cec755539e72888 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:32.693701 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdea259b2284b5c9cec755539e72888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.694380 21936 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdea259b2284b5c9cec755539e72888 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:32.695616 21936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdea259b2284b5c9cec755539e72888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.690196 21938 tablet_service.cc:1511] Processing CreateTablet for tablet 82fae287aad247d99c33e1a07c6e82a3 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:32.699651 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fae287aad247d99c33e1a07c6e82a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.699802 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:32.701292 21838 leader_election.cc:343] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.712955 22071 tablet_bootstrap.cc:654] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.717826 22067 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:32.718360 22067 ts_tablet_manager.cc:1403] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.011s
I20260709 13:05:32.721624 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:32.723308 21841 leader_election.cc:343] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.723835 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:32.724804 22070 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.721457 22067 raft_consensus.cc:359] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.726219 22067 raft_consensus.cc:385] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.726619 22067 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.723469 22069 tablet_bootstrap.cc:654] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.728853 22067 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.731424 22067 ts_tablet_manager.cc:1434] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:32.732461 22067 tablet_bootstrap.cc:492] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:32.738950 22067 tablet_bootstrap.cc:654] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.741283 22071 tablet_bootstrap.cc:492] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:32.741802 22071 ts_tablet_manager.cc:1403] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.003s
I20260709 13:05:32.742790 21861 tablet_service.cc:1511] Processing CreateTablet for tablet f9fc717cf49c47969c86d6c23778f56c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:32.744175 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9fc717cf49c47969c86d6c23778f56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.743978 21934 tablet_service.cc:1511] Processing CreateTablet for tablet f9fc717cf49c47969c86d6c23778f56c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:32.745337 21934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9fc717cf49c47969c86d6c23778f56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.745031 22013 tablet_service.cc:1511] Processing CreateTablet for tablet f9fc717cf49c47969c86d6c23778f56c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:32.746269 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9fc717cf49c47969c86d6c23778f56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.753823 22008 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdea259b2284b5c9cec755539e72888 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:32.755414 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdea259b2284b5c9cec755539e72888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.757995 22071 raft_consensus.cc:359] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.758772 22071 raft_consensus.cc:385] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.759057 22071 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.765586 22071 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.771785 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:32.774140 22071 ts_tablet_manager.cc:1434] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.005s
I20260709 13:05:32.775301 22071 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:32.775621 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:05:32.777853 21914 leader_election.cc:343] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:32.779286 21914 leader_election.cc:343] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.782593 22071 tablet_bootstrap.cc:654] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.800590 22069 tablet_bootstrap.cc:492] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:32.801138 22069 ts_tablet_manager.cc:1403] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.024s
I20260709 13:05:32.804003 22069 raft_consensus.cc:359] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.804814 22069 raft_consensus.cc:385] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.804471 21861 tablet_service.cc:1511] Processing CreateTablet for tablet 1b7ba79f0d534cbba2170f41c42625e6 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:32.805115 22069 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.805871 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b7ba79f0d534cbba2170f41c42625e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.806058 22069 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.811071 22069 ts_tablet_manager.cc:1434] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:32.812137 22069 tablet_bootstrap.cc:492] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:32.820405 22069 tablet_bootstrap.cc:654] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.832324 22069 tablet_bootstrap.cc:492] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:32.832860 22069 ts_tablet_manager.cc:1403] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:05:32.837710 22008 tablet_service.cc:1511] Processing CreateTablet for tablet 1b7ba79f0d534cbba2170f41c42625e6 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:32.839150 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b7ba79f0d534cbba2170f41c42625e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.849782 21936 tablet_service.cc:1511] Processing CreateTablet for tablet 1b7ba79f0d534cbba2170f41c42625e6 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:32.851339 21936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b7ba79f0d534cbba2170f41c42625e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.849699 22069 raft_consensus.cc:359] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.855360 22069 raft_consensus.cc:385] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.855767 22069 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.858855 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:32.858760 22069 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.859592 22024 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:32.861491 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:32.862825 22075 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:32.863273 22075 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.863444 22067 tablet_bootstrap.cc:492] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:32.863723 22075 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.864182 22067 ts_tablet_manager.cc:1403] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.024s
I20260709 13:05:32.868381 22067 raft_consensus.cc:359] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.869581 22067 raft_consensus.cc:385] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.869763 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:32.870091 22069 ts_tablet_manager.cc:1434] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:05:32.871311 22069 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
W20260709 13:05:32.871501 21916 leader_election.cc:343] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:32.871996 21916 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:32.879926 22071 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:32.870030 22067 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.880558 22069 tablet_bootstrap.cc:654] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.880640 22071 ts_tablet_manager.cc:1403] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.106s	user 0.037s	sys 0.054s
I20260709 13:05:32.881523 22067 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.884218 22071 raft_consensus.cc:359] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.885116 22071 raft_consensus.cc:385] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.885499 22071 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.886373 22067 ts_tablet_manager.cc:1434] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
I20260709 13:05:32.886432 22071 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.887591 22067 tablet_bootstrap.cc:492] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:32.889007 22075 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.891908 22071 ts_tablet_manager.cc:1434] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:32.893077 22071 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:32.894245 22067 tablet_bootstrap.cc:654] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.899893 22071 tablet_bootstrap.cc:654] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:32.911340 21864 tablet_service.cc:1511] Processing CreateTablet for tablet da1dbb318a2c4a44b440673a00d826d1 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:32.912962 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1dbb318a2c4a44b440673a00d826d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.915436 21939 tablet_service.cc:1511] Processing CreateTablet for tablet da1dbb318a2c4a44b440673a00d826d1 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:32.916931 22067 tablet_bootstrap.cc:492] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:32.916997 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1dbb318a2c4a44b440673a00d826d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.917523 22067 ts_tablet_manager.cc:1403] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.009s
I20260709 13:05:32.921078 22067 raft_consensus.cc:359] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.921837 22067 raft_consensus.cc:385] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.922135 22067 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.926853 22071 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:32.927495 22071 ts_tablet_manager.cc:1403] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.003s
I20260709 13:05:32.928305 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:32.928900 22067 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.929852 21875 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.930961 22071 raft_consensus.cc:359] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.938759 22071 raft_consensus.cc:385] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:32.939189 22071 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:32.940187 22071 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:32.934439 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 62973.3us
I20260709 13:05:32.937114 21875 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:32.938187 22076 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.933681 22091 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:32.940732 22075 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:32.948390 22008 tablet_service.cc:1511] Processing CreateTablet for tablet da1dbb318a2c4a44b440673a00d826d1 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:32.949913 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1dbb318a2c4a44b440673a00d826d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.951690 22067 ts_tablet_manager.cc:1434] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:05:32.942454 22076 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:32.944393 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:32.957906 22075 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:32.966307 22067 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:32.969058 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:32.974920 22024 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:32.963935 22076 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:32.987017 21862 tablet_service.cc:1511] Processing CreateTablet for tablet 5d092f1c41e747e194d93526c0fad944 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:32.989169 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d092f1c41e747e194d93526c0fad944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.008301 22070 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.009002 22070 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.012955 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:33.026762 21861 tablet_service.cc:1511] Processing CreateTablet for tablet d8f404cd14ba4c2687ffe2b7637e1da7 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:05:33.029848 21838 leader_election.cc:343] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.033660 21864 tablet_service.cc:1511] Processing CreateTablet for tablet ade18365d2864739b70e41ba62311466 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:33.034888 22067 tablet_bootstrap.cc:654] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.035027 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade18365d2864739b70e41ba62311466. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.037946 22024 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:33.038323 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:33.038926 22069 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:33.039028 21950 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.039454 22069 ts_tablet_manager.cc:1403] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.168s	user 0.040s	sys 0.055s
I20260709 13:05:33.029287 22075 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:33.043032 22071 ts_tablet_manager.cc:1434] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.115s	user 0.020s	sys 0.033s
I20260709 13:05:33.045130 22069 raft_consensus.cc:359] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.045898 22069 raft_consensus.cc:385] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.046203 22069 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.046466 22071 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:33.046921 22069 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.043954 22070 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:33.049296 22069 ts_tablet_manager.cc:1434] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:33.050300 22069 tablet_bootstrap.cc:492] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:33.053514 21987 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:33.053243 22075 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.054589 22095 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.054988 22095 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.055302 22095 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.056931 22069 tablet_bootstrap.cc:654] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.057034 22071 tablet_bootstrap.cc:654] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.057824 21938 tablet_service.cc:1511] Processing CreateTablet for tablet ade18365d2864739b70e41ba62311466 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:33.059170 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade18365d2864739b70e41ba62311466. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.044162 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f404cd14ba4c2687ffe2b7637e1da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.043812 21865 tablet_service.cc:1511] Processing CreateTablet for tablet 8a809fa455ae4f1e908dd7d0f1f2ee8f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:33.056053 21934 tablet_service.cc:1511] Processing CreateTablet for tablet d8f404cd14ba4c2687ffe2b7637e1da7 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:33.062458 21934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f404cd14ba4c2687ffe2b7637e1da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.062939 21858 tablet_service.cc:1511] Processing CreateTablet for tablet 8d57015ad0d14c41a8a97e3c1e1d63f4 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:33.065517 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 8a809fa455ae4f1e908dd7d0f1f2ee8f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:33.066862 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a809fa455ae4f1e908dd7d0f1f2ee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.069612 21865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a809fa455ae4f1e908dd7d0f1f2ee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.074831 22076 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.077368 22076 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.078984 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 8d57015ad0d14c41a8a97e3c1e1d63f4 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:33.079532 22076 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:33.080369 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d57015ad0d14c41a8a97e3c1e1d63f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.083495 22095 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.085289 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:33.085927 21950 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.086304 22013 tablet_service.cc:1511] Processing CreateTablet for tablet d8f404cd14ba4c2687ffe2b7637e1da7 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:33.086699 22014 tablet_service.cc:1511] Processing CreateTablet for tablet 8a809fa455ae4f1e908dd7d0f1f2ee8f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:33.087610 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f404cd14ba4c2687ffe2b7637e1da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.087359 22008 tablet_service.cc:1511] Processing CreateTablet for tablet 5d092f1c41e747e194d93526c0fad944 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:33.087886 21987 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:33.086853 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:33.088622 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d092f1c41e747e194d93526c0fad944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.089783 22076 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.090197 22076 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.089959 22011 tablet_service.cc:1511] Processing CreateTablet for tablet ade18365d2864739b70e41ba62311466 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:05:33.091177 21841 leader_election.cc:343] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.091637 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ade18365d2864739b70e41ba62311466. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.092792 21858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d57015ad0d14c41a8a97e3c1e1d63f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.091638 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:33.094190 22070 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:33.090567 22076 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.102070 22012 tablet_service.cc:1511] Processing CreateTablet for tablet 8d57015ad0d14c41a8a97e3c1e1d63f4 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:33.103442 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d57015ad0d14c41a8a97e3c1e1d63f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.105137 21936 tablet_service.cc:1511] Processing CreateTablet for tablet 5d092f1c41e747e194d93526c0fad944 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:33.106453 21936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d092f1c41e747e194d93526c0fad944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.128170 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a809fa455ae4f1e908dd7d0f1f2ee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.133653 21939 tablet_service.cc:1511] Processing CreateTablet for tablet ca34a4d332f1434f8089d28952415e70 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:33.134505 22009 tablet_service.cc:1511] Processing CreateTablet for tablet ca34a4d332f1434f8089d28952415e70 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:33.135808 22009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca34a4d332f1434f8089d28952415e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.137671 22067 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:33.137995 22069 tablet_bootstrap.cc:492] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:33.138211 22067 ts_tablet_manager.cc:1403] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.172s	user 0.015s	sys 0.004s
I20260709 13:05:33.138448 22069 ts_tablet_manager.cc:1403] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.029s
I20260709 13:05:33.139999 22095 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:33.141655 22069 raft_consensus.cc:359] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.142443 22069 raft_consensus.cc:385] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.142751 22069 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.145486 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:33.145394 22069 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.145690 21864 tablet_service.cc:1511] Processing CreateTablet for tablet ca34a4d332f1434f8089d28952415e70 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:33.147097 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca34a4d332f1434f8089d28952415e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.146081 21950 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.152253 22069 ts_tablet_manager.cc:1434] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:05:33.153404 22069 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:33.154979 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:33.155314 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:33.155699 21875 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.156067 21874 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.155628 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:33.157222 21873 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.134903 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca34a4d332f1434f8089d28952415e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.165297 21862 tablet_service.cc:1511] Processing CreateTablet for tablet 7685d376b61d438aa76f16fe47a7846d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:33.166719 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685d376b61d438aa76f16fe47a7846d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.171193 22069 tablet_bootstrap.cc:654] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.171265 21772 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.174324 22067 raft_consensus.cc:359] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.175132 22067 raft_consensus.cc:385] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.175462 22067 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.176340 22067 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.178836 22076 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.179622 22010 tablet_service.cc:1511] Processing CreateTablet for tablet 7685d376b61d438aa76f16fe47a7846d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:33.180979 22010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685d376b61d438aa76f16fe47a7846d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.181771 22067 ts_tablet_manager.cc:1434] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260709 13:05:33.181805 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:33.182564 21874 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.183085 22067 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:33.187845 21873 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:33.194161 21874 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:33.195724 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:33.196616 22095 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.215942 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:33.217036 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 7685d376b61d438aa76f16fe47a7846d (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:33.218429 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685d376b61d438aa76f16fe47a7846d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.222446 21861 tablet_service.cc:1511] Processing CreateTablet for tablet 535d3d7bb32243b6b555376404412d8c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:33.223444 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535d3d7bb32243b6b555376404412d8c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:33.228423 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:33.196887 21950 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:33.245641 22095 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:33.249845 22076 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:33.263579 22095 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.271062 22071 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:33.272742 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 535d3d7bb32243b6b555376404412d8c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:33.273088 21858 tablet_service.cc:1511] Processing CreateTablet for tablet f8f8c3db69fa448a9f5e5d132c33b414 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:33.278448 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:33.281090 21934 tablet_service.cc:1511] Processing CreateTablet for tablet a2e697f6ebda4eec99aeb32b72b9bfa4 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:33.283730 21860 tablet_service.cc:1511] Processing CreateTablet for tablet a2e697f6ebda4eec99aeb32b72b9bfa4 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:33.287089 22067 tablet_bootstrap.cc:654] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.290719 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535d3d7bb32243b6b555376404412d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.291200 21940 tablet_service.cc:1511] Processing CreateTablet for tablet f8f8c3db69fa448a9f5e5d132c33b414 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:33.297477 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f8c3db69fa448a9f5e5d132c33b414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.303188 21934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e697f6ebda4eec99aeb32b72b9bfa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.304951 21938 tablet_service.cc:1511] Processing CreateTablet for tablet bd12cba9f1b74b1b908b1d598ca51a8c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:33.307351 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd12cba9f1b74b1b908b1d598ca51a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.309721 22069 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:33.310227 22069 ts_tablet_manager.cc:1403] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.157s	user 0.013s	sys 0.014s
I20260709 13:05:33.311101 21865 tablet_service.cc:1511] Processing CreateTablet for tablet bd12cba9f1b74b1b908b1d598ca51a8c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:33.296542 21950 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.313230 22069 raft_consensus.cc:359] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.313959 22069 raft_consensus.cc:385] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.314333 22069 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.314846 21858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f8c3db69fa448a9f5e5d132c33b414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.315471 21860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e697f6ebda4eec99aeb32b72b9bfa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.315115 22069 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.317747 22069 ts_tablet_manager.cc:1434] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:33.318742 22069 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:33.296880 22071 ts_tablet_manager.cc:1403] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.251s	user 0.016s	sys 0.016s
I20260709 13:05:33.326843 21865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd12cba9f1b74b1b908b1d598ca51a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.333504 22104 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.336418 22069 tablet_bootstrap.cc:654] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.335433 22104 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:33.341857 22104 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:33.301520 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 83222.8us
I20260709 13:05:33.346272 22076 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.346825 22076 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.340090 22071 raft_consensus.cc:359] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.347960 22071 raft_consensus.cc:385] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.348160 22014 tablet_service.cc:1511] Processing CreateTablet for tablet f8f8c3db69fa448a9f5e5d132c33b414 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:33.348716 22105 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.349285 22105 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.349958 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f8c3db69fa448a9f5e5d132c33b414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.351419 22076 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:33.349817 22009 tablet_service.cc:1511] Processing CreateTablet for tablet bd12cba9f1b74b1b908b1d598ca51a8c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:33.352680 22009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd12cba9f1b74b1b908b1d598ca51a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.348184 22010 tablet_service.cc:1511] Processing CreateTablet for tablet a2e697f6ebda4eec99aeb32b72b9bfa4 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:33.353230 22105 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:33.353446 22071 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.379864 21861 tablet_service.cc:1511] Processing CreateTablet for tablet cb3ae54bf5ef462ba44e223978c42103 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:33.381148 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3ae54bf5ef462ba44e223978c42103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.397583 22012 tablet_service.cc:1511] Processing CreateTablet for tablet 535d3d7bb32243b6b555376404412d8c (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:33.379827 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:33.404491 21873 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.415150 21940 tablet_service.cc:1511] Processing CreateTablet for tablet cb3ae54bf5ef462ba44e223978c42103 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:33.416783 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3ae54bf5ef462ba44e223978c42103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.429069 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:33.431030 22010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e697f6ebda4eec99aeb32b72b9bfa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.441495 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535d3d7bb32243b6b555376404412d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.447289 22071 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.454929 22071 ts_tablet_manager.cc:1434] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.130s	user 0.006s	sys 0.002s
I20260709 13:05:33.459255 22071 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:33.457538 21950 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:33.465701 22075 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.465677 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:33.489058 22104 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.489490 22104 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.489872 22104 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.489651 21938 tablet_service.cc:1511] Processing CreateTablet for tablet ef15581ea60041b6a79f34c9e4dbe9c3 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:33.488467 21773 catalog_manager.cc:5697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.490935 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef15581ea60041b6a79f34c9e4dbe9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.479772 22075 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.494745 22075 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:33.496304 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:33.466701 21858 tablet_service.cc:1511] Processing CreateTablet for tablet ef15581ea60041b6a79f34c9e4dbe9c3 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:33.497587 21858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef15581ea60041b6a79f34c9e4dbe9c3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:33.497771 21916 leader_election.cc:343] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.498346 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:33.499017 21873 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:33.500427 22071 tablet_bootstrap.cc:654] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.466562 22013 tablet_service.cc:1511] Processing CreateTablet for tablet cb3ae54bf5ef462ba44e223978c42103 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:33.504297 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:33.525230 21950 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.520870 21861 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeff5779b544ebaac041e407041b284 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:33.523384 21864 tablet_service.cc:1511] Processing CreateTablet for tablet 105015b2b463442ab34e0509af7105fb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:33.525481 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3ae54bf5ef462ba44e223978c42103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.519696 22069 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:33.533092 22069 ts_tablet_manager.cc:1403] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.215s	user 0.045s	sys 0.053s
I20260709 13:05:33.533406 22067 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
W20260709 13:05:33.483139 21988 leader_election.cc:343] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.534109 22067 ts_tablet_manager.cc:1403] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.351s	user 0.023s	sys 0.012s
I20260709 13:05:33.517586 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:33.528129 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeff5779b544ebaac041e407041b284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.542124 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:33.543776 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeff5779b544ebaac041e407041b284 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:33.545084 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeff5779b544ebaac041e407041b284. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:33.539202 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56099.7us
I20260709 13:05:33.549031 22098 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.549471 22098 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.549837 22098 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.551141 22008 tablet_service.cc:1511] Processing CreateTablet for tablet a6be2f940d334bd0b3c9d1b89bc17d2f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:33.551301 22011 tablet_service.cc:1511] Processing CreateTablet for tablet 7eeff5779b544ebaac041e407041b284 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:33.553665 22009 tablet_service.cc:1511] Processing CreateTablet for tablet ef15581ea60041b6a79f34c9e4dbe9c3 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:33.538439 21940 tablet_service.cc:1511] Processing CreateTablet for tablet a6be2f940d334bd0b3c9d1b89bc17d2f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:33.554940 22069 raft_consensus.cc:359] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.555473 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6be2f940d334bd0b3c9d1b89bc17d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.555675 22069 raft_consensus.cc:385] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.560429 21949 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.562372 21987 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:33.563006 22067 raft_consensus.cc:359] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.563788 22067 raft_consensus.cc:385] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.564087 22067 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.544715 21865 tablet_service.cc:1511] Processing CreateTablet for tablet a6be2f940d334bd0b3c9d1b89bc17d2f (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:33.564366 22109 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.565001 22069 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.565225 22109 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.566267 22069 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.565292 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105015b2b463442ab34e0509af7105fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.569540 22069 ts_tablet_manager.cc:1434] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:05:33.570178 22075 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.581422 22075 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.571981 22005 tablet_service.cc:1511] Processing CreateTablet for tablet 105015b2b463442ab34e0509af7105fb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:33.574437 21862 tablet_service.cc:1511] Processing CreateTablet for tablet 2af20d42858245eb986768009de88379 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:33.583967 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af20d42858245eb986768009de88379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.571079 22109 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.581815 22006 tablet_service.cc:1511] Processing CreateTablet for tablet 2af20d42858245eb986768009de88379 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:33.587980 22098 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.589494 22075 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:33.590222 22075 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.590304 21860 tablet_service.cc:1511] Processing CreateTablet for tablet e8f816617b58480bad6550570b514d80 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:33.591697 21860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f816617b58480bad6550570b514d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.594960 22098 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:33.596393 22069 tablet_bootstrap.cc:492] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:33.596239 22067 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.597080 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6be2f940d334bd0b3c9d1b89bc17d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.604226 22007 tablet_service.cc:1511] Processing CreateTablet for tablet e8f816617b58480bad6550570b514d80 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:33.605638 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eeff5779b544ebaac041e407041b284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.613235 22105 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.613822 22105 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.616025 22105 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:33.618423 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:33.619174 21873 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.620707 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:33.620823 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:33.621469 21949 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:33.623359 22105 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.623818 22105 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.624199 22105 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.628320 22067 ts_tablet_manager.cc:1434] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 13:05:33.624390 22071 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:33.627426 21865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6be2f940d334bd0b3c9d1b89bc17d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.597932 22104 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.645152 22104 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:33.633720 22009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef15581ea60041b6a79f34c9e4dbe9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.646955 22069 tablet_bootstrap.cc:654] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.647959 22071 ts_tablet_manager.cc:1403] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.189s	user 0.011s	sys 0.019s
I20260709 13:05:33.655943 22007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f816617b58480bad6550570b514d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.656562 22012 tablet_service.cc:1511] Processing CreateTablet for tablet 866936931060464d858e0e11cefba859 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:33.656883 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:33.657940 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866936931060464d858e0e11cefba859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.649083 22014 tablet_service.cc:1511] Processing CreateTablet for tablet b185f97673b24433b4222ebdebb6f211 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:33.658641 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:33.658974 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b185f97673b24433b4222ebdebb6f211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.659232 21949 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.661085 22005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105015b2b463442ab34e0509af7105fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.664209 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af20d42858245eb986768009de88379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.667086 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:33.667253 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:33.667758 21873 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:33.673149 21916 leader_election.cc:343] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.679229 22067 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
W20260709 13:05:33.646909 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 77596.9us
I20260709 13:05:33.681607 22109 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.684002 22109 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:33.686045 22071 raft_consensus.cc:359] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.686403 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:33.686781 22071 raft_consensus.cc:385] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.687114 22071 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
W20260709 13:05:33.688100 21988 leader_election.cc:343] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:33.691036 22067 tablet_bootstrap.cc:654] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.693467 21861 tablet_service.cc:1511] Processing CreateTablet for tablet b185f97673b24433b4222ebdebb6f211 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:33.696029 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:33.696748 21950 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.696849 22075 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.684376 22013 tablet_service.cc:1511] Processing CreateTablet for tablet 6c93691583c1413ca9d0cb9e64fbd7cd (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:33.699641 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b185f97673b24433b4222ebdebb6f211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.700263 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c93691583c1413ca9d0cb9e64fbd7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.701921 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 105015b2b463442ab34e0509af7105fb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:33.703068 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105015b2b463442ab34e0509af7105fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.708519 21950 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:33.710003 21987 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:33.711277 22109 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:33.712026 22109 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:33.687860 22071 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.717612 21940 tablet_service.cc:1511] Processing CreateTablet for tablet 2af20d42858245eb986768009de88379 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:33.718999 21940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af20d42858245eb986768009de88379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.718798 21934 tablet_service.cc:1511] Processing CreateTablet for tablet e8f816617b58480bad6550570b514d80 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:33.720214 21934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f816617b58480bad6550570b514d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.725525 21864 tablet_service.cc:1511] Processing CreateTablet for tablet 866936931060464d858e0e11cefba859 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:33.720819 21856 tablet_service.cc:1511] Processing CreateTablet for tablet 23093b4e74d34b3d87ab577135fa1517 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:33.726759 21859 tablet_service.cc:1511] Processing CreateTablet for tablet 6c93691583c1413ca9d0cb9e64fbd7cd (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:33.727705 22109 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.730355 21857 tablet_service.cc:1511] Processing CreateTablet for tablet 080e5fa3988746d88e6350506ed3b136 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:33.732808 21859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c93691583c1413ca9d0cb9e64fbd7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.721092 21863 tablet_service.cc:1511] Processing CreateTablet for tablet eda002bd6903433da20d221420291f1e (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:33.735042 21863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda002bd6903433da20d221420291f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.736159 21856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23093b4e74d34b3d87ab577135fa1517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.739715 22104 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:33.741380 21857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 080e5fa3988746d88e6350506ed3b136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.748018 21936 tablet_service.cc:1511] Processing CreateTablet for tablet b185f97673b24433b4222ebdebb6f211 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:33.749840 21936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b185f97673b24433b4222ebdebb6f211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.754701 21937 tablet_service.cc:1511] Processing CreateTablet for tablet 866936931060464d858e0e11cefba859 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:33.756487 21937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866936931060464d858e0e11cefba859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.761910 21933 tablet_service.cc:1511] Processing CreateTablet for tablet 6c93691583c1413ca9d0cb9e64fbd7cd (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:33.762285 21935 tablet_service.cc:1511] Processing CreateTablet for tablet eda002bd6903433da20d221420291f1e (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:33.763295 21933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c93691583c1413ca9d0cb9e64fbd7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.763134 21931 tablet_service.cc:1511] Processing CreateTablet for tablet 23093b4e74d34b3d87ab577135fa1517 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:33.765852 21935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda002bd6903433da20d221420291f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.766785 21862 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2be7847b8c4a19be52a47f4a860ceb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:33.768014 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:33.768410 21931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23093b4e74d34b3d87ab577135fa1517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.768759 21874 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:33.768040 21932 tablet_service.cc:1511] Processing CreateTablet for tablet 080e5fa3988746d88e6350506ed3b136 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:33.771126 21932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 080e5fa3988746d88e6350506ed3b136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.768383 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2be7847b8c4a19be52a47f4a860ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.773120 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866936931060464d858e0e11cefba859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.773108 22071 ts_tablet_manager.cc:1434] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.123s	user 0.006s	sys 0.002s
I20260709 13:05:33.796630 22014 tablet_service.cc:1511] Processing CreateTablet for tablet eda002bd6903433da20d221420291f1e (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:33.798100 22014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda002bd6903433da20d221420291f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.799954 22070 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.870090 22011 tablet_service.cc:1511] Processing CreateTablet for tablet 23093b4e74d34b3d87ab577135fa1517 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:33.871388 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23093b4e74d34b3d87ab577135fa1517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.855787 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:33.867674 22075 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.882195 22071 tablet_bootstrap.cc:492] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:33.856514 22070 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.887414 21874 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.882659 21914 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:33.919836 22098 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:33.920222 22098 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.920567 22098 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:33.930483 22069 tablet_bootstrap.cc:492] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:33.930979 22069 ts_tablet_manager.cc:1403] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.335s	user 0.023s	sys 0.046s
I20260709 13:05:33.934620 22067 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:33.935073 22067 ts_tablet_manager.cc:1403] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.257s	user 0.011s	sys 0.013s
I20260709 13:05:33.942171 22069 raft_consensus.cc:359] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.942873 22069 raft_consensus.cc:385] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.943148 22069 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.943949 22069 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.937772 22067 raft_consensus.cc:359] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:33.944706 21757 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 59623us
I20260709 13:05:33.944988 22067 raft_consensus.cc:385] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:33.945318 22067 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:33.946002 22067 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.955468 22071 tablet_bootstrap.cc:654] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:33.967166 21874 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:33.889155 22075 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:33.970683 22075 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:05:33.976079 22118 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:05:33.975919 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:33.976734 22022 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:33.985316 21916 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:33.877029 22010 tablet_service.cc:1511] Processing CreateTablet for tablet 080e5fa3988746d88e6350506ed3b136 (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:33.989768 22010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 080e5fa3988746d88e6350506ed3b136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:33.995293 22098 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:33.888366 21760 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44690.1us
I20260709 13:05:33.993996 22105 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.004815 22024 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 1: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:05:34.035883 22104 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:33.997651 21873 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:34.044348 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:34.045133 21874 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:34.054157 21931 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2be7847b8c4a19be52a47f4a860ceb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:34.075898 21931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2be7847b8c4a19be52a47f4a860ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:34.087985 22070 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:05:34.092769 21757 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 48523.3us
W20260709 13:05:34.135390 21758 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 91341.9us
I20260709 13:05:34.143657 21773 catalog_manager.cc:5697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.151614 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:34.134323 22098 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.149471 21773 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.153399 22098 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.153784 22098 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.154120 22098 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.154215 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:34.159904 22067 ts_tablet_manager.cc:1434] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.225s	user 0.030s	sys 0.027s
I20260709 13:05:34.161319 22067 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.166960 22069 ts_tablet_manager.cc:1434] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.236s	user 0.010s	sys 0.010s
I20260709 13:05:34.169641 22067 tablet_bootstrap.cc:654] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.168035 22069 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:34.154903 22024 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:34.112787 22105 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:34.188246 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:34.189107 21947 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 1: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:05:34.098834 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 91036.9us
I20260709 13:05:34.192167 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:34.192994 22069 tablet_bootstrap.cc:654] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.193804 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:34.217337 22122 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.215893 22022 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 1: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:05:34.213773 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:34.228645 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:34.229308 21872 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.229717 22115 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.230221 22115 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:34.231082 22115 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.229324 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:05:34.234956 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:34.236979 21872 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
W20260709 13:05:34.224675 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 53588.8us
I20260709 13:05:34.257164 22071 tablet_bootstrap.cc:492] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
W20260709 13:05:34.249356 21949 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.017s
I20260709 13:05:34.257704 22071 ts_tablet_manager.cc:1403] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.390s	user 0.013s	sys 0.025s
I20260709 13:05:34.228070 22104 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:05:34.259353 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:34.262276 22104 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.262825 22104 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:34.263512 22098 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.263746 22104 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.240933 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:34.265081 22109 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.267601 22126 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.268091 22126 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.268239 22122 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:34.266537 21949 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:34.285279 22067 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.285753 22067 ts_tablet_manager.cc:1403] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.125s	user 0.020s	sys 0.023s
I20260709 13:05:34.282331 21872 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.278065 22009 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2be7847b8c4a19be52a47f4a860ceb (DEFAULT_TABLE table=test-workload [id=1dcf9b53296142e9872b66d7539d2a36]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:34.278910 21947 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 1: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:05:34.291379 22009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2be7847b8c4a19be52a47f4a860ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:34.298192 22067 raft_consensus.cc:359] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.299227 22067 raft_consensus.cc:385] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.299585 22067 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.305555 22071 raft_consensus.cc:359] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.307317 22071 raft_consensus.cc:385] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.307641 22071 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.279241 22126 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.308338 22071 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.309823 22067 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.312366 22071 ts_tablet_manager.cc:1434] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:05:34.313731 22071 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:34.327040 21914 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:34.336989 22124 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.337533 22124 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.339746 22124 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.346072 22067 ts_tablet_manager.cc:1434] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.002s
I20260709 13:05:34.346899 22067 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.348829 22139 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:05:34.332962 22115 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.341068 22122 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.353145 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:34.354929 21916 leader_election.cc:343] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.362725 22067 tablet_bootstrap.cc:654] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:34.335616 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 67744.4us
I20260709 13:05:34.372575 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:34.373374 22023 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.364055 22098 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.387526 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:34.389106 21871 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:34.389472 22069 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:34.389981 22069 ts_tablet_manager.cc:1403] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.222s	user 0.009s	sys 0.008s
I20260709 13:05:34.391299 21914 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:34.392678 22098 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.393134 22098 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.393478 22098 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.395224 22105 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.392505 22071 tablet_bootstrap.cc:654] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.399381 22069 raft_consensus.cc:359] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.400082 22069 raft_consensus.cc:385] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.400331 22069 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.402542 22069 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.404412 22069 ts_tablet_manager.cc:1434] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:34.405381 22069 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:34.404690 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:34.420238 22069 tablet_bootstrap.cc:654] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.402056 21771 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.451639 22098 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.452376 22104 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.452864 22104 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.453956 22023 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:34.454980 22104 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:34.455369 21916 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:34.457566 22075 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.458070 22075 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:34.458884 22075 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.462018 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:34.462358 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:34.465649 22126 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.467682 21873 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 1: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:05:34.467868 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:34.468950 21874 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 1: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:05:34.470005 22126 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.476959 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:34.468511 21872 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.477178 22098 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.480568 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:34.481513 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:34.482498 22022 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 1: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:05:34.481577 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:34.483580 22122 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.487623 22069 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:34.488119 22069 ts_tablet_manager.cc:1403] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.000s
W20260709 13:05:34.488251 21916 leader_election.cc:343] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.490855 22069 raft_consensus.cc:359] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.491587 22069 raft_consensus.cc:385] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.491852 22069 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.492565 22069 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.493228 21872 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:34.495251 22069 ts_tablet_manager.cc:1434] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:05:34.496132 22067 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.496383 22069 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:34.496655 22067 ts_tablet_manager.cc:1403] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.012s
I20260709 13:05:34.498775 22067 raft_consensus.cc:359] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.499261 22067 raft_consensus.cc:385] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.499482 22067 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.494596 21914 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:34.501127 22067 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.502985 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:34.504070 22126 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.511261 22122 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.512544 22098 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.514092 22098 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:34.517870 22098 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.521068 22071 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:34.522899 22071 ts_tablet_manager.cc:1403] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.209s	user 0.011s	sys 0.009s
I20260709 13:05:34.525718 22071 raft_consensus.cc:359] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.526191 22071 raft_consensus.cc:385] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.526364 22071 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.526897 22071 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.512818 21773 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.528344 22071 ts_tablet_manager.cc:1434] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:05:34.521728 22067 ts_tablet_manager.cc:1434] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.018s
I20260709 13:05:34.529255 22071 tablet_bootstrap.cc:492] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:34.529336 22067 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.522330 22069 tablet_bootstrap.cc:654] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.535727 22071 tablet_bootstrap.cc:654] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.535734 22067 tablet_bootstrap.cc:654] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.537791 22126 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.538341 22126 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.543327 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:34.547717 21841 leader_election.cc:343] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.547256 21771 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.548712 22126 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.553689 22069 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:34.553627 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:34.554314 22069 ts_tablet_manager.cc:1403] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.001s
I20260709 13:05:34.554435 21947 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:34.555576 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:34.556711 22126 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.557081 22126 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.557420 22126 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.557790 22069 raft_consensus.cc:359] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.557420 21773 catalog_manager.cc:5697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.558543 22069 raft_consensus.cc:385] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.558910 22069 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.559675 22069 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.550098 21771 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.565106 22069 ts_tablet_manager.cc:1434] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:34.566031 22067 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.566032 22069 tablet_bootstrap.cc:492] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:34.566563 22067 ts_tablet_manager.cc:1403] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.013s
I20260709 13:05:34.564321 22126 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.569115 22067 raft_consensus.cc:359] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.569409 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:34.569852 22067 raft_consensus.cc:385] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.569993 21947 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.570152 22067 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.570876 22067 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.572443 22069 tablet_bootstrap.cc:654] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.572793 22067 ts_tablet_manager.cc:1434] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:34.573644 22067 tablet_bootstrap.cc:492] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.577759 21947 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:34.578895 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:34.579741 22070 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.580199 22070 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:34.581025 22070 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.591944 22067 tablet_bootstrap.cc:654] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.595671 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:05:34.597186 21841 leader_election.cc:343] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.597919 22126 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.601766 22071 tablet_bootstrap.cc:492] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:34.602346 22071 ts_tablet_manager.cc:1403] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.001s
I20260709 13:05:34.603996 21770 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.605998 22071 raft_consensus.cc:359] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.606762 22071 raft_consensus.cc:385] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.608263 22071 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.609118 22071 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.612443 22067 tablet_bootstrap.cc:492] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.613269 22067 ts_tablet_manager.cc:1403] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.002s
I20260709 13:05:34.614342 22071 ts_tablet_manager.cc:1434] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:34.615447 22071 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:34.616170 22067 raft_consensus.cc:359] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.616950 22067 raft_consensus.cc:385] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.617247 22067 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.618131 22067 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.612489 22069 tablet_bootstrap.cc:492] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:34.619628 22069 ts_tablet_manager.cc:1403] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.015s
I20260709 13:05:34.627264 22067 ts_tablet_manager.cc:1434] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:34.631317 22067 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.631420 22071 tablet_bootstrap.cc:654] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.629969 22069 raft_consensus.cc:359] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.634594 22069 raft_consensus.cc:385] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.635090 22069 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.638085 22098 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.639343 22069 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.644613 22069 ts_tablet_manager.cc:1434] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:34.646100 22067 tablet_bootstrap.cc:654] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.651432 22122 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.651983 22122 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.654328 22122 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:34.656068 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:34.656903 21875 raft_consensus.cc:2393] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 1: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:05:34.657637 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:34.659785 21987 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:34.661320 22122 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.665553 22069 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:34.672132 22122 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.682451 22067 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.683223 22067 ts_tablet_manager.cc:1403] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.052s	user 0.026s	sys 0.015s
I20260709 13:05:34.687018 22067 raft_consensus.cc:359] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.688041 22067 raft_consensus.cc:385] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.688444 22067 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.689556 22067 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.692373 22067 ts_tablet_manager.cc:1434] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:34.693822 22067 tablet_bootstrap.cc:492] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.697337 22115 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.705420 22115 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.705928 22098 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.707545 22115 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.699892 22126 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.696787 22069 tablet_bootstrap.cc:654] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.709007 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:34.710903 22126 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.711297 21872 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:34.712739 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:34.713106 22126 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.709558 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:34.714141 22022 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:34.715299 22098 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:34.715790 22098 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.715710 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:34.718753 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:34.720942 21838 leader_election.cc:343] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:34.721866 21841 leader_election.cc:343] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.722424 21841 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:34.723246 22126 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.716379 22098 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.731658 22067 tablet_bootstrap.cc:654] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.735762 22098 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.738916 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:34.739516 21872 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.751538 21872 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:34.754900 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:34.766675 22023 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:34.767436 22067 tablet_bootstrap.cc:492] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.767958 22067 ts_tablet_manager.cc:1403] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.008s
I20260709 13:05:34.770661 22067 raft_consensus.cc:359] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.771319 22067 raft_consensus.cc:385] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.764000 22071 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:34.771698 22067 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.772008 22071 ts_tablet_manager.cc:1403] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.157s	user 0.021s	sys 0.023s
I20260709 13:05:34.759506 22137 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.772506 22067 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.774907 22071 raft_consensus.cc:359] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.766057 22098 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.775658 22071 raft_consensus.cc:385] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.775396 22023 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:34.776001 22071 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.777446 21916 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:34.777565 22071 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.778795 22098 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:34.779769 22098 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:34.781138 22098 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.782178 22067 ts_tablet_manager.cc:1434] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:05:34.784363 22067 tablet_bootstrap.cc:492] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.771335 22069 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:34.788728 22071 ts_tablet_manager.cc:1434] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:05:34.789011 22069 ts_tablet_manager.cc:1403] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.124s	user 0.004s	sys 0.027s
I20260709 13:05:34.792465 22069 raft_consensus.cc:359] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.795652 22069 raft_consensus.cc:385] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.795948 22069 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.797130 22137 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.797719 22069 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.798913 22071 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:34.800532 22069 ts_tablet_manager.cc:1434] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:05:34.801430 22069 tablet_bootstrap.cc:492] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:34.807612 22071 tablet_bootstrap.cc:654] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.811365 22067 tablet_bootstrap.cc:654] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.818729 22069 tablet_bootstrap.cc:654] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.827126 22067 tablet_bootstrap.cc:492] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.827605 22122 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:34.827418 21773 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.827591 22067 ts_tablet_manager.cc:1403] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 13:05:34.840049 22067 raft_consensus.cc:359] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.840792 22067 raft_consensus.cc:385] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.841063 22067 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.843389 22067 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.845446 22104 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.846750 22067 ts_tablet_manager.cc:1434] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:05:34.847675 22067 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.861828 22067 tablet_bootstrap.cc:654] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.865399 22098 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.866559 22069 tablet_bootstrap.cc:492] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:34.867174 22069 ts_tablet_manager.cc:1403] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.001s
I20260709 13:05:34.866258 22098 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.868053 22126 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.868832 22126 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.870909 22126 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.870810 22069 raft_consensus.cc:359] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.871510 22069 raft_consensus.cc:385] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.871804 22069 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.872416 22069 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.873499 22098 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.875262 22069 ts_tablet_manager.cc:1434] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:34.876333 22069 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:34.877177 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:34.873535 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:34.886325 21916 leader_election.cc:343] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.888028 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:05:34.890033 21914 leader_election.cc:343] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.890482 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:34.884526 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:34.892508 22098 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.893031 22098 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:34.893572 21841 leader_election.cc:343] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.895254 22098 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:34.896119 22098 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:34.897514 21838 leader_election.cc:343] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.897567 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:34.898088 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:34.899305 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:34.899957 22126 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:34.900453 21916 leader_election.cc:343] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:34.903309 21914 leader_election.cc:343] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:34.904963 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:34.906368 22098 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:34.911707 22071 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:34.912238 22071 ts_tablet_manager.cc:1403] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.002s
I20260709 13:05:34.915060 22071 raft_consensus.cc:359] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.915858 22071 raft_consensus.cc:385] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.916149 22071 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.917695 22071 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.930682 22069 tablet_bootstrap.cc:654] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.932868 22071 ts_tablet_manager.cc:1434] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:05:34.933866 22071 tablet_bootstrap.cc:492] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:34.939079 22067 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.939694 22067 ts_tablet_manager.cc:1403] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.092s	user 0.007s	sys 0.011s
I20260709 13:05:34.942389 22067 raft_consensus.cc:359] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.943058 22067 raft_consensus.cc:385] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.943327 22067 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.944067 22067 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.944689 22098 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.946377 22067 ts_tablet_manager.cc:1434] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:34.947291 22071 tablet_bootstrap.cc:654] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.952363 22067 tablet_bootstrap.cc:492] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:34.958493 22067 tablet_bootstrap.cc:654] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:34.963451 22098 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:34.992966 22067 tablet_bootstrap.cc:492] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:34.993634 22067 ts_tablet_manager.cc:1403] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.005s
I20260709 13:05:34.997315 22067 raft_consensus.cc:359] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:34.997969 22067 raft_consensus.cc:385] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:34.998257 22067 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:34.998862 22067 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.001030 22067 ts_tablet_manager.cc:1434] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:05:35.001950 22067 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:35.002113 22098 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.004707 22069 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:35.005216 22069 ts_tablet_manager.cc:1403] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.129s	user 0.020s	sys 0.003s
I20260709 13:05:35.008091 22069 raft_consensus.cc:359] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.008441 22126 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.008677 22067 tablet_bootstrap.cc:654] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.008806 22069 raft_consensus.cc:385] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.009109 22069 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.009030 22126 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.009994 22071 tablet_bootstrap.cc:492] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.010442 22071 ts_tablet_manager.cc:1403] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.008s
I20260709 13:05:35.011345 22126 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.011888 22126 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.013079 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.014060 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:35.015062 21841 leader_election.cc:343] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:35.015694 21838 leader_election.cc:343] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.016167 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:35.017367 22070 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.012346 22126 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.018402 22071 raft_consensus.cc:359] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.019305 22071 raft_consensus.cc:385] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.020437 22069 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.019644 22071 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.021689 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.023348 22071 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.023952 22069 ts_tablet_manager.cc:1434] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
W20260709 13:05:35.023362 21838 leader_election.cc:343] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.025255 22067 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:35.025712 22067 ts_tablet_manager.cc:1403] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 13:05:35.025839 22071 ts_tablet_manager.cc:1434] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:35.028501 22067 raft_consensus.cc:359] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.029320 22071 tablet_bootstrap.cc:492] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:35.029337 22067 raft_consensus.cc:385] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.029748 22067 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.030349 22067 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.031096 22070 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.031587 22070 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.032294 22067 ts_tablet_manager.cc:1434] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:05:35.033394 22067 tablet_bootstrap.cc:492] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:35.034999 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.035669 22023 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:35.036273 22071 tablet_bootstrap.cc:654] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.037092 21841 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:35.037969 22125 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.038345 22125 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.038692 22125 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.039371 22067 tablet_bootstrap.cc:654] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.039738 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.040411 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:35.037982 22070 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.048977 22125 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.050559 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:35.052345 21841 leader_election.cc:343] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.028501 22069 tablet_bootstrap.cc:492] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:35.052933 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:35.054190 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:35.054886 21947 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.060789 22070 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.061710 22126 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.064175 22098 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:35.067636 22125 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.071242 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:35.072214 22023 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.071640 22069 tablet_bootstrap.cc:654] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.081442 22067 tablet_bootstrap.cc:492] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:35.082046 22067 ts_tablet_manager.cc:1403] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.022s
I20260709 13:05:35.084434 22069 tablet_bootstrap.cc:492] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:35.084913 22067 raft_consensus.cc:359] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.085626 22067 raft_consensus.cc:385] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.085902 22067 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.086755 22071 tablet_bootstrap.cc:492] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.087298 22071 ts_tablet_manager.cc:1403] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.004s
I20260709 13:05:35.086822 22067 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.087859 22125 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.088296 22125 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.089007 22067 ts_tablet_manager.cc:1434] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:35.089910 22067 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:35.090349 22125 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.092815 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.093540 21949 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:35.094573 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.095908 22067 tablet_bootstrap.cc:654] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.096266 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:05:35.097697 21841 leader_election.cc:343] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.098701 22125 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.099169 22125 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.099591 22125 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.084932 22069 ts_tablet_manager.cc:1403] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.007s
I20260709 13:05:35.106312 22023 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:35.110673 21841 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:35.108382 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:35.111681 22126 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.114420 22126 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:35.124393 22069 raft_consensus.cc:359] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.125260 22069 raft_consensus.cc:385] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.125618 22069 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.130738 22023 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.130872 22071 raft_consensus.cc:359] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.131660 22071 raft_consensus.cc:385] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.131944 22071 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.129211 22070 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:35.121006 22126 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.137934 22067 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:35.137622 22125 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.142886 22069 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.145171 22069 ts_tablet_manager.cc:1434] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:05:35.145247 22125 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.146142 22069 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:35.145954 22125 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.148330 22071 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.150061 22067 ts_tablet_manager.cc:1403] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.010s
I20260709 13:05:35.153079 22067 raft_consensus.cc:359] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.153784 22067 raft_consensus.cc:385] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.154050 22067 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.154352 22071 ts_tablet_manager.cc:1434] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.003s
I20260709 13:05:35.155288 22071 tablet_bootstrap.cc:492] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:35.154755 22067 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.157644 22067 ts_tablet_manager.cc:1434] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:35.159067 22067 tablet_bootstrap.cc:492] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:35.162379 22124 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.162902 22124 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.165319 22124 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.173977 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.171751 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:35.174809 21947 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.174711 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:05:35.182018 21916 leader_election.cc:343] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:35.190945 21841 leader_election.cc:343] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.192519 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:35.193202 21872 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:35.194998 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:35.195789 22124 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.196162 22124 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.196493 22124 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.200573 22071 tablet_bootstrap.cc:654] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.200698 22069 tablet_bootstrap.cc:654] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.197433 21947 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:35.208458 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:35.210227 22125 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.210732 22125 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:35.211548 22125 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.211975 22124 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.221004 22188 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.221526 22188 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.225955 22188 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.226310 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:35.226958 21875 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.227488 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.228111 21949 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:35.231482 22067 tablet_bootstrap.cc:654] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.231340 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.229360 21838 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:05:35.233479 21841 leader_election.cc:343] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.235651 21875 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:35.236868 22125 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.237375 22125 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.238000 22125 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.241371 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:35.242172 22075 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.242684 22075 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:35.243583 22075 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.244369 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:05:35.246001 21916 leader_election.cc:343] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.250419 22124 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.259188 22067 tablet_bootstrap.cc:492] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:35.259891 22067 ts_tablet_manager.cc:1403] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.008s
I20260709 13:05:35.261286 22188 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.262872 22188 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.265066 22188 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.266254 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.270016 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.274389 22122 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.274554 21841 leader_election.cc:343] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.274947 22122 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.277712 21949 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:35.277068 22122 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:35.276682 22125 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.280799 22071 tablet_bootstrap.cc:492] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.281280 22071 ts_tablet_manager.cc:1403] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.002s
I20260709 13:05:35.281524 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.281836 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:35.282639 21875 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
W20260709 13:05:35.283004 21987 leader_election.cc:343] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.283987 22071 raft_consensus.cc:359] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.409778 22071 raft_consensus.cc:385] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.410075 22071 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
W20260709 13:05:35.342340 22192 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:05:35.410746 21771 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.310335 22188 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.293743 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:35.408535 22125 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.285064 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:35.412209 22126 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.413160 22188 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.412204 22071 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.418092 22069 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:35.418742 22069 ts_tablet_manager.cc:1403] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.273s	user 0.018s	sys 0.016s
I20260709 13:05:35.283921 21838 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:35.395031 22075 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:05:35.420462 22067 raft_consensus.cc:359] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.421917 22067 raft_consensus.cc:385] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.423063 22067 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.424650 22071 ts_tablet_manager.cc:1434] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.143s	user 0.007s	sys 0.000s
I20260709 13:05:35.426628 22071 tablet_bootstrap.cc:492] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:35.421252 22137 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.425148 22125 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.416512 22126 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.434495 22067 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.438603 22067 ts_tablet_manager.cc:1434] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.178s	user 0.005s	sys 0.002s
I20260709 13:05:35.439607 22067 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
W20260709 13:05:35.423703 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 138720us
I20260709 13:05:35.430481 22137 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.441246 22137 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.447642 22098 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:35.430680 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 149747us
I20260709 13:05:35.434465 22125 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.297930 21770 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.459859 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:35.458272 22125 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.457060 22188 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.467964 22069 raft_consensus.cc:359] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.468492 22069 raft_consensus.cc:385] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.468858 22069 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.468900 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.469342 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:35.469856 21949 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:35.470594 21841 leader_election.cc:343] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.471509 22126 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.469866 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:35.473691 21841 leader_election.cc:343] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.472702 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.469537 22069 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:35.475330 21841 leader_election.cc:343] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.475895 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.477176 21948 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:35.475893 21947 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:35.479229 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:35.480381 22126 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.480779 22126 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.481092 22126 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.481644 22122 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.482161 22122 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.482673 22069 ts_tablet_manager.cc:1434] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 13:05:35.483680 22069 tablet_bootstrap.cc:492] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:35.484194 22122 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:35.509423 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:35.514010 22188 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.514420 22188 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.514813 22188 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.518960 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:35.519675 21874 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:35.535986 22126 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.538419 22126 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.541610 22071 tablet_bootstrap.cc:654] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.556094 22188 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.559886 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:35.560515 21947 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.567641 22067 tablet_bootstrap.cc:654] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.567730 21947 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:35.564253 21949 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:35.570945 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:35.571832 22126 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.571684 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:35.572420 22126 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:35.573251 22199 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:35.573356 22126 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.563926 22125 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.573873 22199 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.577013 22199 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.577113 22125 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.556095 22137 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.577525 22188 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.584934 22137 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:35.587406 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.592175 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:35.592356 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:35.593456 21948 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.595086 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:35.595675 21838 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:35.597947 22126 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.598469 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:35.600951 21950 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.602388 22199 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.603421 21948 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:35.596581 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:05:35.604997 21841 leader_election.cc:343] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.606356 22071 tablet_bootstrap.cc:492] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.606858 22071 ts_tablet_manager.cc:1403] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.180s	user 0.019s	sys 0.003s
I20260709 13:05:35.607534 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:35.606487 22199 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:05:35.609470 21987 leader_election.cc:343] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.609736 22188 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.592770 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:35.611656 21838 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:35.612687 22125 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:35.612875 21987 leader_election.cc:343] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.613216 22125 raft_consensus.cc:697] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:05:35.613901 21987 leader_election.cc:343] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.614044 22125 consensus_queue.cc:237] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.612203 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:35.616097 21874 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.617223 21950 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
W20260709 13:05:35.618775 21841 leader_election.cc:343] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:35.619849 21841 leader_election.cc:343] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.608220 22126 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:35.620702 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:35.621521 22189 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.622010 22189 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:35.621604 22126 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.622779 22189 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.625494 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:35.626052 21872 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.626650 22069 tablet_bootstrap.cc:654] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.637609 22071 raft_consensus.cc:359] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.638995 22071 raft_consensus.cc:385] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.639520 22071 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
W20260709 13:05:35.649641 21841 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:35.650185 22188 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:35.643478 22071 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.658314 22071 ts_tablet_manager.cc:1434] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:05:35.659056 22071 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:35.661046 21872 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:35.666574 22067 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:35.667557 22067 ts_tablet_manager.cc:1403] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.228s	user 0.012s	sys 0.003s
I20260709 13:05:35.669071 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:35.670652 22199 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.671150 22199 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:35.674911 21874 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:35.676101 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:35.676568 22069 tablet_bootstrap.cc:492] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:35.677165 22069 ts_tablet_manager.cc:1403] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.002s
I20260709 13:05:35.673324 22199 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.677177 22137 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:35.678404 22137 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:35.682515 22071 tablet_bootstrap.cc:654] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.684540 22069 raft_consensus.cc:359] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.694147 22022 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.694420 22069 raft_consensus.cc:385] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.694703 22069 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.695389 22069 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.693670 22067 raft_consensus.cc:359] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.696916 22067 raft_consensus.cc:385] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.697242 22067 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.690383 21770 catalog_manager.cc:5697] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:05:35.698966 22137 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.701777 22069 ts_tablet_manager.cc:1434] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:05:35.702916 22069 tablet_bootstrap.cc:492] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:35.702164 22067 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.718900 22067 ts_tablet_manager.cc:1434] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.001s
I20260709 13:05:35.722994 22067 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:35.737803 22071 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.738034 22067 tablet_bootstrap.cc:654] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.738386 22071 ts_tablet_manager.cc:1403] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.012s
I20260709 13:05:35.741180 22188 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.742983 22188 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.743336 21773 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.745049 22188 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.746721 22098 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.747694 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:35.749629 21841 leader_election.cc:343] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.745082 21773 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.751658 21773 catalog_manager.cc:5697] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.753294 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.753139 21773 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.756956 22071 raft_consensus.cc:359] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.757758 22071 raft_consensus.cc:385] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.758090 22071 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.760908 22071 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.762095 22098 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:35.763546 22069 tablet_bootstrap.cc:654] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.764530 22071 ts_tablet_manager.cc:1434] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:05:35.767163 22071 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
W20260709 13:05:35.768069 21838 leader_election.cc:343] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.770171 21838 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:35.768626 22188 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:35.773102 22137 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.773732 22137 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.776892 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:35.777383 22188 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.783906 22137 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:35.785003 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.785828 21947 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 1: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:05:35.787776 21987 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:35.789146 22137 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.800319 22071 tablet_bootstrap.cc:654] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.802762 22188 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.803289 22188 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.806526 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:35.807737 21841 leader_election.cc:343] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.810917 22188 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.815452 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:35.818478 21838 leader_election.cc:343] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.818897 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:35.819561 22189 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.827338 22067 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:35.827338 22137 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.829831 22069 tablet_bootstrap.cc:492] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:35.830740 22069 ts_tablet_manager.cc:1403] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.018s
I20260709 13:05:35.833355 22069 raft_consensus.cc:359] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.834086 22069 raft_consensus.cc:385] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.834369 22069 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.835237 22067 ts_tablet_manager.cc:1403] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.023s
I20260709 13:05:35.838120 22067 raft_consensus.cc:359] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.839445 21770 catalog_manager.cc:5697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.838862 22067 raft_consensus.cc:385] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.841410 21770 catalog_manager.cc:5697] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.841519 22067 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.843780 22071 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.846941 22071 ts_tablet_manager.cc:1403] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.003s
I20260709 13:05:35.841789 22069 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.849623 22071 raft_consensus.cc:359] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.850337 22071 raft_consensus.cc:385] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.850658 22071 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.850785 22067 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.851433 22071 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.852337 22067 ts_tablet_manager.cc:1434] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:05:35.853264 22067 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:35.853426 22071 ts_tablet_manager.cc:1434] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:35.854347 22071 tablet_bootstrap.cc:492] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:35.859833 22067 tablet_bootstrap.cc:654] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.850287 22069 ts_tablet_manager.cc:1434] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:05:35.862526 22069 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:35.863497 22071 tablet_bootstrap.cc:654] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.879081 22071 tablet_bootstrap.cc:492] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.879642 22071 ts_tablet_manager.cc:1403] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:05:35.882756 22071 raft_consensus.cc:359] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.883412 22071 raft_consensus.cc:385] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.883699 22071 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.884332 22071 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.886641 22071 ts_tablet_manager.cc:1434] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:35.887550 22071 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:35.892976 22199 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.893191 22071 tablet_bootstrap.cc:654] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.893486 22199 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.895768 22199 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:35.897969 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:35.901511 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.903340 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:35.904688 22137 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.905046 22069 tablet_bootstrap.cc:654] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.907174 22071 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.907668 22071 ts_tablet_manager.cc:1403] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:05:35.910465 22071 raft_consensus.cc:359] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.911181 22071 raft_consensus.cc:385] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.911458 22071 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.912106 22071 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.914459 22071 ts_tablet_manager.cc:1434] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:35.914603 22067 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:35.915081 22067 ts_tablet_manager.cc:1403] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.019s
I20260709 13:05:35.915410 22071 tablet_bootstrap.cc:492] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:35.917733 22067 raft_consensus.cc:359] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.918401 22067 raft_consensus.cc:385] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.918669 22067 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.919297 22067 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.921324 22071 tablet_bootstrap.cc:654] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.921464 22069 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:35.921921 22069 ts_tablet_manager.cc:1403] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.004s
I20260709 13:05:35.924988 22069 raft_consensus.cc:359] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.925683 22069 raft_consensus.cc:385] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.925941 22069 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.927842 22069 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.929736 22067 ts_tablet_manager.cc:1434] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:05:35.933736 22124 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.934201 22124 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.936218 22124 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.937872 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:35.938680 21874 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 1: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:05:35.939495 22067 tablet_bootstrap.cc:492] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:35.940963 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.942502 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:35.943608 22124 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.947150 22069 ts_tablet_manager.cc:1434] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:05:35.950342 22124 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.950814 22137 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.951445 22137 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.956657 22067 tablet_bootstrap.cc:654] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.956410 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:35.957278 21949 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 1: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:05:35.957206 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:35.958933 22137 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:35.959443 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:35.959714 22188 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.960230 22188 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.961076 22137 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.962407 22071 tablet_bootstrap.cc:492] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:35.962944 22071 ts_tablet_manager.cc:1403] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.048s	user 0.028s	sys 0.016s
I20260709 13:05:35.964325 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:35.965751 21838 leader_election.cc:343] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.965888 22071 raft_consensus.cc:359] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:35.962335 22188 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:35.966576 22071 raft_consensus.cc:385] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:35.966873 22071 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.967250 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:35.967555 22071 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:35.968855 21841 leader_election.cc:343] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:35.969468 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:35.971289 22188 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.973445 22071 ts_tablet_manager.cc:1434] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:35.974416 22071 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:35.959851 22069 tablet_bootstrap.cc:492] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:35.983067 22069 tablet_bootstrap.cc:654] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.991222 22071 tablet_bootstrap.cc:654] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:35.993440 22023 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:35.994899 22137 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:35.997786 22188 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.006201 22067 tablet_bootstrap.cc:492] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:36.006978 22067 ts_tablet_manager.cc:1403] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.004s
I20260709 13:05:36.012533 22188 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.012588 22067 raft_consensus.cc:359] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.013495 22067 raft_consensus.cc:385] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.013798 22067 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.014501 22067 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.016997 22071 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:36.017855 22071 ts_tablet_manager.cc:1403] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.002s
I20260709 13:05:36.018784 22067 ts_tablet_manager.cc:1434] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:05:36.016997 22069 tablet_bootstrap.cc:492] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:36.019548 22069 ts_tablet_manager.cc:1403] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.007s
I20260709 13:05:36.020891 22071 raft_consensus.cc:359] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.021622 22071 raft_consensus.cc:385] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.021955 22071 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.022229 22069 raft_consensus.cc:359] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.022931 22069 raft_consensus.cc:385] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.023211 22069 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.022696 22071 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.024521 22067 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:36.027910 22071 ts_tablet_manager.cc:1434] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:05:36.027514 22069 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.044292 22069 ts_tablet_manager.cc:1434] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.004s
I20260709 13:05:36.045281 22069 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:36.033761 22199 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.034641 22067 tablet_bootstrap.cc:654] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.049474 22199 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.053453 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:36.054152 21949 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:36.054224 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:36.054873 21874 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:36.055815 22069 tablet_bootstrap.cc:654] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.028956 22071 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:36.036876 22022 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.055824 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.064281 22199 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.064934 22199 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.065320 22199 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.065675 22199 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.080235 22137 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.081642 22137 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.086591 22137 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.089192 22067 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:36.089403 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:36.091490 22137 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.092001 22137 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.091228 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:36.092780 22189 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.093457 21947 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 1: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:05:36.093526 22199 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.099071 22137 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.089679 22067 ts_tablet_manager.cc:1403] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.013s
I20260709 13:05:36.103690 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:36.104429 21872 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:36.105448 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:36.105473 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:36.106276 21950 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:36.106597 21948 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.107534 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:36.108170 21874 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.109648 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.110718 22137 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.111112 22137 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.111490 22137 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.112632 22189 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.113608 21948 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:36.110948 21987 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:36.118611 22205 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.123713 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.136355 22067 raft_consensus.cc:359] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.137216 22067 raft_consensus.cc:385] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.137504 22067 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.147787 22069 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:36.147472 22067 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.148253 22069 ts_tablet_manager.cc:1403] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.018s
I20260709 13:05:36.127942 21874 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:36.132890 22205 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.155016 22137 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.157547 22067 ts_tablet_manager.cc:1434] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.055s	user 0.000s	sys 0.006s
I20260709 13:05:36.150441 22199 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.158591 22205 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.167587 22067 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:36.169178 22071 tablet_bootstrap.cc:654] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.172884 22189 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.173623 22240 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.173691 22189 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.165386 22205 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:36.176011 22189 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.175925 22205 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.180840 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:36.182683 21838 leader_election.cc:343] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.183286 22137 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.183759 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:36.184520 21948 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.204744 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:36.205441 21875 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.221699 22124 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.236949 22124 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.255836 22124 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.273774 22069 raft_consensus.cc:359] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.279417 22069 raft_consensus.cc:385] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.282541 21949 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.289104 21875 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:36.296713 21948 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:36.279770 22069 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.298719 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.302424 22069 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.303120 22126 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.304303 22067 tablet_bootstrap.cc:654] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.306777 21770 catalog_manager.cc:5697] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.308416 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:36.310473 22071 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:36.310935 22071 ts_tablet_manager.cc:1403] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.282s	user 0.016s	sys 0.014s
I20260709 13:05:36.312494 22069 ts_tablet_manager.cc:1434] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.164s	user 0.009s	sys 0.001s
I20260709 13:05:36.313503 22069 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:36.313822 22241 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.311661 22242 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.314396 22241 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:36.317742 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:36.317736 22188 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.318688 21875 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 1: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:05:36.316506 22241 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.319950 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:36.321527 22205 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.323304 22115 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.320106 22069 tablet_bootstrap.cc:654] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.330305 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:36.335578 22071 raft_consensus.cc:359] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.342734 22071 raft_consensus.cc:385] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.344161 22071 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.344913 22071 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.357266 22205 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.366266 22071 ts_tablet_manager.cc:1434] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:05:36.367877 22071 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:36.370288 21770 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:36.377635 21841 leader_election.cc:343] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.378149 21841 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:36.382150 22126 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.388742 22125 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.389609 22188 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.395565 22071 tablet_bootstrap.cc:654] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.421504 22067 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:36.422165 22067 ts_tablet_manager.cc:1403] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.255s	user 0.010s	sys 0.018s
I20260709 13:05:36.453248 22069 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:36.453984 22069 ts_tablet_manager.cc:1403] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.021s
I20260709 13:05:36.458931 22071 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:36.459426 22071 ts_tablet_manager.cc:1403] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.008s
I20260709 13:05:36.461532 22115 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.463713 22115 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.465817 22071 raft_consensus.cc:359] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.466881 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:36.466527 22071 raft_consensus.cc:385] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.467208 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:36.467531 22071 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.466915 22125 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.467953 22024 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:36.468690 22125 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.468627 22071 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.469619 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.470503 22124 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.470875 22125 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.467573 21874 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:36.471962 22115 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.472846 22071 ts_tablet_manager.cc:1434] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:05:36.473839 22071 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:36.470875 22124 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.474956 22124 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.475235 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:36.477223 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:36.477509 21841 leader_election.cc:343] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:36.487363 21838 leader_election.cc:343] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.488143 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:36.489614 22067 raft_consensus.cc:359] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.490163 22067 raft_consensus.cc:385] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.490415 22067 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.489017 22125 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.492439 22067 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.494535 22067 ts_tablet_manager.cc:1434] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 13:05:36.495502 22067 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:36.500504 22125 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.501083 22125 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.502882 22069 raft_consensus.cc:359] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.506246 22069 raft_consensus.cc:385] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.514835 22125 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.506736 22069 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.506796 22124 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.517042 22069 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.521734 22069 ts_tablet_manager.cc:1434] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.006s
I20260709 13:05:36.522791 22069 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:36.526193 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:36.527936 21838 leader_election.cc:343] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.532155 22124 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.534368 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:36.522471 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:36.535025 22021 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:36.539462 21841 leader_election.cc:343] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.540011 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:36.543483 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:36.544148 21875 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.549404 22126 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.550607 22240 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.551138 22240 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.556170 22067 tablet_bootstrap.cc:654] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.556953 22021 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:36.558529 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.559762 22071 tablet_bootstrap.cc:654] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:36.565061 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:36.563386 22115 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.566169 22115 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:36.567018 22115 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.584401 22240 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.586830 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:36.587656 21874 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:36.588627 22069 tablet_bootstrap.cc:654] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.589130 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:36.593428 21947 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:36.595553 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.601243 21875 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:36.603116 21770 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.601693 22240 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.610934 22240 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.611321 22240 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.615151 22067 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:36.618223 22067 ts_tablet_manager.cc:1403] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.010s
I20260709 13:05:36.621654 22067 raft_consensus.cc:359] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.622392 22067 raft_consensus.cc:385] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.622664 22067 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.623459 22067 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.625862 22067 ts_tablet_manager.cc:1434] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:36.627586 22067 tablet_bootstrap.cc:492] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:36.630012 22071 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:36.630503 22071 ts_tablet_manager.cc:1403] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.157s	user 0.002s	sys 0.013s
I20260709 13:05:36.635679 22071 raft_consensus.cc:359] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.636338 22071 raft_consensus.cc:385] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.636621 22071 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.637259 22071 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.639487 22071 ts_tablet_manager.cc:1434] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:05:36.640758 22071 tablet_bootstrap.cc:492] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:36.642086 22067 tablet_bootstrap.cc:654] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.644258 22069 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:36.656212 22242 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.656234 22069 ts_tablet_manager.cc:1403] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.134s	user 0.022s	sys 0.025s
I20260709 13:05:36.663187 22069 raft_consensus.cc:359] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.664328 22069 raft_consensus.cc:385] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.664829 22069 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.665774 22069 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.658437 22240 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.669697 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:36.670351 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:36.671177 21947 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.672991 22071 tablet_bootstrap.cc:654] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.670353 21874 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.680433 22238 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:36.691191 22069 ts_tablet_manager.cc:1434] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:05:36.693022 22069 tablet_bootstrap.cc:492] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:36.698434 22242 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.698989 22242 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.701277 22242 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.689471 22240 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.704439 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:36.705191 21872 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:36.705292 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:36.705984 21948 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:36.706846 21874 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:36.707641 21987 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.708571 22240 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.708962 22240 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.709314 22240 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.719549 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:36.718137 22188 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.720845 22238 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.720711 22188 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.721355 22238 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:36.722338 22238 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.722919 22188 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.724619 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:36.726101 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:36.726735 21841 leader_election.cc:343] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:36.727550 21838 leader_election.cc:343] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:36.714892 21947 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:36.727985 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:36.728703 22067 tablet_bootstrap.cc:492] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:36.729143 22067 ts_tablet_manager.cc:1403] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.102s	user 0.036s	sys 0.030s
I20260709 13:05:36.732019 22126 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:36.740389 22067 raft_consensus.cc:359] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.741637 22067 raft_consensus.cc:385] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.741978 22067 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.737916 22240 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.748565 22071 tablet_bootstrap.cc:492] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:36.749155 22071 ts_tablet_manager.cc:1403] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.004s
I20260709 13:05:36.750442 22240 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:36.752498 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:36.753414 21875 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.754715 22071 raft_consensus.cc:359] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.755683 22071 raft_consensus.cc:385] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.755801 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:36.756055 22071 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.756449 21949 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.757220 22071 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.764650 21949 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:36.768236 22067 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.770565 21987 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.771442 22238 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.772017 22238 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:36.772893 22238 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.773626 21875 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:36.776332 22069 tablet_bootstrap.cc:654] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.777168 22067 ts_tablet_manager.cc:1434] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.003s
I20260709 13:05:36.778898 22067 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:36.785271 22241 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.786147 22242 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.786640 22071 ts_tablet_manager.cc:1434] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:05:36.807534 22069 tablet_bootstrap.cc:492] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:36.821050 22069 ts_tablet_manager.cc:1403] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.003s
I20260709 13:05:36.823765 22069 raft_consensus.cc:359] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.824425 22069 raft_consensus.cc:385] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.824916 22069 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.825984 22069 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.828367 22069 ts_tablet_manager.cc:1434] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:36.829447 22069 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:36.831817 22071 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:36.832405 21771 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.840672 22067 tablet_bootstrap.cc:654] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.834371 21771 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.844050 22071 tablet_bootstrap.cc:654] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.844408 22069 tablet_bootstrap.cc:654] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.851531 22067 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:36.852049 22067 ts_tablet_manager.cc:1403] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.002s
I20260709 13:05:36.855060 22067 raft_consensus.cc:359] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.855727 22067 raft_consensus.cc:385] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.856019 22067 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.859442 22071 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:36.859946 22071 ts_tablet_manager.cc:1403] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 13:05:36.860916 22067 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.862541 22071 raft_consensus.cc:359] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.863075 22067 ts_tablet_manager.cc:1434] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.006s
I20260709 13:05:36.863245 22071 raft_consensus.cc:385] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.863524 22071 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.864043 22067 tablet_bootstrap.cc:492] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:36.864315 22071 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.866770 22071 ts_tablet_manager.cc:1434] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:36.867718 22071 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:36.870782 22067 tablet_bootstrap.cc:654] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.873879 22071 tablet_bootstrap.cc:654] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.877312 22069 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:36.879142 22069 ts_tablet_manager.cc:1403] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.007s
I20260709 13:05:36.883735 22069 raft_consensus.cc:359] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.885087 22069 raft_consensus.cc:385] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.885465 22069 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.886474 22069 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.889343 22069 ts_tablet_manager.cc:1434] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:36.898937 22069 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:36.907948 22069 tablet_bootstrap.cc:654] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.907948 22067 tablet_bootstrap.cc:492] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:36.909162 22067 ts_tablet_manager.cc:1403] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.028s
I20260709 13:05:36.914165 22115 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.914897 22115 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.918514 22115 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.920948 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:36.923243 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:36.927100 22021 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:36.924242 21875 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:36.928573 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:36.931198 22115 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:36.931581 22115 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.931900 22115 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.933509 22067 raft_consensus.cc:359] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.934267 22067 raft_consensus.cc:385] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.934527 22067 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.934595 22071 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:36.935670 22071 ts_tablet_manager.cc:1403] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.068s	user 0.028s	sys 0.022s
I20260709 13:05:36.935350 22067 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.950845 22069 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:36.950866 22067 ts_tablet_manager.cc:1434] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:05:36.951403 22069 ts_tablet_manager.cc:1403] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.002s
I20260709 13:05:36.951598 22071 raft_consensus.cc:359] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.952288 22071 raft_consensus.cc:385] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.952374 22067 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:36.952577 22071 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.953536 22071 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.954093 22069 raft_consensus.cc:359] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.954720 22069 raft_consensus.cc:385] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.954963 22069 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.955574 22069 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.946954 22115 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.959031 22067 tablet_bootstrap.cc:654] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:36.959465 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:36.960049 21875 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:36.963081 22069 ts_tablet_manager.cc:1434] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:36.964031 22069 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:36.965619 22071 ts_tablet_manager.cc:1434] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.005s
I20260709 13:05:36.966524 22071 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:36.973294 21875 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:36.974937 21914 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:36.975788 22098 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:36.976262 22098 raft_consensus.cc:697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:36.977106 22098 consensus_queue.cc:237] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.988999 22067 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:36.989502 22067 ts_tablet_manager.cc:1403] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.020s
I20260709 13:05:36.990334 22115 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:36.991887 22115 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:36.992141 22067 raft_consensus.cc:359] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.992864 22067 raft_consensus.cc:385] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:36.993156 22067 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:36.993934 22067 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:36.995712 22067 ts_tablet_manager.cc:1434] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:36.993250 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:36.999487 22021 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.013329 21771 catalog_manager.cc:5697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.018910 22067 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:37.025354 22021 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:37.026345 22069 tablet_bootstrap.cc:654] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.028717 22067 tablet_bootstrap.cc:654] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.033485 22071 tablet_bootstrap.cc:654] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.057054 22124 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:37.064265 22242 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.064826 22242 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.067102 22242 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:37.070676 22071 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:37.073393 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:37.073715 22126 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.074146 21949 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:37.074234 22126 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.077776 22126 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.079977 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:37.081359 21987 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:37.082324 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.082949 22241 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:37.083072 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:37.083407 22241 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:37.082486 21838 leader_election.cc:343] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.083994 22241 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:37.084072 21841 leader_election.cc:343] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.084591 21841 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:37.085963 22188 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:37.092903 21875 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:37.096931 22069 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:37.096931 22067 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:37.097453 22069 ts_tablet_manager.cc:1403] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.000s
I20260709 13:05:37.097698 22067 ts_tablet_manager.cc:1403] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.005s
I20260709 13:05:37.100080 22071 ts_tablet_manager.cc:1403] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.003s
I20260709 13:05:37.100419 22069 raft_consensus.cc:359] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.101138 22069 raft_consensus.cc:385] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.101431 22069 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.102236 22069 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.102623 22067 raft_consensus.cc:359] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.103397 22067 raft_consensus.cc:385] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.103845 22067 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.104810 22069 ts_tablet_manager.cc:1434] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:37.104658 22067 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.103340 22098 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.105487 22188 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.106038 22188 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.106006 22098 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.108171 22188 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.108400 22069 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:37.109763 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.110453 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:37.110984 21916 leader_election.cc:343] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:37.113210 21838 leader_election.cc:343] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.113790 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.108192 22098 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.123095 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:05:37.123472 21841 leader_election.cc:343] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.122134 22067 ts_tablet_manager.cc:1434] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:05:37.125298 22067 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:37.125218 22071 raft_consensus.cc:359] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.125998 22071 raft_consensus.cc:385] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.126282 22071 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.127048 22071 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.127754 21875 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:37.129415 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:37.128126 22098 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.132655 22126 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:37.132671 22098 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.134160 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:37.134903 22098 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.135421 22098 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:37.135757 22098 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.136085 22098 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.136626 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:37.137301 21872 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:37.138389 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:37.140380 22124 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:37.140957 22242 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.142215 22124 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.143268 22124 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.145296 22071 ts_tablet_manager.cc:1434] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 13:05:37.145735 22098 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.146286 22071 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:37.157588 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.158394 22021 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:37.158562 22126 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.158643 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:37.159281 21875 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.163811 22098 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.159225 22126 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.167239 22241 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.179066 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:37.180053 22021 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.182637 22242 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.193845 22067 tablet_bootstrap.cc:654] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.205029 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.199715 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:37.217777 21874 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.200456 22126 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.215088 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:37.215713 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:37.211306 22241 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:37.213426 22069 tablet_bootstrap.cc:654] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.222105 21948 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.226079 22021 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:37.223995 22124 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.228271 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:37.230407 22071 tablet_bootstrap.cc:654] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.223394 22126 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.233917 22126 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.232729 22067 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:37.236037 22067 ts_tablet_manager.cc:1403] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.013s
I20260709 13:05:37.235831 22286 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:37.237972 22286 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:37.240012 22126 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.239940 22286 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.238480 22124 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.235512 21948 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:37.298437 21987 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:37.299284 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:37.300910 22024 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.334004 22242 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:37.334858 22242 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:37.336109 22242 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.363059 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:37.474385 22188 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.365159 22125 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.412225 21874 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
W20260709 13:05:37.359529 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 61560.3us
I20260709 13:05:37.497682 22125 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.498710 21875 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
W20260709 13:05:37.500952 21838 leader_election.cc:343] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.501340 22188 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.503931 22188 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.504791 22125 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.515818 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.514564 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:37.518088 21875 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.500579 22067 raft_consensus.cc:359] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.523526 22067 raft_consensus.cc:385] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.524695 22071 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:37.525543 22071 ts_tablet_manager.cc:1403] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.379s	user 0.034s	sys 0.040s
I20260709 13:05:37.527465 22124 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:37.531320 21841 leader_election.cc:343] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.531930 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:37.533416 22071 raft_consensus.cc:359] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.533967 22071 raft_consensus.cc:385] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.534209 22071 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.534849 22071 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.523922 22067 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.537377 22067 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.540055 22125 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:37.541059 21841 leader_election.cc:343] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.541821 22071 ts_tablet_manager.cc:1434] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:05:37.411630 22205 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.131s
I20260709 13:05:37.542296 22067 ts_tablet_manager.cc:1434] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.306s	user 0.007s	sys 0.003s
I20260709 13:05:37.543344 22071 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:37.543824 22067 tablet_bootstrap.cc:492] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:37.545677 22024 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
W20260709 13:05:37.547236 21838 leader_election.cc:343] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.565995 21916 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:37.567171 22124 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:37.567832 22124 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:37.554488 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:37.573076 22124 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.589845 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.591837 22022 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:37.595459 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:37.589892 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44051.5us
I20260709 13:05:37.607517 22098 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.614384 21770 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.616916 22296 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:37.662496 22069 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:37.663183 22069 ts_tablet_manager.cc:1403] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.557s	user 0.027s	sys 0.022s
I20260709 13:05:37.671996 21841 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:37.673661 22295 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:37.674115 22295 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.674520 22295 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:37.677079 21841 leader_election.cc:343] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.666819 21875 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:37.688627 22242 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.690675 22069 raft_consensus.cc:359] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.691409 22069 raft_consensus.cc:385] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.691708 22069 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.694145 21773 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.694674 22067 tablet_bootstrap.cc:654] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.692370 22069 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.697263 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:37.700014 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:37.707558 22295 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:37.718613 21838 leader_election.cc:343] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.709606 22071 tablet_bootstrap.cc:654] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:37.710784 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:37.712700 22069 ts_tablet_manager.cc:1434] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:05:37.720000 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:37.725528 22125 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:37.726120 21838 leader_election.cc:343] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.729501 22069 tablet_bootstrap.cc:492] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:37.740556 22295 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.742668 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:37.766430 22024 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:37.773694 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:37.778448 22067 tablet_bootstrap.cc:492] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:37.778982 22067 ts_tablet_manager.cc:1403] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.010s
I20260709 13:05:37.785593 22067 raft_consensus.cc:359] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.786667 22067 raft_consensus.cc:385] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.786968 22067 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.787593 22067 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.790724 22067 ts_tablet_manager.cc:1434] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:37.791731 22067 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
W20260709 13:05:37.792011 21838 leader_election.cc:343] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.795756 21770 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.802656 22067 tablet_bootstrap.cc:654] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.805689 22125 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.802490 22024 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:37.806206 22125 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.807729 21841 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:37.808590 22295 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:37.809190 22295 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:37.810586 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.810842 22069 tablet_bootstrap.cc:654] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.810333 22295 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:37.811997 21841 leader_election.cc:343] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.808367 22125 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.814711 22071 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:37.815174 22071 ts_tablet_manager.cc:1403] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.272s	user 0.018s	sys 0.013s
I20260709 13:05:37.818813 22071 raft_consensus.cc:359] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.819753 22071 raft_consensus.cc:385] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.820109 22071 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.822109 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:37.823752 21838 leader_election.cc:343] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:37.828326 21838 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:37.829218 22125 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:37.833038 22067 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:37.833582 22067 ts_tablet_manager.cc:1403] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 13:05:37.836299 22067 raft_consensus.cc:359] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.837008 22067 raft_consensus.cc:385] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.837301 22067 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.838156 22067 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.841404 22067 ts_tablet_manager.cc:1434] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:37.842613 22067 tablet_bootstrap.cc:492] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:37.847155 22071 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.848902 22067 tablet_bootstrap.cc:654] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.849490 22071 ts_tablet_manager.cc:1434] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:05:37.850648 22071 tablet_bootstrap.cc:492] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:37.852269 22205 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.855955 22069 tablet_bootstrap.cc:492] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:37.856467 22069 ts_tablet_manager.cc:1403] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.001s
I20260709 13:05:37.859481 22069 raft_consensus.cc:359] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.860173 22069 raft_consensus.cc:385] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.860427 22069 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.861181 22069 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.862010 22071 tablet_bootstrap.cc:654] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.869499 22067 tablet_bootstrap.cc:492] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:37.870817 22067 ts_tablet_manager.cc:1403] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.010s
I20260709 13:05:37.871212 21771 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.873711 22067 raft_consensus.cc:359] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.874434 22067 raft_consensus.cc:385] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.874702 22067 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.875353 22067 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.881632 22067 ts_tablet_manager.cc:1434] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:37.885327 22301 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.886492 22069 ts_tablet_manager.cc:1434] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:05:37.887598 22069 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:37.889109 22067 tablet_bootstrap.cc:492] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:37.909446 22301 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.914476 22241 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:37.935148 22069 tablet_bootstrap.cc:654] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.938874 22071 tablet_bootstrap.cc:492] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:37.939522 22071 ts_tablet_manager.cc:1403] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.000s
I20260709 13:05:37.946170 22071 raft_consensus.cc:359] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.947572 22071 raft_consensus.cc:385] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:37.947989 22071 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:37.948949 22071 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.952533 22071 ts_tablet_manager.cc:1434] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:05:37.954218 22071 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:37.955539 22301 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.956101 22301 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:37.958410 22301 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:37.959702 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:37.960413 22024 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:37.961525 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:37.962591 22071 tablet_bootstrap.cc:654] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.962185 21872 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:37.968217 22067 tablet_bootstrap.cc:654] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:37.962160 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:37.971374 22301 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:37.971894 22301 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.972404 22301 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.013180 22124 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:38.004272 22295 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.018878 22295 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.028527 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:38.031286 21838 leader_election.cc:343] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.031978 22124 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.032089 22295 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.032521 22124 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.029735 22301 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.033778 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:38.035055 22071 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:38.035594 22071 ts_tablet_manager.cc:1403] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.046s
I20260709 13:05:38.035532 22301 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.037030 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:38.036950 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:38.037663 22021 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.038105 21875 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:38.038702 22071 raft_consensus.cc:359] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.039803 22071 raft_consensus.cc:385] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.040100 22071 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.040997 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:38.040858 22071 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.041662 22024 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:38.042068 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:38.042800 22301 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.043040 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:38.043239 22301 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.043406 22071 ts_tablet_manager.cc:1434] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:05:38.041689 21841 leader_election.cc:343] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.043843 22301 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.044557 22071 tablet_bootstrap.cc:492] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:38.044447 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:38.045869 22295 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.043649 21875 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.047144 22124 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.049610 22021 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:38.050834 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:38.051999 22286 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.052461 22286 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:38.053293 22286 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.058122 21875 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:38.071238 22069 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:38.071929 22069 ts_tablet_manager.cc:1403] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.185s	user 0.008s	sys 0.005s
I20260709 13:05:38.078435 22067 tablet_bootstrap.cc:492] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:38.078979 22067 ts_tablet_manager.cc:1403] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.190s	user 0.033s	sys 0.005s
I20260709 13:05:38.081161 22069 raft_consensus.cc:359] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.081682 22067 raft_consensus.cc:359] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.082166 22069 raft_consensus.cc:385] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.082376 22067 raft_consensus.cc:385] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.082525 22069 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.082747 22067 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.083534 22067 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.088733 22301 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.092440 22301 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.093616 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:38.095288 22071 tablet_bootstrap.cc:654] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.096114 22022 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.101248 21773 catalog_manager.cc:5697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.110827 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:38.121001 21873 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.111624 22069 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.123625 22301 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.123982 22069 ts_tablet_manager.cc:1434] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.005s
I20260709 13:05:38.125008 22067 ts_tablet_manager.cc:1434] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.006s
I20260709 13:05:38.126163 22067 tablet_bootstrap.cc:492] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:38.130650 22069 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:38.138872 22069 tablet_bootstrap.cc:654] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.154829 22067 tablet_bootstrap.cc:654] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.163563 22069 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:38.164110 22069 ts_tablet_manager.cc:1403] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.006s
I20260709 13:05:38.166819 22069 raft_consensus.cc:359] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.167495 22069 raft_consensus.cc:385] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.167779 22069 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.168751 22069 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.169310 21873 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:38.170634 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:38.171343 22301 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.171816 22301 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:38.169807 22071 tablet_bootstrap.cc:492] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:38.172523 22071 ts_tablet_manager.cc:1403] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.128s	user 0.031s	sys 0.014s
I20260709 13:05:38.172650 22301 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.175222 22071 raft_consensus.cc:359] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.175768 22071 raft_consensus.cc:385] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.176021 22071 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.177448 22069 ts_tablet_manager.cc:1434] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:05:38.181685 22295 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.182559 22069 tablet_bootstrap.cc:492] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:38.182180 22295 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.185788 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:38.187270 21841 leader_election.cc:343] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.185178 22295 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.188212 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:38.184991 22071 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:38.189754 21838 leader_election.cc:343] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.190203 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:38.190894 22071 ts_tablet_manager.cc:1434] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:05:38.191506 22295 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.191931 22071 tablet_bootstrap.cc:492] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:38.194959 22067 tablet_bootstrap.cc:492] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:38.195335 22205 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.195418 22067 ts_tablet_manager.cc:1403] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:05:38.195896 22205 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.198261 22205 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:38.199188 22067 raft_consensus.cc:359] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.199934 22067 raft_consensus.cc:385] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.200817 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:38.201474 21947 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:38.202409 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:38.202659 21987 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:38.203425 22295 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.203516 22205 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.204012 22205 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.200284 22067 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.203981 22295 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.203065 21873 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:38.204540 22205 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.205386 22067 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.207500 22295 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.208093 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:38.208954 22069 tablet_bootstrap.cc:654] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:38.209599 21841 leader_election.cc:343] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.207180 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:38.210244 22022 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
W20260709 13:05:38.211406 21838 leader_election.cc:343] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.212880 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:38.213518 22125 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.215879 22067 ts_tablet_manager.cc:1434] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:05:38.217278 22067 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:38.220744 22071 tablet_bootstrap.cc:654] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.223917 22067 tablet_bootstrap.cc:654] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.225548 22069 tablet_bootstrap.cc:492] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:38.226100 22069 ts_tablet_manager.cc:1403] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.002s
I20260709 13:05:38.225381 21773 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.225811 22205 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.231745 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:38.232435 21873 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.240370 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:38.241156 21947 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.229655 22069 raft_consensus.cc:359] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.244141 22069 raft_consensus.cc:385] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.244755 22069 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.250353 21947 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:38.265805 22069 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.252748 22205 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:38.272452 22069 ts_tablet_manager.cc:1434] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:05:38.274935 21987 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:38.276166 22238 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.276759 22238 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:38.277740 22238 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.283145 22069 tablet_bootstrap.cc:492] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:38.285223 22301 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.285913 22301 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.254510 21873 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:38.291875 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:38.292836 22021 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:38.295766 21916 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:38.298765 22124 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.299161 22124 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.299513 22124 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.308137 22071 tablet_bootstrap.cc:492] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:38.288214 22301 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.308744 22071 ts_tablet_manager.cc:1403] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.001s
I20260709 13:05:38.309391 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:38.310144 21873 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:38.311982 22071 raft_consensus.cc:359] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.318719 22071 raft_consensus.cc:385] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.319054 22071 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.325644 21773 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.327416 22124 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.331487 22125 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.332046 22125 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.334977 22125 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.330883 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:38.336529 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:38.337451 21873 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:38.338811 21838 leader_election.cc:343] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.339828 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:38.341261 21841 leader_election.cc:343] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.324515 22071 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.341740 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:38.341212 22067 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:38.343362 22067 ts_tablet_manager.cc:1403] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.126s	user 0.033s	sys 0.049s
I20260709 13:05:38.347486 22125 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.352332 22069 tablet_bootstrap.cc:654] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.352542 22125 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.353344 22125 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.356056 22125 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.356801 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:38.357208 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:38.358224 22071 ts_tablet_manager.cc:1434] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
W20260709 13:05:38.358331 21838 leader_election.cc:343] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.358865 22124 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.359989 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:05:38.361941 21841 leader_election.cc:343] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.362516 22021 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.365955 22069 tablet_bootstrap.cc:492] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:38.365787 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:38.366475 22069 ts_tablet_manager.cc:1403] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.000s
I20260709 13:05:38.367254 22295 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.369364 22067 raft_consensus.cc:359] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.370065 22067 raft_consensus.cc:385] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.370319 22067 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.371070 22067 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.373276 22021 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:38.374505 21947 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.374699 21916 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:38.375837 22124 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.376585 22124 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:38.377370 22067 ts_tablet_manager.cc:1434] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:05:38.378468 22067 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:38.377985 22124 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.385586 22067 tablet_bootstrap.cc:654] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.387601 22069 raft_consensus.cc:359] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.388444 22069 raft_consensus.cc:385] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.389000 22069 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.384274 21873 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:38.390077 22069 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.393872 22069 ts_tablet_manager.cc:1434] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:05:38.395020 22069 tablet_bootstrap.cc:492] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:38.402835 22069 tablet_bootstrap.cc:654] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.403144 22337 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.408062 21770 catalog_manager.cc:5697] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.436458 22337 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.437139 22337 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.441243 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:38.442606 21841 leader_election.cc:343] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.444031 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:38.440081 22337 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:05:38.452173 21838 leader_election.cc:343] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.452948 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:38.454033 22337 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.473214 22124 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:38.495086 22286 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.496150 22071 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:38.502202 22337 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.505612 22301 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.506240 22301 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.508255 22301 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.510859 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:38.513262 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:38.515754 21916 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:38.516870 22301 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:38.596403 22301 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.552349 22071 tablet_bootstrap.cc:654] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.644184 22069 tablet_bootstrap.cc:492] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:38.644707 22069 ts_tablet_manager.cc:1403] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.250s	user 0.036s	sys 0.056s
I20260709 13:05:38.647735 22069 raft_consensus.cc:359] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.651892 22301 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.648459 22069 raft_consensus.cc:385] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.660657 22069 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.661423 22069 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.673125 22069 ts_tablet_manager.cc:1434] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:05:38.674181 22069 tablet_bootstrap.cc:492] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:38.689967 22069 tablet_bootstrap.cc:654] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.708422 22071 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:38.710901 22071 ts_tablet_manager.cc:1403] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.348s	user 0.013s	sys 0.000s
I20260709 13:05:38.711805 22069 tablet_bootstrap.cc:492] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:38.712289 22069 ts_tablet_manager.cc:1403] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 13:05:38.728994 22069 raft_consensus.cc:359] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.729699 22069 raft_consensus.cc:385] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.729984 22069 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.735824 22067 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:38.736359 22067 ts_tablet_manager.cc:1403] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.358s	user 0.097s	sys 0.166s
I20260709 13:05:38.738574 22069 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.740521 22071 raft_consensus.cc:359] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.745174 22071 raft_consensus.cc:385] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.747424 22071 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.748294 22071 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.743906 22067 raft_consensus.cc:359] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.757771 22067 raft_consensus.cc:385] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.758194 22067 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.759091 22067 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.761971 22098 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.762544 22098 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.763813 22067 ts_tablet_manager.cc:1434] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 13:05:38.761320 22071 ts_tablet_manager.cc:1434] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:05:38.765432 22071 tablet_bootstrap.cc:492] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:38.767524 22098 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.741168 22069 ts_tablet_manager.cc:1434] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:05:38.767740 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:38.768786 22022 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:38.770529 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:38.771606 22098 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.772119 22098 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.772547 22098 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.772909 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:38.773605 21872 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:38.779446 22205 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.780933 22301 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.784708 22067 tablet_bootstrap.cc:492] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:38.794081 22069 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:38.795221 22067 tablet_bootstrap.cc:654] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.771801 22071 tablet_bootstrap.cc:654] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.797638 22205 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.804684 22205 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.810449 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:38.811196 21872 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:38.812501 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:38.813947 22205 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:38.814477 22205 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.814822 22205 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.815153 22205 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.819864 22286 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.820437 22286 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.822700 22286 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.825408 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:38.826521 22301 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:38.832800 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:38.834136 21873 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:38.834461 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:38.833179 21916 leader_election.cc:343] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.837136 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:05:38.837275 21987 leader_election.cc:343] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.839375 22286 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:38.843288 22286 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.843818 22286 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.844003 22205 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.852722 22098 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.854643 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:38.855274 21872 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.857290 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:38.858110 21873 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.859546 22205 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:38.860852 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:38.856231 22098 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:05:38.862393 21987 leader_election.cc:343] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.856215 22071 tablet_bootstrap.cc:492] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:38.864919 22071 ts_tablet_manager.cc:1403] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.003s
I20260709 13:05:38.864238 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:38.867913 22024 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:38.879611 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:38.887758 22024 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:38.890558 21873 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:38.892530 22240 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:38.888141 22286 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.894950 22286 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.891916 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:38.904860 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:38.905567 21875 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.908111 22067 tablet_bootstrap.cc:492] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:38.908619 22067 ts_tablet_manager.cc:1403] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.008s
I20260709 13:05:38.912568 22067 raft_consensus.cc:359] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.913200 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:38.888346 21872 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
W20260709 13:05:38.914956 21916 leader_election.cc:343] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.913384 22067 raft_consensus.cc:385] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.916098 22067 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.917229 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:38.899700 22069 tablet_bootstrap.cc:654] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.918179 21875 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:38.918843 22286 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.919412 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:38.916962 22067 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.919540 22286 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:38.920423 22301 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.922459 22301 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:38.922408 22071 raft_consensus.cc:359] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.923177 22071 raft_consensus.cc:385] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.921236 22241 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.923491 22071 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.924196 22071 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.926501 22067 ts_tablet_manager.cc:1434] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.006s
I20260709 13:05:38.927487 22071 ts_tablet_manager.cc:1434] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:05:38.927660 22241 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:38.931465 22241 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.928025 22301 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.937839 22071 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:38.937878 22067 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:38.944543 22286 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.955992 22067 tablet_bootstrap.cc:654] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.964673 22337 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.965592 22337 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:38.968163 22337 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:38.971446 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:38.975999 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:38.978252 21841 leader_election.cc:343] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:38.981860 21838 leader_election.cc:343] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:38.982285 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:38.982384 21771 catalog_manager.cc:5697] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.988684 22069 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:38.987198 22337 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:38.989485 22069 ts_tablet_manager.cc:1403] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.196s	user 0.017s	sys 0.006s
I20260709 13:05:38.996250 21770 catalog_manager.cc:5697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.011962 22205 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.012876 22205 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.015739 22205 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:39.019150 22069 raft_consensus.cc:359] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.020053 22069 raft_consensus.cc:385] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.020406 22069 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.021157 22069 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.023564 22069 ts_tablet_manager.cc:1434] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.034s	user 0.024s	sys 0.005s
I20260709 13:05:39.025022 22069 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:39.030277 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:39.030572 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:39.031112 21872 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 1: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:05:39.033951 21988 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:39.035046 22205 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.036175 22071 tablet_bootstrap.cc:654] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.051266 22205 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.058830 22069 tablet_bootstrap.cc:654] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.072023 22071 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:39.072557 22071 ts_tablet_manager.cc:1403] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.007s
I20260709 13:05:39.077919 22067 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:39.077643 22071 raft_consensus.cc:359] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.078415 22067 ts_tablet_manager.cc:1403] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.149s	user 0.029s	sys 0.004s
I20260709 13:05:39.078411 22071 raft_consensus.cc:385] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.082448 22286 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.083026 22286 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.083341 22067 raft_consensus.cc:359] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.084046 22067 raft_consensus.cc:385] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.084327 22067 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.085206 22286 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.085011 22067 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.078958 22071 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.087328 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:39.087824 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:39.090790 22295 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.097903 22067 ts_tablet_manager.cc:1434] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:05:39.101056 22071 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.103246 22295 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.105048 22071 ts_tablet_manager.cc:1434] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:05:39.105988 22071 tablet_bootstrap.cc:492] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:39.106576 22295 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.102409 21872 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.109895 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:39.108840 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:39.110877 21916 leader_election.cc:343] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:39.111394 21838 leader_election.cc:343] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:39.112229 21841 leader_election.cc:343] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.112643 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:39.113770 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:39.114807 22301 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.115192 22301 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.115551 22301 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.117293 22337 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.122319 21771 catalog_manager.cc:5697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.123883 22067 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:39.125917 22301 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.130144 22069 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:39.135759 22069 ts_tablet_manager.cc:1403] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.008s
I20260709 13:05:39.137365 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:39.131315 22067 tablet_bootstrap.cc:654] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.159806 22286 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.160403 22286 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.160926 22301 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.134985 22071 tablet_bootstrap.cc:654] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.137941 21872 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.139253 22069 raft_consensus.cc:359] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.161777 22069 raft_consensus.cc:385] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.162119 22069 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.163084 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:05:39.165716 21916 leader_election.cc:343] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.166615 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:39.168072 21916 leader_election.cc:343] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.168730 22286 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.162838 22069 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.172043 22069 ts_tablet_manager.cc:1434] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:05:39.177989 22069 tablet_bootstrap.cc:492] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:39.187502 21872 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:39.188539 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:39.189180 21875 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.193490 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:39.194661 22098 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.195124 22098 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:39.196003 22098 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.197074 22069 tablet_bootstrap.cc:654] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.199633 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:39.200488 22286 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.201014 22286 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.201401 22286 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.213543 22069 tablet_bootstrap.cc:492] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:39.215453 22069 ts_tablet_manager.cc:1403] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.038s	user 0.001s	sys 0.014s
I20260709 13:05:39.219122 22069 raft_consensus.cc:359] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.219928 22069 raft_consensus.cc:385] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.220221 22069 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.212280 22286 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.233903 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:39.234453 22286 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.234625 21875 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.241178 22295 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.241792 22295 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.244125 22295 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.246091 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:39.246692 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:39.248107 21838 leader_election.cc:343] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:39.250662 21841 leader_election.cc:343] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.251178 21841 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:39.251958 22295 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.257797 22069 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.260277 22069 ts_tablet_manager.cc:1434] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 13:05:39.260989 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:05:39.263008 21916 leader_election.cc:343] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.264775 22069 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:39.268421 21875 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:39.270115 21770 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.276527 22069 tablet_bootstrap.cc:654] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.277357 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:39.278258 22098 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.278694 22098 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:39.281392 22098 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.288810 22071 tablet_bootstrap.cc:492] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:39.289454 22071 ts_tablet_manager.cc:1403] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.184s	user 0.008s	sys 0.005s
I20260709 13:05:39.290108 22067 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:39.300446 22067 ts_tablet_manager.cc:1403] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.192s	user 0.021s	sys 0.031s
I20260709 13:05:39.302703 22071 raft_consensus.cc:359] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.303332 22071 raft_consensus.cc:385] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.303320 22067 raft_consensus.cc:359] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.303915 22071 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.304172 22067 raft_consensus.cc:385] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.304765 22071 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.307780 22071 ts_tablet_manager.cc:1434] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:05:39.309859 22071 tablet_bootstrap.cc:492] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:39.315178 22067 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.316051 22067 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.323570 22071 tablet_bootstrap.cc:654] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.329088 22067 ts_tablet_manager.cc:1434] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:05:39.329082 22069 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:39.330294 22069 ts_tablet_manager.cc:1403] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.011s
I20260709 13:05:39.330366 22067 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:39.326160 21770 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.332135 22098 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:39.335232 22069 raft_consensus.cc:359] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.335971 22069 raft_consensus.cc:385] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.336261 22069 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.336942 22069 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.347708 22069 ts_tablet_manager.cc:1434] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:39.363191 22098 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.367352 22069 tablet_bootstrap.cc:492] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:39.369877 22067 tablet_bootstrap.cc:654] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.380648 22098 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.381364 22098 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.384716 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:39.384865 22098 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.385350 21872 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.385072 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:39.391431 22024 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.392907 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:39.393723 22301 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.394125 22301 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.394485 22301 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.394294 22286 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:39.395766 22069 tablet_bootstrap.cc:654] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.402202 22071 tablet_bootstrap.cc:492] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:39.402666 22071 ts_tablet_manager.cc:1403] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.010s
I20260709 13:05:39.405392 22071 raft_consensus.cc:359] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.406080 22071 raft_consensus.cc:385] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.406400 22071 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.407033 22071 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.409075 22071 ts_tablet_manager.cc:1434] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:05:39.411017 22067 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:39.413262 22071 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:39.421029 22067 ts_tablet_manager.cc:1403] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.091s	user 0.004s	sys 0.008s
I20260709 13:05:39.423110 21948 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.426182 22067 raft_consensus.cc:359] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.438526 22067 raft_consensus.cc:385] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.438911 22067 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.438822 22115 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.439706 22067 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.432313 22069 tablet_bootstrap.cc:492] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:39.434545 22301 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.442001 22069 ts_tablet_manager.cc:1403] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.012s
I20260709 13:05:39.437381 22241 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:39.438115 22295 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.444519 22295 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.446575 22295 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.448323 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:39.449733 22069 raft_consensus.cc:359] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:39.450173 21841 leader_election.cc:343] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.450414 22069 raft_consensus.cc:385] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.450695 22069 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.451277 22069 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.453820 22069 ts_tablet_manager.cc:1434] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:05:39.455610 22067 ts_tablet_manager.cc:1434] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:05:39.456816 22067 tablet_bootstrap.cc:492] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:39.461602 22240 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.427147 22071 tablet_bootstrap.cc:654] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.472426 22069 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:39.473709 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:39.481861 22067 tablet_bootstrap.cc:654] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.477123 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:39.484488 21870 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.489462 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:39.490360 22021 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.479818 22301 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.520756 22069 tablet_bootstrap.cc:654] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:39.528024 21838 leader_election.cc:343] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.528592 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:39.529994 22125 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:39.537914 22379 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:05:39.584576 22337 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.603242 22071 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:39.603777 22071 ts_tablet_manager.cc:1403] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.194s	user 0.016s	sys 0.025s
I20260709 13:05:39.589346 22337 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.607266 22337 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.610533 21870 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:39.616565 22071 raft_consensus.cc:359] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.617429 22071 raft_consensus.cc:385] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.617753 22071 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
W20260709 13:05:39.618952 22380 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.067s	user 0.001s	sys 0.003s
I20260709 13:05:39.614965 22021 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:39.623939 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:39.624778 22124 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.625269 22124 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:39.626034 22124 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.633368 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:39.618542 22071 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.645628 22071 ts_tablet_manager.cc:1434] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 13:05:39.646714 22071 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
W20260709 13:05:39.649798 21838 leader_election.cc:343] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.670347 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:39.671830 22069 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:39.672324 22069 ts_tablet_manager.cc:1403] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.011s
W20260709 13:05:39.673611 21841 leader_election.cc:343] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.674065 21841 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:39.678313 22067 tablet_bootstrap.cc:492] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:39.678844 22067 ts_tablet_manager.cc:1403] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.014s
I20260709 13:05:39.676369 22301 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:39.676306 22337 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.686625 22385 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.687131 22385 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.691416 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:39.694615 22067 raft_consensus.cc:359] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.695642 22067 raft_consensus.cc:385] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.695983 22067 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.697309 22071 tablet_bootstrap.cc:654] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.699302 22067 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.687120 22069 raft_consensus.cc:359] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.701416 22069 raft_consensus.cc:385] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.701694 22069 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.702375 22069 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.705333 22069 ts_tablet_manager.cc:1434] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:05:39.707916 22069 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:39.709950 22124 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.710783 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:39.694658 22385 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:39.716524 22067 ts_tablet_manager.cc:1434] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.003s
I20260709 13:05:39.717717 22067 tablet_bootstrap.cc:492] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:39.722857 22067 tablet_bootstrap.cc:654] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.727891 21771 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.734623 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:39.735061 22098 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.735553 22098 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.737479 22098 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.739787 22383 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.740758 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:39.741430 21871 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.744478 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:39.745184 22022 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.745457 22023 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.746476 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:39.747363 22115 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.747761 22115 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.748119 22115 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.761492 22115 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.772289 22023 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.772471 22124 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.784158 22069 tablet_bootstrap.cc:654] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.782742 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:39.791031 22021 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.791682 22069 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:39.792158 22069 ts_tablet_manager.cc:1403] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 13:05:39.795463 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:39.796188 21871 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.800159 22071 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:39.800734 22071 ts_tablet_manager.cc:1403] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.001s
I20260709 13:05:39.802387 22067 tablet_bootstrap.cc:492] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:39.803140 22067 ts_tablet_manager.cc:1403] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.000s
I20260709 13:05:39.781073 22115 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.816847 22071 raft_consensus.cc:359] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.817970 22071 raft_consensus.cc:385] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.818370 22071 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.819330 22071 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.821436 21871 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:39.824772 22098 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:39.826041 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:39.826963 22098 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.827463 22098 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:39.828245 22098 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.829214 22071 ts_tablet_manager.cc:1434] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:05:39.830348 22071 tablet_bootstrap.cc:492] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:39.838310 22069 raft_consensus.cc:359] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.839136 22069 raft_consensus.cc:385] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.823552 22021 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:39.839447 22069 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.842615 22069 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.843950 22067 raft_consensus.cc:359] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.844726 22067 raft_consensus.cc:385] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.855233 22067 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.856014 22067 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.860042 21770 catalog_manager.cc:5697] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.851850 22071 tablet_bootstrap.cc:654] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.862998 22067 ts_tablet_manager.cc:1434] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.006s
I20260709 13:05:39.867415 22295 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.868037 22067 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:39.868028 22295 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.871874 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:39.873651 21838 leader_election.cc:343] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.876438 22067 tablet_bootstrap.cc:654] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.879367 22295 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.880918 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:39.882550 21841 leader_election.cc:343] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.883038 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:39.883915 22071 tablet_bootstrap.cc:492] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:39.883811 22295 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:39.884420 22071 ts_tablet_manager.cc:1403] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.004s
I20260709 13:05:39.887393 22071 raft_consensus.cc:359] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.888151 22071 raft_consensus.cc:385] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.888486 22071 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.889194 22071 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.891292 22071 ts_tablet_manager.cc:1434] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:39.892145 22071 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:39.893433 22067 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:39.893929 22067 ts_tablet_manager.cc:1403] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.005s
I20260709 13:05:39.854844 22069 ts_tablet_manager.cc:1434] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.001s
I20260709 13:05:39.896842 22067 raft_consensus.cc:359] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.897616 22067 raft_consensus.cc:385] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.897784 22069 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:39.902223 22098 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.897907 22067 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.902777 22098 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.903517 22067 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.905668 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:39.905897 22067 ts_tablet_manager.cc:1434] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:05:39.906365 21870 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.907388 22067 tablet_bootstrap.cc:492] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:39.907647 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:39.908425 22286 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.908855 22286 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.909205 22286 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.914106 22067 tablet_bootstrap.cc:654] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.914924 22098 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.918179 22071 tablet_bootstrap.cc:654] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.926803 22071 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:39.927318 22071 ts_tablet_manager.cc:1403] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.001s
I20260709 13:05:39.930083 22071 raft_consensus.cc:359] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.931605 22071 raft_consensus.cc:385] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.931908 22071 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.932574 22071 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.935025 22069 tablet_bootstrap.cc:654] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.943755 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:39.920744 22286 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.935034 22071 ts_tablet_manager.cc:1434] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:39.951089 22071 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:39.953367 22098 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.953933 22098 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.955350 22069 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:39.955875 22069 ts_tablet_manager.cc:1403] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.012s
I20260709 13:05:39.958607 22069 raft_consensus.cc:359] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.959362 22069 raft_consensus.cc:385] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.959647 22069 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.961192 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:39.961997 21871 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.945230 22022 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
W20260709 13:05:39.963694 21976 tablet.cc:2406] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:39.963510 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:39.964957 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:39.965320 22390 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.965657 21871 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.965783 22390 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.966234 22390 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.969039 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:39.969808 22024 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:39.973992 22390 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.960307 22069 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:39.976732 22098 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.990170 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:39.996810 22024 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.996536 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:39.999174 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:39.999505 21870 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.000173 22022 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.004299 22069 ts_tablet_manager.cc:1434] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.005s
I20260709 13:05:40.004776 22390 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.005483 22069 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:39.979686 22286 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:39.979405 22067 tablet_bootstrap.cc:492] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:40.009115 22067 ts_tablet_manager.cc:1403] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.007s
I20260709 13:05:40.009482 22022 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.010967 21916 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.012413 22067 raft_consensus.cc:359] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.013202 22067 raft_consensus.cc:385] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.013497 22067 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.014253 22067 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.015012 22098 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.015514 22098 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:40.016202 22071 tablet_bootstrap.cc:654] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.018239 22098 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:40.027486 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:40.034076 21870 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.035422 22337 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.041376 22067 ts_tablet_manager.cc:1434] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:05:40.042404 22067 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:40.037317 22337 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.044471 22337 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.046052 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:40.047291 22024 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
W20260709 13:05:40.047720 21841 leader_election.cc:343] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.048411 21916 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.049376 22098 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.049638 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:40.050014 22098 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:40.050851 22098 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:40.051440 21838 leader_election.cc:343] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.051851 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:40.051107 21871 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.052506 22337 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.055608 21771 catalog_manager.cc:5697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.056716 22071 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.057193 22071 ts_tablet_manager.cc:1403] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.004s
I20260709 13:05:40.059770 22071 raft_consensus.cc:359] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.060432 22071 raft_consensus.cc:385] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.060726 22071 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.061784 22071 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.065299 22067 tablet_bootstrap.cc:654] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.065402 22071 ts_tablet_manager.cc:1434] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:40.068543 22071 tablet_bootstrap.cc:492] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:40.069977 22098 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.074499 22071 tablet_bootstrap.cc:654] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.082993 22069 tablet_bootstrap.cc:654] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.084658 22071 tablet_bootstrap.cc:492] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.090724 22067 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:40.106586 22071 ts_tablet_manager.cc:1403] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.000s
I20260709 13:05:40.106783 22067 ts_tablet_manager.cc:1403] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.001s
I20260709 13:05:40.108892 22071 raft_consensus.cc:359] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.109683 22071 raft_consensus.cc:385] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.110023 22071 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.109738 22067 raft_consensus.cc:359] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.093885 22390 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.110786 22071 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.114148 22071 ts_tablet_manager.cc:1434] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:40.115512 22071 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:40.110543 22067 raft_consensus.cc:385] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.119282 22067 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.120118 22067 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.122601 22067 ts_tablet_manager.cc:1434] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:40.123884 22337 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.124477 22067 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:40.124384 22337 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.126477 22337 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.127723 21771 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.129004 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:40.130388 21838 leader_election.cc:343] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.131536 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:40.131832 22067 tablet_bootstrap.cc:654] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:40.133033 21841 leader_election.cc:343] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.133468 21841 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:40.135082 22337 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.138387 22069 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:40.140213 22069 ts_tablet_manager.cc:1403] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.007s
I20260709 13:05:40.142860 22069 raft_consensus.cc:359] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.143159 22390 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.143556 22115 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.143733 22390 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.144058 22115 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.146086 22390 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.148947 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:40.149648 22024 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:40.150560 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:40.151160 22022 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:40.151638 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:40.152276 21871 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:40.152431 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.151670 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:40.153318 21916 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.153661 21873 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:40.154011 22098 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.154340 22098 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.154668 22098 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.156760 22390 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.146086 22115 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.157173 22390 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.157572 22390 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.163307 22098 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.167193 22098 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.167490 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:40.168052 22022 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.172649 22071 tablet_bootstrap.cc:654] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.173192 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:40.173816 21873 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.176841 22240 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.177426 22240 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.187342 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:40.189815 21987 leader_election.cc:343] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.190335 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:40.190651 22240 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:40.191263 21871 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:40.192901 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:40.194288 22385 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.194633 22385 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.194988 22385 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.221225 22385 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.232004 22022 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.235345 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:40.235989 21871 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.240100 22069 raft_consensus.cc:385] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.240562 22069 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.242522 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.243291 22098 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.243793 22098 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:05:40.244644 22411 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:05:40.244513 22098 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.249848 21873 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.251039 22069 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.252930 22069 ts_tablet_manager.cc:1434] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 13:05:40.253895 22069 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:40.257663 22390 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.259795 22390 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.261432 22385 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:40.263060 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:40.264623 22024 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.264904 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:40.265913 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:05:40.266278 21987 leader_election.cc:343] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.266489 21873 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.259955 22115 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.269953 21871 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:40.271100 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:40.272244 22240 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.272670 22024 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.272745 22240 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:40.273731 22240 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.274566 21916 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.275346 22286 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.275797 22286 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:40.277153 22286 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.284873 22067 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:40.285502 22067 ts_tablet_manager.cc:1403] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.161s	user 0.047s	sys 0.037s
I20260709 13:05:40.287002 22069 tablet_bootstrap.cc:654] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.289731 21873 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.298672 22071 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.299364 22071 ts_tablet_manager.cc:1403] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.184s	user 0.023s	sys 0.032s
I20260709 13:05:40.358428 22067 raft_consensus.cc:359] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.359627 22067 raft_consensus.cc:385] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.359895 22067 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.361790 22098 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.363942 22067 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.376792 22067 ts_tablet_manager.cc:1434] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.091s	user 0.017s	sys 0.003s
I20260709 13:05:40.382474 22067 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:40.392627 22337 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.393175 22337 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.395205 22337 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.399241 21772 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.405349 22071 raft_consensus.cc:359] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.405968 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:40.406176 22071 raft_consensus.cc:385] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.406607 22071 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.407318 22071 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:40.407908 21841 leader_election.cc:343] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:40.411664 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43753.6us
I20260709 13:05:40.411868 22071 ts_tablet_manager.cc:1434] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.001s
I20260709 13:05:40.417241 21771 catalog_manager.cc:5697] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.420739 22071 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:40.425472 22067 tablet_bootstrap.cc:654] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.428645 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:40.441622 22390 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.447804 22069 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:40.448340 22069 ts_tablet_manager.cc:1403] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.195s	user 0.016s	sys 0.005s
W20260709 13:05:40.451932 21838 leader_election.cc:343] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.455572 21838 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:40.458652 22071 tablet_bootstrap.cc:654] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.464627 22069 raft_consensus.cc:359] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.465696 22069 raft_consensus.cc:385] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.470055 21772 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.468802 22286 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:40.473984 22418 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.466073 22069 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.481110 22069 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.503120 22115 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.504194 22295 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.504753 22295 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.507946 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:40.509330 21838 leader_election.cc:343] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.510484 22295 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.522512 22069 ts_tablet_manager.cc:1434] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:05:40.529603 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:40.531458 21841 leader_election.cc:343] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.531913 21841 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:40.533007 22418 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.552783 22115 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:40.557518 22069 tablet_bootstrap.cc:492] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:40.566047 22071 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.566553 22071 ts_tablet_manager.cc:1403] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.146s	user 0.043s	sys 0.042s
I20260709 13:05:40.570438 22071 raft_consensus.cc:359] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.571130 22071 raft_consensus.cc:385] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.571380 22071 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.572075 22071 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.574820 22071 ts_tablet_manager.cc:1434] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:40.581534 22067 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:40.581976 22067 ts_tablet_manager.cc:1403] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.204s	user 0.020s	sys 0.005s
I20260709 13:05:40.584260 22071 tablet_bootstrap.cc:492] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:40.588214 22069 tablet_bootstrap.cc:654] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.588990 22115 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.589668 22115 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.601640 22071 tablet_bootstrap.cc:654] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.602519 22067 raft_consensus.cc:359] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.603899 22067 raft_consensus.cc:385] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.604161 22067 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.605245 22067 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.606761 22115 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.607405 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:40.607681 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:40.608052 21870 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:40.608259 22022 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:40.609820 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.610677 22115 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.611012 22115 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.611274 22115 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.620220 22067 ts_tablet_manager.cc:1434] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 13:05:40.631349 22067 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:40.638506 22115 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.640633 22115 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.641721 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:40.641742 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:40.642417 21873 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.642571 22021 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.647006 22069 tablet_bootstrap.cc:492] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:40.647452 22069 ts_tablet_manager.cc:1403] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.004s
I20260709 13:05:40.652783 22021 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.654332 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.655184 22301 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.655723 22301 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:40.656836 22301 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.674548 22385 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.676200 22071 tablet_bootstrap.cc:492] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.677316 22071 ts_tablet_manager.cc:1403] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.020s
I20260709 13:05:40.679132 22069 raft_consensus.cc:359] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.679850 22069 raft_consensus.cc:385] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:40.680011 21987 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:40.680173 22069 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.680966 22069 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.685874 22069 ts_tablet_manager.cc:1434] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:05:40.686944 22069 tablet_bootstrap.cc:492] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:40.686691 21873 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:40.688488 22071 raft_consensus.cc:359] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.689203 22067 tablet_bootstrap.cc:654] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.689517 22071 raft_consensus.cc:385] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.689845 22071 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.694790 22071 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.696988 22071 ts_tablet_manager.cc:1434] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:05:40.698498 22071 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:40.710292 22115 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.712142 22069 tablet_bootstrap.cc:654] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.713827 21772 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.715442 22071 tablet_bootstrap.cc:654] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.719033 22286 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.723484 22069 tablet_bootstrap.cc:492] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:40.723958 22069 ts_tablet_manager.cc:1403] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.003s
I20260709 13:05:40.726409 22069 raft_consensus.cc:359] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.727062 22069 raft_consensus.cc:385] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.727335 22069 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.731805 22069 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.736071 22069 ts_tablet_manager.cc:1434] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:40.740451 22071 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.740962 22071 ts_tablet_manager.cc:1403] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.001s
I20260709 13:05:40.741616 22240 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.742107 22240 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.743301 22390 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.743640 22071 raft_consensus.cc:359] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.744302 22071 raft_consensus.cc:385] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.744539 22071 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.745730 22071 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.748317 22071 ts_tablet_manager.cc:1434] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:40.749264 22071 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:40.751108 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:05:40.752635 21988 leader_election.cc:343] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.753284 22115 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.755410 22071 tablet_bootstrap.cc:654] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.763095 22240 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:40.764063 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:40.772009 22067 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:40.781374 22067 ts_tablet_manager.cc:1403] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.002s
I20260709 13:05:40.781327 21947 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:40.783354 21987 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:40.784483 22383 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.784278 22067 raft_consensus.cc:359] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.784922 22383 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.785036 22067 raft_consensus.cc:385] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.785310 22383 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.785349 22067 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.794478 22067 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.796885 22069 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:40.798271 22067 ts_tablet_manager.cc:1434] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:05:40.817831 22069 tablet_bootstrap.cc:654] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.836365 22067 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:40.839097 22385 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.839653 22385 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.841672 22385 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:40.852460 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:40.853179 21948 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:40.854214 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:40.891124 21873 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:40.857908 22418 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.893499 22418 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.896477 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:40.898442 21838 leader_election.cc:343] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.857630 21987 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:40.902861 22069 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:40.903362 22069 ts_tablet_manager.cc:1403] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.005s
I20260709 13:05:40.905102 22385 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.905524 22385 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.905884 22385 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:40.909001 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 51473.8us
I20260709 13:05:40.910434 22071 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.910923 22071 ts_tablet_manager.cc:1403] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.162s	user 0.028s	sys 0.056s
I20260709 13:05:40.910547 22069 raft_consensus.cc:359] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.911284 22069 raft_consensus.cc:385] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.911556 22069 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.892447 22067 tablet_bootstrap.cc:654] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.913255 22418 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:40.914099 22071 raft_consensus.cc:359] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.914822 22071 raft_consensus.cc:385] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.914541 22383 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.915104 22071 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.915760 22071 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.916930 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:40.917228 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:05:40.918216 21841 leader_election.cc:343] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.917764 22383 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:40.918773 21841 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:40.917814 22071 ts_tablet_manager.cc:1434] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:05:40.918502 21988 leader_election.cc:343] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.920774 22385 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.923436 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:40.924111 21873 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.924038 22418 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.923557 22071 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:40.937505 22385 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:40.939447 21873 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:40.940719 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:40.941812 22385 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.942319 22385 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:40.942672 22383 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.942967 22071 tablet_bootstrap.cc:654] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.943214 22383 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.943394 22385 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.912184 22069 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.946656 22069 ts_tablet_manager.cc:1434] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:05:40.949214 22383 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:40.950199 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:05:40.951524 21988 leader_election.cc:343] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.958704 22071 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.959167 22071 ts_tablet_manager.cc:1403] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.005s
I20260709 13:05:40.959493 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:40.960214 21947 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.961814 22071 raft_consensus.cc:359] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.962551 22071 raft_consensus.cc:385] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.962818 22071 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.963565 22071 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.965636 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:40.966092 22071 ts_tablet_manager.cc:1434] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:05:40.966472 21948 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.968711 22071 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:40.969602 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:40.975833 22071 tablet_bootstrap.cc:654] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:40.985121 21987 leader_election.cc:343] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.985673 21987 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:40.987000 22383 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.989040 22071 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:40.989555 22071 ts_tablet_manager.cc:1403] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 13:05:40.990516 21947 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:40.991628 21987 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:40.993036 22383 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.992781 22071 raft_consensus.cc:359] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.993681 22071 raft_consensus.cc:385] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.993721 22383 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:40.994094 22071 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.994952 22383 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:40.994944 22071 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.001137 22071 ts_tablet_manager.cc:1434] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:05:41.002202 22071 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:41.010247 22390 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.010805 22390 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.013047 22390 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.014766 21948 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:41.015357 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:41.015964 21873 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:41.017030 22069 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:41.019352 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:41.019701 22071 tablet_bootstrap.cc:654] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.021466 22390 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.021373 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:41.022969 22390 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:41.023933 21916 leader_election.cc:343] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.024976 22390 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.038206 22069 tablet_bootstrap.cc:654] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.040194 22067 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:41.040752 22067 ts_tablet_manager.cc:1403] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.205s	user 0.012s	sys 0.003s
I20260709 13:05:41.059458 21770 catalog_manager.cc:5697] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.061024 22071 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:41.061625 22071 ts_tablet_manager.cc:1403] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.000s
I20260709 13:05:41.072255 22390 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.075350 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:41.075978 21870 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.080154 22067 raft_consensus.cc:359] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.081301 22067 raft_consensus.cc:385] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.081709 22067 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.083905 22390 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.085027 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:05:41.086582 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:05:41.086531 21916 leader_election.cc:343] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.082749 22067 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.088403 22069 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:41.088896 22069 ts_tablet_manager.cc:1403] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.014s
I20260709 13:05:41.091040 22385 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.091540 22385 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.093676 22385 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:41.094849 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:41.095307 22071 raft_consensus.cc:359] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.095963 22071 raft_consensus.cc:385] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.096227 22071 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
W20260709 13:05:41.096343 21987 leader_election.cc:343] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.096905 22071 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.097596 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:41.098301 22067 ts_tablet_manager.cc:1434] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:05:41.099372 22067 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
W20260709 13:05:41.100092 21988 leader_election.cc:343] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.100512 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:41.101716 22383 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.101725 22071 ts_tablet_manager.cc:1434] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:05:41.106894 22071 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:41.106348 21870 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:41.109695 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:41.109109 21771 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.111547 22286 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.112378 22286 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:41.113201 22286 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.120837 22067 tablet_bootstrap.cc:654] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.121533 22071 tablet_bootstrap.cc:654] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.127547 22069 raft_consensus.cc:359] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.128944 22069 raft_consensus.cc:385] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.129261 22069 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.129887 22069 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.138516 22069 ts_tablet_manager.cc:1434] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.002s
I20260709 13:05:41.136564 22383 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.139987 22069 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:41.140157 22383 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.142689 22383 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:41.144737 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:41.145955 21987 leader_election.cc:343] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.148418 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:05:41.152474 21988 leader_election.cc:343] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.152926 21988 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:41.153827 22383 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:41.179209 22067 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:41.179726 22067 ts_tablet_manager.cc:1403] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.003s
I20260709 13:05:41.182478 22069 tablet_bootstrap.cc:654] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.182407 22067 raft_consensus.cc:359] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.183109 22067 raft_consensus.cc:385] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.183389 22067 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.184001 22067 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.189828 22067 ts_tablet_manager.cc:1434] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:41.190912 22067 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:41.200008 22071 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:41.201470 22071 ts_tablet_manager.cc:1403] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.095s	user 0.030s	sys 0.010s
I20260709 13:05:41.203547 22067 tablet_bootstrap.cc:654] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.204116 22071 raft_consensus.cc:359] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.204901 22071 raft_consensus.cc:385] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.205169 22071 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.210844 22071 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.213114 22071 ts_tablet_manager.cc:1434] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:41.214123 22071 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:41.213654 22069 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:41.215399 22069 ts_tablet_manager.cc:1403] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.000s
I20260709 13:05:41.215950 22385 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.216471 22385 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.218667 22385 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:41.218518 22069 raft_consensus.cc:359] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.219374 22069 raft_consensus.cc:385] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.219703 22069 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.220022 22071 tablet_bootstrap.cc:654] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.220490 22069 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.220992 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:41.222397 21987 leader_election.cc:343] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.222311 22069 ts_tablet_manager.cc:1434] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:41.223193 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:41.224681 22069 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:41.225021 21873 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:41.230495 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:41.231551 22385 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.231920 22385 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.232260 22385 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.234639 22067 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:41.235280 22067 ts_tablet_manager.cc:1403] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.009s
W20260709 13:05:41.236871 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45596.8us
I20260709 13:05:41.239581 22067 raft_consensus.cc:359] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.245846 22067 raft_consensus.cc:385] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.246284 22067 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.248172 22067 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.250730 22067 ts_tablet_manager.cc:1434] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:41.251941 22115 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.252408 22115 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.254143 22069 tablet_bootstrap.cc:654] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.254273 22115 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.254747 22071 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:41.255537 22071 ts_tablet_manager.cc:1403] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.011s
I20260709 13:05:41.255641 22067 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:41.256026 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:41.257897 21916 leader_election.cc:343] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.260809 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:41.261415 21873 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:41.262481 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:05:41.263196 22115 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.263556 22115 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.259675 22390 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:41.263863 22115 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.266361 22385 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.276350 22071 raft_consensus.cc:359] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.277138 22071 raft_consensus.cc:385] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.277441 22071 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.278139 22071 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.290493 22115 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.269423 22240 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.294415 22240 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.295495 22385 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:41.296378 22240 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:41.302165 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:41.309047 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:41.309684 22115 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.309911 21870 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.319355 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:41.321798 21870 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:41.323208 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:41.322954 22301 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:41.323767 21916 leader_election.cc:343] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.324150 22124 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.324916 22124 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:41.325752 22124 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.328332 22418 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.329080 22418 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.332343 22418 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.333873 22115 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.334398 22115 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.334626 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:41.335170 21948 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:41.336797 21838 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:41.337069 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:41.337663 22021 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:41.338146 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:41.338717 21875 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:41.338789 21916 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:41.339537 22390 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.339897 22390 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.340256 22390 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.340287 22418 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.340850 22418 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.341230 22418 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.347391 22390 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.305436 21770 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.351981 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:05:41.363046 21987 leader_election.cc:343] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:41.364301 21987 leader_election.cc:343] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:41.350414 22115 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.368935 22295 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.387064 22390 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.387426 22071 ts_tablet_manager.cc:1434] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.131s	user 0.020s	sys 0.023s
I20260709 13:05:41.395424 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:41.396159 22021 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.348067 22418 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.408365 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:41.409430 22022 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:41.417352 22071 tablet_bootstrap.cc:492] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:41.431373 22069 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:41.432050 22069 ts_tablet_manager.cc:1403] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.208s	user 0.031s	sys 0.017s
I20260709 13:05:41.397460 22295 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.445643 22071 tablet_bootstrap.cc:654] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.415804 22455 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:05:41.450155 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:41.451020 21873 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.486037 22021 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:41.491318 22069 raft_consensus.cc:359] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.493634 22069 raft_consensus.cc:385] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.494098 22069 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.495275 22069 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.488425 21873 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:41.499601 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:41.506951 22067 tablet_bootstrap.cc:654] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.534821 22069 ts_tablet_manager.cc:1434] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.001s
I20260709 13:05:41.535009 22463 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:41.545640 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 73884.4us
I20260709 13:05:41.551780 22069 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:41.557080 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:41.557682 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:41.558007 22385 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.558585 21950 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 1: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:05:41.550416 22463 raft_consensus.cc:697] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:41.557727 21949 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.594329 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:41.560489 22295 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.631896 22071 tablet_bootstrap.cc:492] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:41.632575 22071 ts_tablet_manager.cc:1403] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.226s	user 0.023s	sys 0.019s
I20260709 13:05:41.713677 21949 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:41.716848 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:41.717463 21875 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.646250 22295 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.800745 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:41.801717 21871 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:41.701498 22463 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.853685 22418 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:05:41.824095 22474 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:05:41.873497 21838 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:41.891390 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:41.892302 22018 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.896273 21875 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:41.728365 22295 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.896306 21841 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:41.901211 22418 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.918602 22067 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:41.920086 22067 ts_tablet_manager.cc:1403] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.665s	user 0.027s	sys 0.013s
I20260709 13:05:41.903640 22470 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.945425 22071 raft_consensus.cc:359] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.946190 22071 raft_consensus.cc:385] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.946478 22071 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.947155 22071 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.949865 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:41.950150 22295 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:41.951213 22071 ts_tablet_manager.cc:1434] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.318s	user 0.003s	sys 0.012s
I20260709 13:05:41.952736 22067 raft_consensus.cc:359] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.953673 22067 raft_consensus.cc:385] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.951220 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:41.954061 22067 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.954926 22067 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:41.956039 22418 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:41.973102 22069 tablet_bootstrap.cc:654] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.956621 22481 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.978896 22071 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:41.985837 22067 ts_tablet_manager.cc:1434] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 13:05:41.982203 22481 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.072933 22481 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.987043 22455 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.097s
I20260709 13:05:42.087502 22482 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.088338 22482 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:05:42.112561 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 127208us
I20260709 13:05:42.089525 22482 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.092468 22418 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.176134 22067 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Bootstrap starting.
I20260709 13:05:42.226804 22470 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:42.235852 22469 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.236390 22469 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.238528 22469 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:42.248449 22067 tablet_bootstrap.cc:654] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.248942 22481 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:42.263954 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:42.261868 22017 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.278929 22018 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:42.291270 22240 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.303700 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:42.304409 22069 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:42.304497 21873 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 1: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:05:42.304992 22069 ts_tablet_manager.cc:1403] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.762s	user 0.040s	sys 0.050s
I20260709 13:05:42.315945 22465 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.322350 21916 consensus_peers.cc:597] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.314354 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:42.329401 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:42.331806 21875 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:42.333621 22499 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.003s
I20260709 13:05:42.316495 22465 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.361718 22069 raft_consensus.cc:359] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.362439 22069 raft_consensus.cc:385] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.362704 22069 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.371218 22069 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.375583 21875 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:42.377406 22465 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:42.378222 22069 ts_tablet_manager.cc:1434] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.002s
I20260709 13:05:42.382112 22069 tablet_bootstrap.cc:492] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:42.382838 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:42.345850 22019 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:42.381361 22481 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:42.394101 22482 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.401959 22482 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:42.409796 22482 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.399196 22071 tablet_bootstrap.cc:654] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.414439 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:42.431383 22069 tablet_bootstrap.cc:654] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.432899 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:42.444399 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:42.426256 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:42.445863 22492 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:05:42.452313 22490 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.452836 22490 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.453197 22490 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.452207 22475 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:42.453330 22485 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:05:42.472954 22486 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.473533 22486 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.473925 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:42.475095 22019 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:42.480002 21772 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:42.486173 21987 leader_election.cc:343] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:42.462781 22485 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:05:42.497447 21841 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:05:42.521469 22067 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: No bootstrap required, opened a new log
I20260709 13:05:42.522189 22067 ts_tablet_manager.cc:1403] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Time spent bootstrapping tablet: real 0.346s	user 0.039s	sys 0.038s
I20260709 13:05:42.536182 22069 tablet_bootstrap.cc:492] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:42.536743 22069 ts_tablet_manager.cc:1403] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.155s	user 0.018s	sys 0.028s
I20260709 13:05:42.510689 22418 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.551817 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:42.543628 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:42.546526 22418 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.564862 22069 raft_consensus.cc:359] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.565770 22069 raft_consensus.cc:385] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.566094 22069 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.559875 22418 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.569471 22069 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.560066 21944 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:42.563205 21950 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:42.616888 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:42.580482 22067 raft_consensus.cc:359] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.618312 22067 raft_consensus.cc:385] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.618597 22067 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.617590 22024 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 0.
I20260709 13:05:42.578203 22492 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:05:42.622007 22067 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.659368 22069 ts_tablet_manager.cc:1434] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.122s	user 0.007s	sys 0.001s
I20260709 13:05:42.595479 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:42.624979 22481 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:05:42.700525 22069 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:42.703099 21916 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:42.703953 22301 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.704289 22301 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.704581 22301 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.630848 22418 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.706797 22067 ts_tablet_manager.cc:1434] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Time spent starting tablet: real 0.184s	user 0.007s	sys 0.002s
I20260709 13:05:42.712529 22071 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:42.715425 22071 ts_tablet_manager.cc:1403] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.742s	user 0.031s	sys 0.075s
I20260709 13:05:42.729171 22301 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.732285 22301 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:42.735234 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:42.736155 22024 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:42.741822 21987 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:42.749127 21869 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 1: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:05:42.738857 22295 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:05:42.777499 22470 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.781001 22069 tablet_bootstrap.cc:654] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.778064 22470 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.785549 22418 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:42.787482 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:42.773550 22479 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.805759 22479 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.831700 22486 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:42.865986 22470 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:42.883306 22491 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:05:42.894976 22024 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:05:42.910045 22479 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:42.911561 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:42.916244 21916 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:05:42.937268 22071 raft_consensus.cc:359] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.938313 22071 raft_consensus.cc:385] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.938699 22071 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.950935 22071 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.954104 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:42.965237 21945 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 1: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:05:42.961625 22493 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.974256 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:05:42.981714 22490 consensus_meta.cc:287] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.528s	user 0.015s	sys 0.018s
I20260709 13:05:42.985451 22071 ts_tablet_manager.cc:1434] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.270s	user 0.001s	sys 0.008s
I20260709 13:05:42.982127 22490 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.014151 22493 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:42.997360 22071 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Bootstrap starting.
I20260709 13:05:42.998016 22516 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:43.002974 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:43.003858 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:43.070448 22019 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 0.
I20260709 13:05:43.073686 21771 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:43.075423 21841 leader_election.cc:343] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:43.085246 22516 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:05:43.093498 22490 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:05:43.094887 21838 leader_election.cc:343] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:43.095491 21838 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:05:43.097258 21838 leader_election.cc:343] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:43.098467 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:43.102748 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:43.092362 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:43.117835 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:43.118456 22021 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.105326 22470 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:05:43.104480 22295 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:43.101500 22490 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:43.130414 21841 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:43.131533 22465 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:43.132048 22465 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.132004 22516 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:43.141609 21987 consensus_peers.cc:597] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:43.142326 21874 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 1: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:05:43.138087 22465 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.192962 22071 tablet_bootstrap.cc:654] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:43.144585 22493 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:43.233315 22475 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.235843 22526 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.092s
I20260709 13:05:43.249704 22021 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:43.251258 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:05:43.253659 22518 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:05:43.267784 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:43.258638 22295 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:43.252591 22475 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.282780 22475 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:43.283509 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:43.287410 21946 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.289052 22295 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:43.325940 22295 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:43.336870 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 117562us
I20260709 13:05:43.347846 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:05:43.422886 22512 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:05:43.433806 22532 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:05:43.452013 22024 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.468586 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:43.490649 22071 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: No bootstrap required, opened a new log
I20260709 13:05:43.491338 22071 ts_tablet_manager.cc:1403] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Time spent bootstrapping tablet: real 0.494s	user 0.050s	sys 0.058s
I20260709 13:05:43.519465 21987 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:43.519234 22071 raft_consensus.cc:359] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.520511 22071 raft_consensus.cc:385] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:43.517516 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 86641.7us
I20260709 13:05:43.520951 22071 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Initialized, Role: FOLLOWER
I20260709 13:05:43.533206 22071 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.521818 22465 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.550829 22465 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:43.557559 22481 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.558085 22481 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.560132 22481 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:43.567711 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:05:43.574332 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:43.575016 21873 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 0.
I20260709 13:05:43.583422 22069 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:43.583948 22069 ts_tablet_manager.cc:1403] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.885s	user 0.052s	sys 0.032s
I20260709 13:05:43.586535 22069 raft_consensus.cc:359] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.587221 22069 raft_consensus.cc:385] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:43.587481 22069 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
W20260709 13:05:43.587939 21987 leader_election.cc:343] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:43.590819 21771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 112) took 1031 ms. Trace:
I20260709 13:05:43.546033 21946 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:43.549154 22071 ts_tablet_manager.cc:1434] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.001s
I20260709 13:05:43.599781 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:43.608734 22526 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:43.609151 22526 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.609491 22526 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.613637 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:05:43.618808 21943 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.607172 21771 rpcz_store.cc:276] 0709 13:05:42.558997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.559131 (+   134us) service_pool.cc:224] Handling call
0709 13:05:43.590762 (+1031631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:43.083397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:43.084204 (+   807us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:43.084253 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:05:43.084278 (+    25us) tablet.cc:662] Decoding operations
0709 13:05:43.090656 (+  6378us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:43.090718 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:43.090745 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:43.090923 (+   178us) tablet.cc:701] Row locks acquired
0709 13:05:43.090942 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:05:43.091090 (+   148us) write_op.cc:270] Start()
0709 13:05:43.091247 (+   157us) write_op.cc:276] Timestamp: P: 1783602343091043 usec, L: 0
0709 13:05:43.091276 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:05:43.091909 (+   633us) log.cc:844] Serialized 534 byte log entry
0709 13:05:43.094156 (+  2247us) op_driver.cc:464] REPLICATION: finished
0709 13:05:43.114077 (+ 19921us) write_op.cc:301] APPLY: starting
0709 13:05:43.119761 (+  5684us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:43.136818 (+ 17057us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:43.145577 (+  8759us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:43.190305 (+ 44728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:43.199353 (+  9048us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:43.199402 (+    49us) write_op.cc:312] APPLY: finished
0709 13:05:43.199632 (+   230us) log.cc:844] Serialized 22 byte log entry
0709 13:05:43.199807 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.199890 (+    83us) write_op.cc:454] Released schema lock
0709 13:05:43.199948 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:43.200340 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.200364 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7598,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":5134,"apply.run_cpu_time_us":1934,"apply.run_wall_time_us":86152,"num_ops":1,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":2963,"prepare.run_wall_time_us":8836,"replication_time_us":2762}]]}
I20260709 13:05:43.626643 22526 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:43.630868 21838 leader_election.cc:343] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:43.635651 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:05:43.636471 21873 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.588025 22069 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.653079 22069 ts_tablet_manager.cc:1434] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.003s
I20260709 13:05:43.654176 22069 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:43.654734 22526 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:43.655354 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:05:43.658483 21987 leader_election.cc:343] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:43.660203 22069 tablet_bootstrap.cc:654] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:43.542862 21916 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:05:43.661278 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 118496us
I20260709 13:05:43.653111 21873 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:05:43.666492 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:05:43.667275 22526 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:43.667793 22526 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:05:43.668694 22526 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:05:43.669544 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 140364us
I20260709 13:05:43.678756 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:05:43.679666 22020 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.702854 22020 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:05:43.633879 21770 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.711668 21770 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.715132 22488 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:43.768136 22546 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:43.775548 22457 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:43.780857 22124 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.788044 21841 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:05:43.788460 21821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:43.789806 22542 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:43.790369 22542 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:05:43.791261 22542 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.803541 22069 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:43.804280 22069 ts_tablet_manager.cc:1403] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.004s
I20260709 13:05:43.823484 22069 raft_consensus.cc:359] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.824297 22069 raft_consensus.cc:385] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:43.824591 22069 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:43.831187 22069 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.833316 22069 ts_tablet_manager.cc:1434] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:05:43.834344 22069 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:43.834043 22124 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:43.860102 22069 tablet_bootstrap.cc:654] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:43.866966 21942 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.866676 21771 catalog_manager.cc:5697] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:43.908946 22069 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:43.909451 22069 ts_tablet_manager.cc:1403] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.033s
I20260709 13:05:43.912007 22069 raft_consensus.cc:359] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.912695 22069 raft_consensus.cc:385] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:43.912977 22069 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:43.913807 22069 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.916054 22069 ts_tablet_manager.cc:1434] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:43.917480 22069 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Bootstrap starting.
I20260709 13:05:43.919936 21772 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.923139 22069 tablet_bootstrap.cc:654] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:43.926174 21770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 110) took 1390 ms. Trace:
I20260709 13:05:43.926576 21770 rpcz_store.cc:276] 0709 13:05:42.535645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.535800 (+   155us) service_pool.cc:224] Handling call
0709 13:05:43.926092 (+1390292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:43.776559 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:43.777137 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:43.777173 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:05:43.777193 (+    20us) tablet.cc:662] Decoding operations
0709 13:05:43.777619 (+   426us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:43.777698 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:43.777726 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:05:43.778035 (+   309us) tablet.cc:701] Row locks acquired
0709 13:05:43.778054 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:05:43.778181 (+   127us) write_op.cc:270] Start()
0709 13:05:43.778299 (+   118us) write_op.cc:276] Timestamp: P: 1783602343778140 usec, L: 0
0709 13:05:43.778322 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:43.778966 (+   644us) log.cc:844] Serialized 916 byte log entry
0709 13:05:43.823037 (+ 44071us) op_driver.cc:464] REPLICATION: finished
0709 13:05:43.827796 (+  4759us) write_op.cc:301] APPLY: starting
0709 13:05:43.827867 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:43.827974 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:43.828078 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:43.828396 (+   318us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:43.828547 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:05:43.828625 (+    78us) write_op.cc:312] APPLY: finished
0709 13:05:43.828830 (+   205us) log.cc:844] Serialized 28 byte log entry
0709 13:05:43.829867 (+  1037us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.829949 (+    82us) write_op.cc:454] Released schema lock
0709 13:05:43.829986 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:43.847599 (+ 17613us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.847629 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21463,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":4546,"apply.run_cpu_time_us":1652,"apply.run_wall_time_us":19773,"num_ops":2,"prepare.queue_time_us":10014,"prepare.run_cpu_time_us":2715,"prepare.run_wall_time_us":2715,"replication_time_us":44587,"thread_start_us":14030,"threads_started":2}]]}
I20260709 13:05:43.932758 22069 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: No bootstrap required, opened a new log
I20260709 13:05:43.933296 22069 ts_tablet_manager.cc:1403] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:05:43.936259 22069 raft_consensus.cc:359] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.936975 22069 raft_consensus.cc:385] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:43.937335 22069 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Initialized, Role: FOLLOWER
I20260709 13:05:43.940057 21772 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.944610 21772 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:05:43.946755 22069 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:43.949672 22069 ts_tablet_manager.cc:1434] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:43.961849 21771 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.006754 22542 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:44.016023 22542 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:44.084235 22488 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.084810 22488 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:44.089423 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:44.094890 22488 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:44.096357 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:44.097335 22018 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 1: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:05:44.099121 21916 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:44.099867 22491 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.107699 22491 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:44.131606 22491 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.132179 22491 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:05:44.134982 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:05:44.135481 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:05:44.136562 22457 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:44.136940 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:05:44.137931 22488 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:44.141021 22491 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:44.180039 21943 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.189874 22494 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:44.201246 21949 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.236483 22542 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:44.249154 22522 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:44.380290 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:44.418359 22564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:44.418692 22565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:44.424638 20756 server_base.cc:1061] running on GCE node
W20260709 13:05:44.425099 22567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:44.426774 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:44.427098 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:44.427345 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602344427328 us; error 0 us; skew 500 ppm
I20260709 13:05:44.428186 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:44.442819 20756 webserver.cc:533] Webserver started at http://127.20.69.4:44081/ using document root <none> and password file <none>
I20260709 13:05:44.444506 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:44.444856 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:44.445387 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:44.447082 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-3-root/instance:
uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-56lb"
I20260709 13:05:44.453751 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:05:44.459196 22572 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.460222 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:44.460721 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-3-root
uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
format_stamp: "Formatted at 2026-07-09 13:05:44 on dist-test-slave-56lb"
I20260709 13:05:44.461181 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:44.484124 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:44.486148 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:44.488224 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:44.491705 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:44.491994 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.492331 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:44.492565 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:44.658210 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.4:41571
I20260709 13:05:44.658481 22634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.4:41571 every 8 connection(s)
I20260709 13:05:44.678231 20756 auto_leader_rebalancer-test.cc:384] add a tserver: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:44.720280 22635 heartbeater.cc:344] Connected to a master server at 127.20.69.62:45563
I20260709 13:05:44.720772 22635 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:44.721772 22635 heartbeater.cc:507] Master 127.20.69.62:45563 requested a full tablet report, sending...
I20260709 13:05:44.724090 21772 ts_manager.cc:194] Registered new tserver with Master: bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:05:44.725976 21772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52560
I20260709 13:05:44.882774 21875 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:44.891340 22019 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:44.892452 21943 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:44.894584 22479 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.895912 22542 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:44.944361 22479 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:44.974581 21772 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.969846 21943 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:44.991737 22019 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
W20260709 13:05:45.005378 21839 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8f816617b58480bad6550570b514d80. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.176214 21949 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:45.184994 22021 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.188166 21875 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.190111 22124 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.191637 22652 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.209997 22652 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:45.216794 21875 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:45.231300 21949 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:45.255492 22023 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.260572 22488 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:45.272253 21914 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7a6203a9eab4b71b33f702b49f0945f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:45.293254 21874 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:45.301071 21770 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.304875 22124 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.309302 22018 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
W20260709 13:05:46.021189 21915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.010s
W20260709 13:05:46.022329 21915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.010s
I20260709 13:05:46.065636 22635 heartbeater.cc:499] Master 127.20.69.62:45563 was elected leader, sending a full tablet report...
W20260709 13:05:46.073691 21914 consensus_peers.cc:597] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8f8c3db69fa448a9f5e5d132c33b414. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:46.149302 21875 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.931s	user 0.021s	sys 0.005s
W20260709 13:05:46.150321 22018 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.010s
W20260709 13:05:46.197005 22023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.017s	sys 0.013s
W20260709 13:05:46.209988 22023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.017s	sys 0.013s
I20260709 13:05:46.225335 22665 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:46.242823 22023 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:46.247417 21869 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:46.248498 22665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35474 (request call id 1) took 1019 ms. Trace:
I20260709 13:05:46.249045 22665 rpcz_store.cc:276] 0709 13:05:45.228893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.229043 (+   150us) service_pool.cc:224] Handling call
0709 13:05:45.237652 (+  8609us) log.cc:844] Serialized 492 byte log entry
0709 13:05:46.248383 (+1010731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1332,"raft.queue_time_us":2458,"raft.run_cpu_time_us":1706,"raft.run_wall_time_us":1727,"spinlock_wait_cycles":211968,"thread_start_us":12571,"threads_started":1,"wal-append.queue_time_us":11016}
I20260709 13:05:46.279448 22674 ts_tablet_manager.cc:933] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:46.281769 22676 ts_tablet_manager.cc:933] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:46.287071 22675 ts_tablet_manager.cc:933] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:46.293251 22675 tablet_copy_client.cc:323] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:05:46.296818 21772 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.308430 22674 tablet_copy_client.cc:323] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:05:46.313778 22023 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:46.316149 22676 tablet_copy_client.cc:323] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:05:46.355298 21885 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet e8f816617b58480bad6550570b514d80 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
W20260709 13:05:46.357062 21896 debug-util.cc:398] Leaking SignalData structure 0x7b080015a100 after lost signal to thread 20759
W20260709 13:05:46.373204 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08000937c0 after lost signal to thread 21807
I20260709 13:05:46.372673 21885 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet e8f816617b58480bad6550570b514d80 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-e8f816617b58480bad6550570b514d80
I20260709 13:05:46.376823 21960 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet f8f8c3db69fa448a9f5e5d132c33b414 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:05:46.378119 21959 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet b7a6203a9eab4b71b33f702b49f0945f from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:05:46.378278 21960 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet f8f8c3db69fa448a9f5e5d132c33b414 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-f8f8c3db69fa448a9f5e5d132c33b414
I20260709 13:05:46.376312 21869 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:46.381511 21943 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:46.380303 21959 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet b7a6203a9eab4b71b33f702b49f0945f from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-b7a6203a9eab4b71b33f702b49f0945f
I20260709 13:05:46.385399 22663 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:46.387897 22671 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:46.394362 21885 tablet_copy_source_session.cc:215] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:46.409468 22674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f816617b58480bad6550570b514d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.407022 21960 tablet_copy_source_session.cc:215] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:46.433454 21959 tablet_copy_source_session.cc:215] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:05:46.441150 21988 consensus_peers.cc:597] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f2be7847b8c4a19be52a47f4a860ceb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:46.443842 22676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a6203a9eab4b71b33f702b49f0945f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.448773 22671 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:46.459705 22675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f8c3db69fa448a9f5e5d132c33b414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.467051 21943 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:46.489781 21869 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:46.533962 22674 tablet_copy_client.cc:806] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:46.534716 22674 tablet_copy_client.cc:670] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:46.545764 22675 tablet_copy_client.cc:806] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:46.546566 22674 tablet_copy_client.cc:538] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:46.546579 22675 tablet_copy_client.cc:670] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:46.552650 22675 tablet_copy_client.cc:538] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:46.562354 22676 tablet_copy_client.cc:806] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:46.563045 22676 tablet_copy_client.cc:670] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:46.575021 22675 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:46.575296 22674 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:46.576295 22676 tablet_copy_client.cc:538] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:46.626286 22676 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:46.662305 21770 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.741071 22697 ts_tablet_manager.cc:933] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:46.747387 22675 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:46.748662 22675 tablet_bootstrap.cc:492] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:46.749606 22675 ts_tablet_manager.cc:1403] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.013s
I20260709 13:05:46.754182 22697 tablet_copy_client.cc:323] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:05:46.755134 22675 raft_consensus.cc:359] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:46.766467 22675 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:46.767870 22675 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:46.773474 22034 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 2f2be7847b8c4a19be52a47f4a860ceb from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:05:46.774340 22034 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 2f2be7847b8c4a19be52a47f4a860ceb from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-2f2be7847b8c4a19be52a47f4a860ceb
I20260709 13:05:46.790313 22676 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:46.791436 22676 tablet_bootstrap.cc:492] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:46.792132 22676 ts_tablet_manager.cc:1403] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.166s	user 0.001s	sys 0.022s
I20260709 13:05:46.792893 22034 tablet_copy_source_session.cc:215] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:46.815768 22697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2be7847b8c4a19be52a47f4a860ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:46.820254 22674 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:46.821847 22674 tablet_bootstrap.cc:492] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:46.822535 22674 ts_tablet_manager.cc:1403] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.247s	user 0.030s	sys 0.007s
I20260709 13:05:46.828100 22675 ts_tablet_manager.cc:1434] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.078s	user 0.016s	sys 0.026s
I20260709 13:05:46.828860 22674 raft_consensus.cc:359] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:46.831219 21960 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-f8f8c3db69fa448a9f5e5d132c33b414 received from {username='slave'} at 127.0.0.1:35490
I20260709 13:05:46.831784 21960 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-f8f8c3db69fa448a9f5e5d132c33b414 on tablet f8f8c3db69fa448a9f5e5d132c33b414 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:46.825814 22676 raft_consensus.cc:359] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:46.835788 22676 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:46.836424 22676 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:46.835325 22674 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:46.838686 22674 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:46.841692 22676 ts_tablet_manager.cc:1434] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 13:05:46.844035 21960 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-b7a6203a9eab4b71b33f702b49f0945f received from {username='slave'} at 127.0.0.1:35490
I20260709 13:05:46.844540 21960 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-b7a6203a9eab4b71b33f702b49f0945f on tablet b7a6203a9eab4b71b33f702b49f0945f with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:46.862818 22674 ts_tablet_manager.cc:1434] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 13:05:46.874472 21885 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-e8f816617b58480bad6550570b514d80 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:05:46.875032 21885 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-e8f816617b58480bad6550570b514d80 on tablet e8f816617b58480bad6550570b514d80 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:46.884706 22697 tablet_copy_client.cc:806] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:46.885438 22697 tablet_copy_client.cc:670] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:46.894325 22697 tablet_copy_client.cc:538] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:46.907938 22697 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:47.149364 22697 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:47.150311 22697 tablet_bootstrap.cc:492] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:47.150974 22697 ts_tablet_manager.cc:1403] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.243s	user 0.059s	sys 0.127s
I20260709 13:05:47.175540 22697 raft_consensus.cc:359] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:47.176437 22697 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:47.177119 22697 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:47.188500 22610 raft_consensus.cc:1217] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:47.201864 22697 ts_tablet_manager.cc:1434] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 13:05:47.253878 22034 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-2f2be7847b8c4a19be52a47f4a860ceb received from {username='slave'} at 127.0.0.1:60038
I20260709 13:05:47.269274 22034 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-2f2be7847b8c4a19be52a47f4a860ceb on tablet 2f2be7847b8c4a19be52a47f4a860ceb with peer bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:05:47.280877 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 43695.7us
W20260709 13:05:47.282588 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 48160us
W20260709 13:05:47.284431 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44298.2us
W20260709 13:05:47.310310 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 47377.4us
W20260709 13:05:47.320271 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76786.1us
I20260709 13:05:47.334550 22610 raft_consensus.cc:1217] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:47.351781 22610 raft_consensus.cc:1217] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:47.354205 22610 raft_consensus.cc:1217] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:47.722983 22652 raft_consensus.cc:1064] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:47.733067 22652 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:47.736676 22706 raft_consensus.cc:1064] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:47.741303 22706 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:47.771114 22671 raft_consensus.cc:1064] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:47.773774 22671 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:47.779798 22610 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.786072 22021 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.794117 22712 raft_consensus.cc:1064] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:47.800166 21875 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.812391 22652 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.813527 22712 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:47.817788 22709 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.821375 22665 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.822026 21943 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.823972 22705 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.841184 22608 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.842677 22019 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.843422 22609 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.845319 21869 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.847352 22659 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:47.848064 22705 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:47.856616 22659 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:05:47.880156 21869 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.882262 22016 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.857805 22671 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:05:47.924516 21942 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.942430 22707 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:05:47.906762 22652 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:05:47.971747 22661 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:47.978490 22610 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:47.980893 22418 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:05:48.034446 22706 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.037262 22023 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.059917 22704 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.077245 21874 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.116283 21943 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:05:48.135180 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 103296us
I20260709 13:05:48.140349 21871 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.144629 22608 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.150713 21770 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.162367 22709 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.151057 22609 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.173120 22707 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.173635 21772 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.199009 22610 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.205468 22019 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.222420 21875 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.208806 22020 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.217877 22607 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.227759 21942 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.343446 21942 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:48.346498 21770 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.348205 21770 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.370345 22607 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.382272 22731 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.383188 22019 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:48.385365 21875 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:48.390347 22709 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.395212 22609 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.397509 22020 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.399067 22659 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.401366 22607 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.402913 22522 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.406749 21943 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:48.410287 22707 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.412077 22608 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.423921 22610 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.425325 22607 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.425731 22731 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.427752 22710 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.437218 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8f816617b58480bad6550570b514d80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:48.441004 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8f8c3db69fa448a9f5e5d132c33b414 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:48.417588 22020 raft_consensus.cc:2955] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.445350 21943 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.446954 22711 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.446326 22659 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.449515 22019 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.451479 22418 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.458137 22710 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.461038 22021 raft_consensus.cc:2955] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.466804 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7a6203a9eab4b71b33f702b49f0945f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:48.461670 21875 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:48.451999 21772 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.471742 22731 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.460631 22608 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.476009 21942 raft_consensus.cc:2955] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.458772 22609 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.482803 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f2be7847b8c4a19be52a47f4a860ceb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:48.489722 21773 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.497072 21875 raft_consensus.cc:2955] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:48.498809 21771 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.520364 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f816617b58480bad6550570b514d80 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:05:48.523379 22741 tablet_replica.cc:333] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:05:48.525013 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet f8f8c3db69fa448a9f5e5d132c33b414 with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:05:48.526851 22741 raft_consensus.cc:2243] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.529023 22741 raft_consensus.cc:2272] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.540012 21770 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.544196 22742 tablet_replica.cc:333] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:05:48.545663 22742 raft_consensus.cc:2243] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.546525 22742 raft_consensus.cc:2272] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.548316 22741 ts_tablet_manager.cc:1916] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:48.551101 22742 ts_tablet_manager.cc:1916] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:48.555832 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f2be7847b8c4a19be52a47f4a860ceb with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:05:48.559593 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet b7a6203a9eab4b71b33f702b49f0945f with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:05:48.639889 22743 tablet_replica.cc:333] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:05:48.665294 22742 ts_tablet_manager.cc:1929] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:48.676007 22742 log.cc:1199] T f8f8c3db69fa448a9f5e5d132c33b414 P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/f8f8c3db69fa448a9f5e5d132c33b414
I20260709 13:05:48.677258 22741 ts_tablet_manager.cc:1929] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:48.677795 22741 log.cc:1199] T e8f816617b58480bad6550570b514d80 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/e8f816617b58480bad6550570b514d80
I20260709 13:05:48.681191 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet e8f816617b58480bad6550570b514d80 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:48.681787 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet f8f8c3db69fa448a9f5e5d132c33b414 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:48.681794 22742 tablet_replica.cc:333] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:05:48.683152 22742 raft_consensus.cc:2243] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.683949 22742 raft_consensus.cc:2272] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.684746 22743 raft_consensus.cc:2243] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:48.685722 22743 raft_consensus.cc:2272] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:48.687534 22742 ts_tablet_manager.cc:1916] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:48.689536 22743 ts_tablet_manager.cc:1916] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:48.702206 22742 ts_tablet_manager.cc:1929] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:48.702625 22742 log.cc:1199] T 2f2be7847b8c4a19be52a47f4a860ceb P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/2f2be7847b8c4a19be52a47f4a860ceb
I20260709 13:05:48.704111 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet 2f2be7847b8c4a19be52a47f4a860ceb (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:48.719630 22743 ts_tablet_manager.cc:1929] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:48.720243 22743 log.cc:1199] T b7a6203a9eab4b71b33f702b49f0945f P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/b7a6203a9eab4b71b33f702b49f0945f
I20260709 13:05:48.721909 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet b7a6203a9eab4b71b33f702b49f0945f (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:49.670511 22021 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:05:49.679008 21988 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04a8fcd2517b44a4895a7b0ec8966a41. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.683039 21942 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:49.685526 22710 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.686697 21875 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:49.688086 22746 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:49.695379 22710 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.704806 21942 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.734800 21770 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.739652 21875 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.778997 21866 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:05:49.790737 21839 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3fd785266e045ce9ae6bb7160866b9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.803939 22021 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:49.805006 21942 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:49.806465 22707 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.812052 22707 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:49.839051 22418 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.846352 22020 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.846525 21943 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.854655 22021 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:49.860810 21773 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.884583 21943 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:49.886183 22750 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:49.887854 21988 consensus_peers.cc:597] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7baa5a75e229412297990ddc378b6aad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.891173 21866 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:49.892729 22750 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.913103 22710 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.915838 21875 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.916975 21942 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.930351 22021 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:49.939056 21773 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.955632 21942 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:49.958729 22750 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:49.961063 21988 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d092f1c41e747e194d93526c0fad944. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.965225 21875 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:49.967917 22710 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.982861 22710 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.985258 21942 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:49.985948 21875 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:50.007701 21772 catalog_manager.cc:5697] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.086393 22766 ts_tablet_manager.cc:933] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:50.088801 22766 tablet_copy_client.cc:323] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:05:50.090886 22034 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 04a8fcd2517b44a4895a7b0ec8966a41 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:05:50.091460 22034 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 04a8fcd2517b44a4895a7b0ec8966a41 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-04a8fcd2517b44a4895a7b0ec8966a41
I20260709 13:05:50.099047 22034 tablet_copy_source_session.cc:215] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:50.102027 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a8fcd2517b44a4895a7b0ec8966a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.119998 22766 tablet_copy_client.cc:806] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:50.120720 22766 tablet_copy_client.cc:670] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:50.125303 22766 tablet_copy_client.cc:538] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:50.131966 22766 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:50.151657 22766 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:50.152662 22766 tablet_bootstrap.cc:492] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:50.153321 22766 ts_tablet_manager.cc:1403] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.002s
I20260709 13:05:50.156349 22766 raft_consensus.cc:359] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:50.157199 22766 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:50.157868 22766 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:50.161278 22766 ts_tablet_manager.cc:1434] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:05:50.162905 22034 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-04a8fcd2517b44a4895a7b0ec8966a41 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:05:50.163352 22034 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-04a8fcd2517b44a4895a7b0ec8966a41 on tablet 04a8fcd2517b44a4895a7b0ec8966a41 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:50.185639 22766 ts_tablet_manager.cc:933] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:50.187300 22766 tablet_copy_client.cc:323] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:05:50.189198 21885 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet e3fd785266e045ce9ae6bb7160866b9d from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:05:50.189713 21885 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet e3fd785266e045ce9ae6bb7160866b9d from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-e3fd785266e045ce9ae6bb7160866b9d
I20260709 13:05:50.198163 21885 tablet_copy_source_session.cc:215] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:50.201412 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3fd785266e045ce9ae6bb7160866b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.216082 22766 tablet_copy_client.cc:806] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:50.216691 22766 tablet_copy_client.cc:670] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:50.220889 22766 tablet_copy_client.cc:538] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:50.229905 22766 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:50.252911 22766 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:50.253827 22766 tablet_bootstrap.cc:492] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:50.254537 22766 ts_tablet_manager.cc:1403] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:05:50.257382 22766 raft_consensus.cc:359] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:50.258186 22766 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:50.258811 22766 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:50.261165 22766 ts_tablet_manager.cc:1434] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:50.262874 21885 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-e3fd785266e045ce9ae6bb7160866b9d received from {username='slave'} at 127.0.0.1:44780
I20260709 13:05:50.263295 21885 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-e3fd785266e045ce9ae6bb7160866b9d on tablet e3fd785266e045ce9ae6bb7160866b9d with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:50.374596 22766 ts_tablet_manager.cc:933] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:50.376355 22766 tablet_copy_client.cc:323] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:05:50.377924 22034 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 7baa5a75e229412297990ddc378b6aad from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:05:50.378415 22034 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 7baa5a75e229412297990ddc378b6aad from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-7baa5a75e229412297990ddc378b6aad
I20260709 13:05:50.383844 22034 tablet_copy_source_session.cc:215] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:50.386750 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7baa5a75e229412297990ddc378b6aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.401312 22766 tablet_copy_client.cc:806] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:50.401933 22766 tablet_copy_client.cc:670] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:50.407388 22766 tablet_copy_client.cc:538] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:50.413763 22766 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:50.429049 22766 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:50.429829 22766 tablet_bootstrap.cc:492] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:50.430401 22766 ts_tablet_manager.cc:1403] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:05:50.432991 22766 raft_consensus.cc:359] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:50.433552 22766 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:50.434012 22766 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:50.435787 22766 ts_tablet_manager.cc:1434] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:05:50.438310 22034 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-7baa5a75e229412297990ddc378b6aad received from {username='slave'} at 127.0.0.1:60038
I20260709 13:05:50.438730 22034 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-7baa5a75e229412297990ddc378b6aad on tablet 7baa5a75e229412297990ddc378b6aad with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:50.463438 22609 raft_consensus.cc:1217] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:50.532829 22766 ts_tablet_manager.cc:933] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:50.534487 22766 tablet_copy_client.cc:323] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:05:50.536118 22034 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 5d092f1c41e747e194d93526c0fad944 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:05:50.536720 22034 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 5d092f1c41e747e194d93526c0fad944 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-5d092f1c41e747e194d93526c0fad944
I20260709 13:05:50.545249 22034 tablet_copy_source_session.cc:215] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:50.548302 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d092f1c41e747e194d93526c0fad944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:50.573731 22766 tablet_copy_client.cc:806] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:50.574604 22766 tablet_copy_client.cc:670] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:50.577932 22766 tablet_copy_client.cc:538] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:50.587723 22766 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:50.611637 22766 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:50.612357 22766 tablet_bootstrap.cc:492] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:50.613094 22766 ts_tablet_manager.cc:1403] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:05:50.615605 22766 raft_consensus.cc:359] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:50.616227 22766 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:50.616740 22766 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:50.618978 22766 ts_tablet_manager.cc:1434] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:50.620877 22034 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-5d092f1c41e747e194d93526c0fad944 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:05:50.621297 22034 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-5d092f1c41e747e194d93526c0fad944 on tablet 5d092f1c41e747e194d93526c0fad944 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:50.791605 22609 raft_consensus.cc:1217] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:50.804318 22609 raft_consensus.cc:1217] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:50.846998 22749 raft_consensus.cc:1064] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:50.855724 22749 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:50.880270 21942 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.881201 22609 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.883102 22746 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.892177 22710 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.894403 21866 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:50.898052 22746 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.915397 22777 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:50.917721 21943 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:50.933291 22609 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:50.939762 21772 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.945005 21866 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:50.984114 22020 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:50.993928 21866 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.994863 22609 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:50.995755 22777 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:50.996793 22750 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:51.005613 22749 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.017544 21866 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.017616 22609 raft_consensus.cc:2955] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.023495 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04a8fcd2517b44a4895a7b0ec8966a41 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:51.035840 21771 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.054396 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet 04a8fcd2517b44a4895a7b0ec8966a41 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:05:51.071520 22786 tablet_replica.cc:333] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:05:51.072827 22786 raft_consensus.cc:2243] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.074544 22786 raft_consensus.cc:2272] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.078833 22786 ts_tablet_manager.cc:1916] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:51.083446 22609 raft_consensus.cc:1217] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:51.109781 22786 ts_tablet_manager.cc:1929] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:51.110301 22786 log.cc:1199] T 04a8fcd2517b44a4895a7b0ec8966a41 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/04a8fcd2517b44a4895a7b0ec8966a41
I20260709 13:05:51.111707 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet 04a8fcd2517b44a4895a7b0ec8966a41 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:51.325223 22418 raft_consensus.cc:1064] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:51.327373 22418 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:51.339524 22609 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.341100 22418 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.341531 21942 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.341835 22020 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.343195 22759 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.349921 22418 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.358762 22759 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.374800 22609 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.384507 21771 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.389457 22749 raft_consensus.cc:1064] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:51.391987 22749 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:51.424585 21943 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.427024 22020 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.508424 21875 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:51.541946 22608 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:51.549413 22790 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:51.556645 21875 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.556344 22608 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.560154 21946 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.561568 21943 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:51.562829 22777 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.564728 22746 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.560173 22759 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.571399 22608 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.572139 22750 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.577437 22790 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:51.586232 21773 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.591423 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3fd785266e045ce9ae6bb7160866b9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:51.594698 21946 raft_consensus.cc:2955] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.599820 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet e3fd785266e045ce9ae6bb7160866b9d with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:05:51.635046 22750 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.637670 22798 tablet_replica.cc:333] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:05:51.640743 22798 raft_consensus.cc:2243] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.641525 22798 raft_consensus.cc:2272] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.638422 21866 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.644613 22609 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.650147 22798 ts_tablet_manager.cc:1916] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:51.663396 22749 raft_consensus.cc:1064] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:51.666147 22749 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:51.670837 21773 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.679982 21942 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.706840 22798 ts_tablet_manager.cc:1929] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:51.707376 22798 log.cc:1199] T e3fd785266e045ce9ae6bb7160866b9d P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/e3fd785266e045ce9ae6bb7160866b9d
I20260709 13:05:51.709422 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet e3fd785266e045ce9ae6bb7160866b9d (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:51.712244 22023 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:51.721029 21942 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.722786 22749 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.723500 22609 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.724175 21866 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:51.727797 22746 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.728669 22750 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:51.733383 21942 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:51.735107 22609 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:51.736773 22746 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:51.739436 22778 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:51.756026 22750 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.762509 22609 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.765610 21942 raft_consensus.cc:2955] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.765925 22777 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.773265 21946 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.785553 21875 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.793174 21771 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.797465 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7baa5a75e229412297990ddc378b6aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:51.810931 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet 7baa5a75e229412297990ddc378b6aad with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:05:51.817778 21772 catalog_manager.cc:5697] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.818836 22803 tablet_replica.cc:333] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:05:51.820114 22803 raft_consensus.cc:2243] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.822630 22609 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.829507 22803 raft_consensus.cc:2272] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.837875 22803 ts_tablet_manager.cc:1916] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:51.846706 22023 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:51.853169 22609 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:51.854168 21866 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:51.854552 22777 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:51.855609 22750 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:51.860077 22803 ts_tablet_manager.cc:1929] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:51.860646 22803 log.cc:1199] T 7baa5a75e229412297990ddc378b6aad P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/7baa5a75e229412297990ddc378b6aad
I20260709 13:05:51.862195 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet 7baa5a75e229412297990ddc378b6aad (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:51.863519 22749 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.865178 21866 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.866132 22609 raft_consensus.cc:2955] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.873934 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d092f1c41e747e194d93526c0fad944 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:51.879848 21771 catalog_manager.cc:5697] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:51.891887 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d092f1c41e747e194d93526c0fad944 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:05:51.901700 22804 tablet_replica.cc:333] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:05:51.902585 22804 raft_consensus.cc:2243] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.903478 22804 raft_consensus.cc:2272] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.906569 22804 ts_tablet_manager.cc:1916] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:51.918059 22804 ts_tablet_manager.cc:1929] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:51.918473 22804 log.cc:1199] T 5d092f1c41e747e194d93526c0fad944 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/5d092f1c41e747e194d93526c0fad944
I20260709 13:05:51.919773 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet 5d092f1c41e747e194d93526c0fad944 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:52.966615 21866 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:05:52.972873 21839 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5af1794ba4454baf843df541f302e8e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:52.973341 21942 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:52.973632 22020 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:52.974879 22806 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.976076 22790 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.984915 22790 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:52.986709 22020 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:52.988989 21942 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:52.998978 21946 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.007149 21770 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
W20260709 13:05:53.016073 21914 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c93691583c1413ca9d0cb9e64fbd7cd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.016134 21866 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:53.017630 22794 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.017922 22023 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:53.026468 22709 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.046344 22709 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.053921 21866 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.077349 22020 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.085173 22023 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.092489 21772 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
W20260709 13:05:53.117743 21988 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b7ba79f0d534cbba2170f41c42625e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.118131 21866 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:53.118227 21946 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:53.119799 22777 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.120683 22746 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.129504 22746 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.134418 21946 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.134562 21875 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.146368 22020 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.150362 21772 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:53.157671 21988 consensus_peers.cc:597] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 866936931060464d858e0e11cefba859. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.159410 21875 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:53.160591 21949 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:53.162228 22746 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.165313 22777 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.177966 21875 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.176695 22821 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.189520 21942 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.194046 21772 catalog_manager.cc:5697] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:53.451500 22825 ts_tablet_manager.cc:933] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:53.453738 22825 tablet_copy_client.cc:323] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:05:53.455331 21885 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet 5af1794ba4454baf843df541f302e8e0 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:05:53.455853 21885 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet 5af1794ba4454baf843df541f302e8e0 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-5af1794ba4454baf843df541f302e8e0
I20260709 13:05:53.461021 21885 tablet_copy_source_session.cc:215] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:53.464305 22825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af1794ba4454baf843df541f302e8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.471882 22827 ts_tablet_manager.cc:933] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:53.477972 22827 tablet_copy_client.cc:323] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:05:53.479853 21960 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet 6c93691583c1413ca9d0cb9e64fbd7cd from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:05:53.480335 21960 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet 6c93691583c1413ca9d0cb9e64fbd7cd from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-6c93691583c1413ca9d0cb9e64fbd7cd
I20260709 13:05:53.482717 22825 tablet_copy_client.cc:806] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:53.483364 22825 tablet_copy_client.cc:670] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:53.488485 21960 tablet_copy_source_session.cc:215] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:53.492950 22825 tablet_copy_client.cc:538] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:53.495846 22827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c93691583c1413ca9d0cb9e64fbd7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.502635 22825 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:53.510891 22827 tablet_copy_client.cc:806] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:53.512180 22827 tablet_copy_client.cc:670] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:53.516422 22827 tablet_copy_client.cc:538] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:53.525982 22827 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:53.531188 22825 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:53.532193 22825 tablet_bootstrap.cc:492] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:53.532896 22825 ts_tablet_manager.cc:1403] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.016s
I20260709 13:05:53.542176 22825 raft_consensus.cc:359] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.543200 22825 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:53.544359 22825 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.557667 22825 ts_tablet_manager.cc:1434] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:05:53.561362 21885 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-5af1794ba4454baf843df541f302e8e0 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:05:53.561793 21885 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-5af1794ba4454baf843df541f302e8e0 on tablet 5af1794ba4454baf843df541f302e8e0 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:53.569785 22827 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:53.570676 22827 tablet_bootstrap.cc:492] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:53.571235 22827 ts_tablet_manager.cc:1403] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.004s
I20260709 13:05:53.573539 22827 raft_consensus.cc:359] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.574150 22827 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:53.574651 22827 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.576792 22827 ts_tablet_manager.cc:1434] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:05:53.578472 21960 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-6c93691583c1413ca9d0cb9e64fbd7cd received from {username='slave'} at 127.0.0.1:35490
I20260709 13:05:53.578884 21960 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-6c93691583c1413ca9d0cb9e64fbd7cd on tablet 6c93691583c1413ca9d0cb9e64fbd7cd with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:53.598254 22827 ts_tablet_manager.cc:933] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:53.602967 22825 ts_tablet_manager.cc:933] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:05:53.604502 22827 tablet_copy_client.cc:323] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:05:53.605814 22825 tablet_copy_client.cc:323] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:05:53.606366 22034 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 866936931060464d858e0e11cefba859 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:05:53.607656 22034 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 866936931060464d858e0e11cefba859 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-866936931060464d858e0e11cefba859
I20260709 13:05:53.611408 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 1b7ba79f0d534cbba2170f41c42625e6 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:05:53.611984 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 1b7ba79f0d534cbba2170f41c42625e6 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-1b7ba79f0d534cbba2170f41c42625e6
I20260709 13:05:53.615316 22034 tablet_copy_source_session.cc:215] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:53.622911 22827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866936931060464d858e0e11cefba859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.624542 22033 tablet_copy_source_session.cc:215] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:53.628151 22825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b7ba79f0d534cbba2170f41c42625e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.640547 22827 tablet_copy_client.cc:806] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:53.641134 22827 tablet_copy_client.cc:670] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:53.644990 22827 tablet_copy_client.cc:538] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:53.653944 22827 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:53.654729 22825 tablet_copy_client.cc:806] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:53.655397 22825 tablet_copy_client.cc:670] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:53.661681 22825 tablet_copy_client.cc:538] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:53.672279 22825 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:53.683346 22827 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:53.684245 22827 tablet_bootstrap.cc:492] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:53.684947 22827 ts_tablet_manager.cc:1403] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 13:05:53.688630 22827 raft_consensus.cc:359] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.689441 22827 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:53.690153 22827 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.697256 22827 ts_tablet_manager.cc:1434] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:05:53.701926 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-866936931060464d858e0e11cefba859 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:05:53.702410 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-866936931060464d858e0e11cefba859 on tablet 866936931060464d858e0e11cefba859 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:53.707530 22825 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:53.708417 22825 tablet_bootstrap.cc:492] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:53.709326 22825 ts_tablet_manager.cc:1403] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.037s	user 0.031s	sys 0.000s
I20260709 13:05:53.713341 22825 raft_consensus.cc:359] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.714172 22825 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:53.714821 22825 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:53.717021 22825 ts_tablet_manager.cc:1434] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:53.719203 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-1b7ba79f0d534cbba2170f41c42625e6 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:05:53.719612 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-1b7ba79f0d534cbba2170f41c42625e6 on tablet 1b7ba79f0d534cbba2170f41c42625e6 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:53.969095 22608 raft_consensus.cc:1217] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:53.979511 22608 raft_consensus.cc:1217] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:54.085937 22608 raft_consensus.cc:1217] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:54.190788 22608 raft_consensus.cc:1217] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:54.418778 22816 raft_consensus.cc:1064] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:54.420713 22816 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:54.427057 22020 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.427558 22608 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.428151 21875 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.429457 22816 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.431349 22709 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.432098 22793 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.448056 22836 raft_consensus.cc:1064] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:54.463168 22836 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:54.463894 22709 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.469703 21875 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.478320 22746 raft_consensus.cc:1064] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:54.480574 22746 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:54.485445 22609 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.514621 21772 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.515453 22023 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:05:54.604920 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 84690.1us
I20260709 13:05:54.614475 22609 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.614879 22608 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.616161 22759 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:54.618461 22020 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.623425 22837 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.631027 21866 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.636401 22848 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:54.637907 21949 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.639827 22821 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.640810 22850 raft_consensus.cc:1064] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:54.643671 22850 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:54.645579 22851 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:54.685127 21942 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.689728 22806 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.698236 22853 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.703760 21942 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.709434 22855 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:54.710242 22607 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.714022 21866 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:54.714253 22607 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.716888 22759 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.730541 22607 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.734762 21771 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.736515 22855 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:54.744679 21942 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:54.750170 21873 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.754943 22021 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.766774 21943 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.776440 22855 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:54.772070 21770 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.786513 21949 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.811021 21873 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:54.822772 22023 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:54.826381 22609 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:54.831171 22816 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:54.834710 21866 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:54.835884 22608 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:54.837525 22849 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:54.838732 22840 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:54.842619 21867 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:54.844578 22608 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:54.840837 22840 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.847375 22610 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.849045 22855 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:54.849581 22848 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.852454 22855 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:54.855504 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c93691583c1413ca9d0cb9e64fbd7cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:54.861466 22746 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.861515 22821 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.863970 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5af1794ba4454baf843df541f302e8e0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:54.863237 22607 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.869823 21942 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:54.878777 22848 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:54.879338 21942 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.884685 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b7ba79f0d534cbba2170f41c42625e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:54.882072 21873 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.882457 21869 raft_consensus.cc:2955] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.895382 21768 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.899605 22607 raft_consensus.cc:2955] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.903715 21772 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.887593 22610 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.895965 21949 raft_consensus.cc:2955] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.905292 21869 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.929181 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b7ba79f0d534cbba2170f41c42625e6 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:05:54.931757 22866 tablet_replica.cc:333] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:05:54.933670 22866 raft_consensus.cc:2243] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:54.934392 22866 raft_consensus.cc:2272] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:54.939599 22866 ts_tablet_manager.cc:1916] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:54.943118 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af1794ba4454baf843df541f302e8e0 with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:05:54.959559 21771 catalog_manager.cc:5697] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.962059 22867 tablet_replica.cc:333] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:05:54.963292 22867 raft_consensus.cc:2243] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:54.964123 22867 raft_consensus.cc:2272] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:54.967073 22867 ts_tablet_manager.cc:1916] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:54.971418 22866 ts_tablet_manager.cc:1929] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:54.971985 22866 log.cc:1199] T 1b7ba79f0d534cbba2170f41c42625e6 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/1b7ba79f0d534cbba2170f41c42625e6
I20260709 13:05:54.976171 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet 1b7ba79f0d534cbba2170f41c42625e6 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:54.978458 21772 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:54.985090 22867 ts_tablet_manager.cc:1929] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:54.985705 22867 log.cc:1199] T 5af1794ba4454baf843df541f302e8e0 P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/5af1794ba4454baf843df541f302e8e0
I20260709 13:05:54.979341 22023 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:54.989113 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet 5af1794ba4454baf843df541f302e8e0 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:54.996704 21949 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:54.999926 22607 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:55.000663 22746 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:55.003023 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c93691583c1413ca9d0cb9e64fbd7cd with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:05:55.003321 22821 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:55.006153 22867 tablet_replica.cc:333] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:05:55.007216 22867 raft_consensus.cc:2243] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.007898 22867 raft_consensus.cc:2272] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.007334 22853 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:55.012084 22867 ts_tablet_manager.cc:1916] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:55.014256 21949 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:55.021474 22610 raft_consensus.cc:2955] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:55.032538 22867 ts_tablet_manager.cc:1929] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:55.033120 22867 log.cc:1199] T 6c93691583c1413ca9d0cb9e64fbd7cd P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/6c93691583c1413ca9d0cb9e64fbd7cd
I20260709 13:05:55.039499 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 866936931060464d858e0e11cefba859 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:55.040294 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet 6c93691583c1413ca9d0cb9e64fbd7cd (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:55.043596 21773 catalog_manager.cc:5697] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.061007 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet 866936931060464d858e0e11cefba859 with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:05:55.063308 22868 tablet_replica.cc:333] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:05:55.064400 22868 raft_consensus.cc:2243] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.065127 22868 raft_consensus.cc:2272] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.070289 22868 ts_tablet_manager.cc:1916] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:55.086414 22868 ts_tablet_manager.cc:1929] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:55.086745 22868 log.cc:1199] T 866936931060464d858e0e11cefba859 P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/866936931060464d858e0e11cefba859
I20260709 13:05:55.088141 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet 866936931060464d858e0e11cefba859 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:56.133934 21873 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.140096 21943 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:56.140336 22023 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:56.140903 21839 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d9daa6d16d543f0a8cb8b3d482b3d80. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.141934 22849 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.142864 22869 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.152061 22872 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.153515 22021 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.158067 21943 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.169266 21942 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.170907 21772 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:56.201412 21914 consensus_peers.cc:597] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82fae287aad247d99c33e1a07c6e82a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.214864 21869 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:56.216423 22878 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.222886 22021 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:56.228426 22878 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:56.246837 21869 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.251381 22021 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.254357 22870 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.274801 21869 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.276110 21772 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
W20260709 13:05:56.305742 21839 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23093b4e74d34b3d87ab577135fa1517. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.306955 22023 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:56.308921 22849 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.311026 21943 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:56.312711 22872 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:56.320175 22872 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.322718 22021 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.327095 21943 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.340922 21869 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.342284 21772 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.354664 22021 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:56.354980 21839 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b83eb73076f949419556cb7ef3746784. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.356284 21943 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:56.356259 22872 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:56.362608 22849 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:56.365760 22849 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.367548 22021 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.378604 21943 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:56.392990 21768 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.699874 22892 ts_tablet_manager.cc:933] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:05:56.702416 22892 tablet_copy_client.cc:323] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:05:56.704077 21960 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet 82fae287aad247d99c33e1a07c6e82a3 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:05:56.704641 21960 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet 82fae287aad247d99c33e1a07c6e82a3 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-82fae287aad247d99c33e1a07c6e82a3
I20260709 13:05:56.707214 22894 ts_tablet_manager.cc:933] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:56.714716 21960 tablet_copy_source_session.cc:215] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:56.715673 22894 tablet_copy_client.cc:323] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:05:56.717420 21885 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:05:56.717952 21885 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-0d9daa6d16d543f0a8cb8b3d482b3d80
I20260709 13:05:56.718427 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fae287aad247d99c33e1a07c6e82a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.732643 21885 tablet_copy_source_session.cc:215] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:56.736166 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.737259 22892 tablet_copy_client.cc:806] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:56.737934 22892 tablet_copy_client.cc:670] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:56.744433 22892 tablet_copy_client.cc:538] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:56.754042 22892 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:56.762179 22894 tablet_copy_client.cc:806] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:56.763432 22894 tablet_copy_client.cc:670] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:56.769106 22894 tablet_copy_client.cc:538] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:56.794777 22894 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:56.799204 22897 ts_tablet_manager.cc:933] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:56.827252 22898 ts_tablet_manager.cc:933] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:05:56.865617 22898 tablet_copy_client.cc:323] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:05:56.870975 21885 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet 23093b4e74d34b3d87ab577135fa1517 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:05:56.871793 21885 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet 23093b4e74d34b3d87ab577135fa1517 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-23093b4e74d34b3d87ab577135fa1517
I20260709 13:05:56.886175 22897 tablet_copy_client.cc:323] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:05:56.888581 21884 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet b83eb73076f949419556cb7ef3746784 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:05:56.889243 21884 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet b83eb73076f949419556cb7ef3746784 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-b83eb73076f949419556cb7ef3746784
I20260709 13:05:56.898339 21884 tablet_copy_source_session.cc:215] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:56.903395 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83eb73076f949419556cb7ef3746784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.905772 22892 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:56.906769 22892 tablet_bootstrap.cc:492] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:56.907774 22892 ts_tablet_manager.cc:1403] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.154s	user 0.053s	sys 0.019s
I20260709 13:05:56.910840 22892 raft_consensus.cc:359] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.906783 21885 tablet_copy_source_session.cc:215] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:56.912827 22892 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:56.913553 22892 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.915206 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23093b4e74d34b3d87ab577135fa1517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.924444 22894 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:56.924921 22892 ts_tablet_manager.cc:1434] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.005s
I20260709 13:05:56.926204 22894 tablet_bootstrap.cc:492] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:56.927273 22894 ts_tablet_manager.cc:1403] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.133s	user 0.025s	sys 0.022s
I20260709 13:05:56.928726 21960 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-82fae287aad247d99c33e1a07c6e82a3 received from {username='slave'} at 127.0.0.1:35490
I20260709 13:05:56.929170 21960 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-82fae287aad247d99c33e1a07c6e82a3 on tablet 82fae287aad247d99c33e1a07c6e82a3 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:56.933060 22894 raft_consensus.cc:359] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.933773 22894 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:56.934508 22894 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.937310 22894 ts_tablet_manager.cc:1434] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:56.939616 21885 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-0d9daa6d16d543f0a8cb8b3d482b3d80 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:05:56.940117 21885 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-0d9daa6d16d543f0a8cb8b3d482b3d80 on tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:56.941926 22898 tablet_copy_client.cc:806] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:56.942562 22898 tablet_copy_client.cc:670] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:56.946913 22898 tablet_copy_client.cc:538] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:56.951685 22897 tablet_copy_client.cc:806] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:56.952378 22897 tablet_copy_client.cc:670] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:56.955809 22898 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:56.957664 22897 tablet_copy_client.cc:538] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:56.966573 22897 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:05:56.978802 22898 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:56.979820 22898 tablet_bootstrap.cc:492] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:56.980556 22898 ts_tablet_manager.cc:1403] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.025s	user 0.025s	sys 0.000s
I20260709 13:05:56.983958 22898 raft_consensus.cc:359] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.984882 22898 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:56.985520 22898 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.992028 22897 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:56.993109 22897 tablet_bootstrap.cc:492] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:05:56.993911 22897 ts_tablet_manager.cc:1403] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.005s
I20260709 13:05:56.995188 22898 ts_tablet_manager.cc:1434] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:56.997123 22897 raft_consensus.cc:359] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:56.999262 22897 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:05:57.001960 21885 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-23093b4e74d34b3d87ab577135fa1517 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:05:57.000134 22897 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:57.002439 21885 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-23093b4e74d34b3d87ab577135fa1517 on tablet 23093b4e74d34b3d87ab577135fa1517 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:57.006723 22897 ts_tablet_manager.cc:1434] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:57.010617 21885 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-b83eb73076f949419556cb7ef3746784 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:05:57.011202 21885 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-b83eb73076f949419556cb7ef3746784 on tablet b83eb73076f949419556cb7ef3746784 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:05:57.102771 22610 raft_consensus.cc:1217] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:57.206219 22610 raft_consensus.cc:1217] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:57.219465 22610 raft_consensus.cc:1217] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:57.369747 22610 raft_consensus.cc:1217] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:57.596356 22872 raft_consensus.cc:1064] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:57.624191 22872 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:57.651561 22610 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:57.653604 22908 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:57.657289 22023 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:57.659613 22891 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:57.663089 21943 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:57.667483 22872 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:57.741325 22891 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:57.776199 22023 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:57.784441 22909 raft_consensus.cc:1064] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:57.799122 21949 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:57.812829 22908 raft_consensus.cc:1064] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:57.788457 22909 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:57.829461 21773 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:57.854259 22908 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:05:57.883435 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45964.1us
W20260709 13:05:57.884109 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61107us
I20260709 13:05:57.913157 22607 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:57.919651 22610 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:57.922395 22924 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:57.944583 22919 raft_consensus.cc:1064] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:05:57.958653 22023 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:05:57.963048 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 60453.3us
I20260709 13:05:57.966553 22609 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:57.970541 21869 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:57.973683 21949 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:57.962432 22872 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:05:57.978158 22870 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:57.980280 22909 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:57.981776 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 75570.7us
I20260709 13:05:57.985042 22924 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:57.998315 22023 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:58.023314 22919 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:58.042234 22924 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.057981 22610 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:58.060411 22923 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:58.060487 22023 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.069386 22016 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:58.075198 22872 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:58.083328 22609 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.097072 21949 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.102214 21943 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:58.117616 22926 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:58.125108 22923 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:58.135371 22872 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.143325 22926 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.148685 22023 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.152424 22019 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.165299 21869 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.202119 22610 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.213636 21949 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.228518 21768 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.237337 21768 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.251871 22610 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.256584 21771 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.282313 21869 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:58.287662 22610 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:58.289918 21869 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:58.290254 21949 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:58.291724 21943 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:58.291550 22872 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:58.296479 22023 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:58.298355 22923 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:58.298944 22870 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:58.299806 22607 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:58.302428 22927 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:58.313561 22909 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.315750 22019 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.328925 22607 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:58.336515 22872 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:58.327517 21871 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:05:58.345307 22023 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:58.349659 22923 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:58.354533 22922 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.356010 22908 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.357303 22609 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:58.360574 22608 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.368901 22020 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:58.371410 22924 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:58.380585 22919 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.388871 22891 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:58.394331 22607 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.396589 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82fae287aad247d99c33e1a07c6e82a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:58.394800 22609 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.394189 21773 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.408434 21949 raft_consensus.cc:2955] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.410142 21768 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.417006 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet 82fae287aad247d99c33e1a07c6e82a3 with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:05:58.416944 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b83eb73076f949419556cb7ef3746784 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:58.424201 22019 raft_consensus.cc:2955] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.424904 21772 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.430698 22023 raft_consensus.cc:2955] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.435819 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:58.436651 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 23093b4e74d34b3d87ab577135fa1517 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:58.433390 22607 raft_consensus.cc:2955] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.448956 22943 tablet_replica.cc:333] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:05:58.452168 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet b83eb73076f949419556cb7ef3746784 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:05:58.469871 21935 tablet_service.cc:1558] Processing DeleteTablet for tablet 23093b4e74d34b3d87ab577135fa1517 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:05:58.534269 22943 raft_consensus.cc:2243] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.537850 22943 raft_consensus.cc:2272] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:58.544849 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 46888.2us
I20260709 13:05:58.551170 22943 ts_tablet_manager.cc:1916] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:58.553141 22945 tablet_replica.cc:333] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:05:58.578598 21768 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:05:58.601400 22945 raft_consensus.cc:2243] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.602236 22945 raft_consensus.cc:2272] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.606207 22945 ts_tablet_manager.cc:1916] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:58.614104 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:05:58.621012 22950 tablet_replica.cc:333] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:05:58.622114 22945 ts_tablet_manager.cc:1929] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:58.622285 22950 raft_consensus.cc:2243] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.622735 22945 log.cc:1199] T b83eb73076f949419556cb7ef3746784 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/b83eb73076f949419556cb7ef3746784
I20260709 13:05:58.623315 22950 raft_consensus.cc:2272] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.624305 22943 ts_tablet_manager.cc:1929] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:58.624936 22943 log.cc:1199] T 82fae287aad247d99c33e1a07c6e82a3 P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/82fae287aad247d99c33e1a07c6e82a3
I20260709 13:05:58.625968 22945 tablet_replica.cc:333] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:05:58.627511 22945 raft_consensus.cc:2243] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:58.625793 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet b83eb73076f949419556cb7ef3746784 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:58.627524 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet 82fae287aad247d99c33e1a07c6e82a3 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:58.627629 22950 ts_tablet_manager.cc:1916] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:58.628391 22945 raft_consensus.cc:2272] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:58.632205 22945 ts_tablet_manager.cc:1916] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:58.653108 22950 ts_tablet_manager.cc:1929] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:58.653707 22950 log.cc:1199] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/0d9daa6d16d543f0a8cb8b3d482b3d80
I20260709 13:05:58.655942 22945 ts_tablet_manager.cc:1929] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:58.656417 22945 log.cc:1199] T 23093b4e74d34b3d87ab577135fa1517 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/23093b4e74d34b3d87ab577135fa1517
I20260709 13:05:58.657428 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet 0d9daa6d16d543f0a8cb8b3d482b3d80 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:58.657801 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet 23093b4e74d34b3d87ab577135fa1517 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:05:59.673987 21943 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:59.680457 21873 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:59.680935 22023 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:59.681097 21914 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb3ae54bf5ef462ba44e223978c42103. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.682091 22951 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.683107 22816 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.690156 22948 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.691864 22023 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.692809 21873 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.713316 21943 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:59.719637 21771 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.734418 22023 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:59.735426 21873 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:59.736552 22948 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:59.740027 21914 consensus_peers.cc:597] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 080e5fa3988746d88e6350506ed3b136. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.740688 22951 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.749676 22816 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.750758 22023 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.752111 21873 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.777854 21943 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:59.778950 21768 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:59.789716 21914 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2af20d42858245eb986768009de88379. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.790262 21869 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:59.792799 22816 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.789944 22023 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:59.800908 22951 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:59.814329 22951 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.817842 22023 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.818027 21873 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.838480 21773 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.849258 22016 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:05:59.856515 21943 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:59.857930 21869 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:59.857944 21988 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65033a7eefd242a796408c7d54fed332. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:59.859877 22955 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.860973 22915 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.870160 22915 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.872892 21869 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.874277 21942 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:05:59.897224 21771 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:00.189968 22970 ts_tablet_manager.cc:933] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:00.192370 22970 tablet_copy_client.cc:323] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:06:00.194686 21960 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet cb3ae54bf5ef462ba44e223978c42103 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:06:00.195252 21960 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet cb3ae54bf5ef462ba44e223978c42103 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-cb3ae54bf5ef462ba44e223978c42103
I20260709 13:06:00.202944 21960 tablet_copy_source_session.cc:215] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:00.208943 22972 ts_tablet_manager.cc:933] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:00.210981 22970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3ae54bf5ef462ba44e223978c42103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.212328 22972 tablet_copy_client.cc:323] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:06:00.214475 21960 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet 080e5fa3988746d88e6350506ed3b136 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:06:00.215000 21960 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet 080e5fa3988746d88e6350506ed3b136 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-080e5fa3988746d88e6350506ed3b136
I20260709 13:06:00.222350 21960 tablet_copy_source_session.cc:215] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:00.225057 22972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 080e5fa3988746d88e6350506ed3b136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.241564 22972 tablet_copy_client.cc:806] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:00.242007 22970 tablet_copy_client.cc:806] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:00.242257 22972 tablet_copy_client.cc:670] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:00.242660 22970 tablet_copy_client.cc:670] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:00.246744 22970 tablet_copy_client.cc:538] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:00.246815 22972 tablet_copy_client.cc:538] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:00.254674 22972 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:00.257433 22970 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:00.279583 22972 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:00.280360 22972 tablet_bootstrap.cc:492] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:00.281054 22972 ts_tablet_manager.cc:1403] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.027s	user 0.027s	sys 0.000s
I20260709 13:06:00.282483 22970 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:00.283520 22970 tablet_bootstrap.cc:492] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:00.284238 22970 ts_tablet_manager.cc:1403] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 13:06:00.284193 22972 raft_consensus.cc:359] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:00.285219 22972 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:00.285969 22972 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:00.287554 22970 raft_consensus.cc:359] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:00.288509 22970 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:00.289299 22972 ts_tablet_manager.cc:1434] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:00.289223 22970 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:00.291543 21959 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-080e5fa3988746d88e6350506ed3b136 received from {username='slave'} at 127.0.0.1:35490
I20260709 13:06:00.291999 21959 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-080e5fa3988746d88e6350506ed3b136 on tablet 080e5fa3988746d88e6350506ed3b136 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:00.300978 22970 ts_tablet_manager.cc:1434] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 13:06:00.302718 21959 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-cb3ae54bf5ef462ba44e223978c42103 received from {username='slave'} at 127.0.0.1:35490
I20260709 13:06:00.303123 21959 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-cb3ae54bf5ef462ba44e223978c42103 on tablet cb3ae54bf5ef462ba44e223978c42103 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:00.361404 22970 ts_tablet_manager.cc:933] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:00.384691 22970 tablet_copy_client.cc:323] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:06:00.386656 21959 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet 2af20d42858245eb986768009de88379 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:06:00.387212 21959 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet 2af20d42858245eb986768009de88379 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-2af20d42858245eb986768009de88379
I20260709 13:06:00.395720 21959 tablet_copy_source_session.cc:215] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:00.398720 22970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af20d42858245eb986768009de88379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.400249 22972 ts_tablet_manager.cc:933] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:00.402474 22972 tablet_copy_client.cc:323] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:06:00.405835 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 65033a7eefd242a796408c7d54fed332 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:06:00.406415 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 65033a7eefd242a796408c7d54fed332 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-65033a7eefd242a796408c7d54fed332
I20260709 13:06:00.415514 22033 tablet_copy_source_session.cc:215] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:00.417858 22970 tablet_copy_client.cc:806] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:00.418522 22970 tablet_copy_client.cc:670] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:00.418889 22972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65033a7eefd242a796408c7d54fed332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:00.422820 22970 tablet_copy_client.cc:538] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:00.433236 22970 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:00.441299 22972 tablet_copy_client.cc:806] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:00.441975 22972 tablet_copy_client.cc:670] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:00.446064 22972 tablet_copy_client.cc:538] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:00.455302 22972 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:00.455678 22970 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:00.456693 22970 tablet_bootstrap.cc:492] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:00.457458 22970 ts_tablet_manager.cc:1403] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:06:00.460636 22970 raft_consensus.cc:359] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:00.461510 22970 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:00.462324 22970 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:00.465860 22970 ts_tablet_manager.cc:1434] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:00.480216 21959 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-2af20d42858245eb986768009de88379 received from {username='slave'} at 127.0.0.1:35490
I20260709 13:06:00.480696 21959 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-2af20d42858245eb986768009de88379 on tablet 2af20d42858245eb986768009de88379 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:00.506585 22972 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:00.507630 22972 tablet_bootstrap.cc:492] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:00.508430 22972 ts_tablet_manager.cc:1403] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.027s
I20260709 13:06:00.510628 22972 raft_consensus.cc:359] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:00.511313 22972 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:00.511968 22972 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:00.514271 22972 ts_tablet_manager.cc:1434] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:06:00.516017 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-65033a7eefd242a796408c7d54fed332 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:06:00.516466 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-65033a7eefd242a796408c7d54fed332 on tablet 65033a7eefd242a796408c7d54fed332 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:00.626906 22607 raft_consensus.cc:1217] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:00.764551 22607 raft_consensus.cc:1217] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:00.922657 22607 raft_consensus.cc:1217] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:00.928478 22607 raft_consensus.cc:1217] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:01.006949 22983 raft_consensus.cc:1064] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:01.009737 22983 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:01.016359 22607 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.017772 21869 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.018399 22023 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.019809 22984 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.020797 22816 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.022122 22983 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:01.050508 22951 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.059201 22608 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.078122 21773 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:01.084442 22019 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.089309 21869 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.126658 21942 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:01.135226 22607 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:01.135874 21869 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:01.136586 22951 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:01.138410 22984 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:01.146821 22816 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.149736 22607 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.154173 21869 raft_consensus.cc:2955] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.164844 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb3ae54bf5ef462ba44e223978c42103 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:01.167260 21771 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.183732 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet cb3ae54bf5ef462ba44e223978c42103 with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:06:01.186872 22993 tablet_replica.cc:333] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:06:01.188058 22993 raft_consensus.cc:2243] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.188899 22993 raft_consensus.cc:2272] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.192040 22993 ts_tablet_manager.cc:1916] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:01.208580 22993 ts_tablet_manager.cc:1929] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:01.209050 22993 log.cc:1199] T cb3ae54bf5ef462ba44e223978c42103 P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/cb3ae54bf5ef462ba44e223978c42103
I20260709 13:06:01.211917 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet cb3ae54bf5ef462ba44e223978c42103 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:01.315433 22994 raft_consensus.cc:1064] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:01.318192 22994 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:01.334373 22607 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.336021 22816 raft_consensus.cc:1064] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:01.334373 21949 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.337451 22900 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.337733 21869 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.338866 22915 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.339792 22994 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.341576 22816 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:01.375847 21873 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.376222 22608 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.377502 22019 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.379618 22816 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.386581 22983 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:01.389933 22983 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.389762 22915 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.403635 22608 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.407387 21943 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.422168 21773 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:01.441166 22983 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.467691 21875 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.473647 22608 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.486742 22019 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.501658 21875 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.500224 21768 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.511943 22951 raft_consensus.cc:1064] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:01.514415 22951 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:01.532774 22019 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:01.536406 21942 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:01.539600 22608 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:01.543984 22915 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:01.546007 21869 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:01.551631 22023 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.554369 21875 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.554369 22608 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:01.554858 23004 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:01.557133 22816 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.558049 22984 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.561885 22016 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:01.564106 22816 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.566847 22983 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:01.568077 22607 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:01.573050 22983 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:01.573128 22915 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.583276 22607 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.587879 22984 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.597039 22016 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.613348 22609 raft_consensus.cc:2955] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.626793 21768 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.628930 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 080e5fa3988746d88e6350506ed3b136 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:01.629422 21866 raft_consensus.cc:2955] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.631201 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65033a7eefd242a796408c7d54fed332 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:01.638265 22951 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.646302 22608 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.649487 21875 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.649791 22016 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.661054 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet 65033a7eefd242a796408c7d54fed332 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:06:01.672185 21772 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.672508 21768 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.686331 23011 tablet_replica.cc:333] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:06:01.692590 23011 raft_consensus.cc:2243] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.693399 23011 raft_consensus.cc:2272] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.700419 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet 080e5fa3988746d88e6350506ed3b136 with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:06:01.711356 23011 ts_tablet_manager.cc:1916] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:01.721117 23012 tablet_replica.cc:333] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:06:01.727686 21942 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:01.733879 23011 ts_tablet_manager.cc:1929] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:01.734467 23011 log.cc:1199] T 65033a7eefd242a796408c7d54fed332 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/65033a7eefd242a796408c7d54fed332
I20260709 13:06:01.734726 23012 raft_consensus.cc:2243] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.735555 23012 raft_consensus.cc:2272] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.739387 23012 ts_tablet_manager.cc:1916] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:01.742270 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet 65033a7eefd242a796408c7d54fed332 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:01.742444 22608 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:01.743978 21866 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:01.748628 22984 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:01.749779 22816 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:01.763147 23012 ts_tablet_manager.cc:1929] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:01.763746 23012 log.cc:1199] T 080e5fa3988746d88e6350506ed3b136 P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/080e5fa3988746d88e6350506ed3b136
I20260709 13:06:01.765889 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet 080e5fa3988746d88e6350506ed3b136 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:01.765096 22816 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.769562 21875 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.770645 22608 raft_consensus.cc:2955] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:01.777127 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2af20d42858245eb986768009de88379 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:01.785734 21768 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:01.801021 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet 2af20d42858245eb986768009de88379 with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:06:01.802811 23013 tablet_replica.cc:333] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:06:01.803992 23013 raft_consensus.cc:2243] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:01.804808 23013 raft_consensus.cc:2272] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:01.808221 23013 ts_tablet_manager.cc:1916] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:01.825626 23013 ts_tablet_manager.cc:1929] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:01.825955 23013 log.cc:1199] T 2af20d42858245eb986768009de88379 P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/2af20d42858245eb986768009de88379
I20260709 13:06:01.827432 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet 2af20d42858245eb986768009de88379 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:02.867973 22016 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:02.873875 21949 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.876037 23016 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:02.877334 21869 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:02.877197 21988 consensus_peers.cc:597] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6be2f940d334bd0b3c9d1b89bc17d2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.878962 22915 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.887507 23017 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:02.889387 21942 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:02.889505 21869 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:02.906498 21773 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.907429 21943 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:02.927561 22016 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.927953 21875 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:02.928933 21914 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd12cba9f1b74b1b908b1d598ca51a8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.929585 23014 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:02.930564 22984 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.938213 23014 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:02.943536 21869 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:02.945389 22016 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:02.976980 22016 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:02.977689 21772 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
W20260709 13:06:02.991310 21988 consensus_peers.cc:597] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9152786e68fb4b41a29fa44da39a923a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.993819 21943 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:02.997771 23004 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.998996 21869 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:03.005379 23017 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:03.028129 22915 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:03.036486 21943 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:03.047847 21875 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:03.057512 21869 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.062731 21768 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:03.078033 21839 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eda002bd6903433da20d221420291f1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.082006 22023 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:03.084117 22981 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.086573 21943 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:03.087988 22981 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:03.099560 23005 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:03.102310 21943 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:03.127571 21773 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:03.138002 22016 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:03.277418 23043 ts_tablet_manager.cc:933] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:03.279297 23043 tablet_copy_client.cc:323] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:06:03.281008 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet a6be2f940d334bd0b3c9d1b89bc17d2f from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:06:03.281555 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet a6be2f940d334bd0b3c9d1b89bc17d2f from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-a6be2f940d334bd0b3c9d1b89bc17d2f
I20260709 13:06:03.289091 22033 tablet_copy_source_session.cc:215] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.292649 23043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6be2f940d334bd0b3c9d1b89bc17d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.307873 23043 tablet_copy_client.cc:806] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:03.308527 23043 tablet_copy_client.cc:670] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:03.312309 23043 tablet_copy_client.cc:538] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:03.326354 23043 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:03.352483 23043 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.353451 23043 tablet_bootstrap.cc:492] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:03.354036 23043 ts_tablet_manager.cc:1403] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.007s
I20260709 13:06:03.356374 23043 raft_consensus.cc:359] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.357295 23043 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:03.357851 23043 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.361048 23043 ts_tablet_manager.cc:1434] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:06:03.363983 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-a6be2f940d334bd0b3c9d1b89bc17d2f received from {username='slave'} at 127.0.0.1:60038
I20260709 13:06:03.364436 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-a6be2f940d334bd0b3c9d1b89bc17d2f on tablet a6be2f940d334bd0b3c9d1b89bc17d2f with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:03.480708 23043 ts_tablet_manager.cc:933] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:06:03.484844 23043 tablet_copy_client.cc:323] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:06:03.486932 21885 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet eda002bd6903433da20d221420291f1e from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:06:03.487490 21885 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet eda002bd6903433da20d221420291f1e from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-eda002bd6903433da20d221420291f1e
I20260709 13:06:03.497793 21885 tablet_copy_source_session.cc:215] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.501523 23043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda002bd6903433da20d221420291f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.531709 23048 ts_tablet_manager.cc:933] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:03.532663 23043 tablet_copy_client.cc:806] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:03.533460 23043 tablet_copy_client.cc:670] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:03.540656 23043 tablet_copy_client.cc:538] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:03.542153 23048 tablet_copy_client.cc:323] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:06:03.544131 21959 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet bd12cba9f1b74b1b908b1d598ca51a8c from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:06:03.544772 21959 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet bd12cba9f1b74b1b908b1d598ca51a8c from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-bd12cba9f1b74b1b908b1d598ca51a8c
I20260709 13:06:03.550637 23043 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:03.568897 21959 tablet_copy_source_session.cc:215] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.572845 23048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd12cba9f1b74b1b908b1d598ca51a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.591214 23048 tablet_copy_client.cc:806] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:03.591923 23048 tablet_copy_client.cc:670] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:03.599617 23048 tablet_copy_client.cc:538] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:03.599586 23051 ts_tablet_manager.cc:933] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:03.600504 23043 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.601663 23043 tablet_bootstrap.cc:492] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:03.602494 23043 ts_tablet_manager.cc:1403] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.001s
I20260709 13:06:03.613508 23051 tablet_copy_client.cc:323] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:06:03.614315 23043 raft_consensus.cc:359] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.615195 23043 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:03.615221 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 9152786e68fb4b41a29fa44da39a923a from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:06:03.615895 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 9152786e68fb4b41a29fa44da39a923a from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-9152786e68fb4b41a29fa44da39a923a
I20260709 13:06:03.615921 23043 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.617717 23048 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:03.624327 22033 tablet_copy_source_session.cc:215] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.626700 23043 ts_tablet_manager.cc:1434] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:06:03.627985 23051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9152786e68fb4b41a29fa44da39a923a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:03.640983 21885 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-eda002bd6903433da20d221420291f1e received from {username='slave'} at 127.0.0.1:44780
I20260709 13:06:03.641495 21885 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-eda002bd6903433da20d221420291f1e on tablet eda002bd6903433da20d221420291f1e with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:03.647585 23051 tablet_copy_client.cc:806] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:03.648205 23051 tablet_copy_client.cc:670] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:03.650365 23048 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.651336 23048 tablet_bootstrap.cc:492] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:03.652117 23048 ts_tablet_manager.cc:1403] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.000s
I20260709 13:06:03.652668 23051 tablet_copy_client.cc:538] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:03.655578 23048 raft_consensus.cc:359] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.656497 23048 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:03.657258 23048 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.663246 23048 ts_tablet_manager.cc:1434] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:03.668841 21959 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-bd12cba9f1b74b1b908b1d598ca51a8c received from {username='slave'} at 127.0.0.1:35490
I20260709 13:06:03.669308 21959 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-bd12cba9f1b74b1b908b1d598ca51a8c on tablet bd12cba9f1b74b1b908b1d598ca51a8c with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:03.675482 23051 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:03.697446 23051 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.698342 23051 tablet_bootstrap.cc:492] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:03.698977 23051 ts_tablet_manager.cc:1403] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:06:03.701900 23051 raft_consensus.cc:359] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.702708 23051 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:03.703313 23051 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:03.705747 23051 ts_tablet_manager.cc:1434] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:03.707621 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-9152786e68fb4b41a29fa44da39a923a received from {username='slave'} at 127.0.0.1:60038
I20260709 13:06:03.707950 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-9152786e68fb4b41a29fa44da39a923a on tablet 9152786e68fb4b41a29fa44da39a923a with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:03.835103 22609 raft_consensus.cc:1217] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:03.948474 22609 raft_consensus.cc:1217] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:04.018044 22609 raft_consensus.cc:1217] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:04.198698 22608 raft_consensus.cc:1217] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:04.321915 22915 raft_consensus.cc:1064] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:04.324211 22915 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:04.331189 22608 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.332528 23017 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.334100 21949 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.335672 23004 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.342811 21875 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.345531 23004 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.345531 23055 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.349383 21949 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.363634 22608 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.373966 21768 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.402483 21875 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.445219 22019 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:04.453919 21949 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.455665 23004 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.456000 22608 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.457482 23055 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.464296 23055 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.467895 21949 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.469866 22609 raft_consensus.cc:2955] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.485415 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6be2f940d334bd0b3c9d1b89bc17d2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:04.488390 21773 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.495847 23042 raft_consensus.cc:1064] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:04.498165 23042 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:04.503315 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet a6be2f940d334bd0b3c9d1b89bc17d2f with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:06:04.509016 23061 raft_consensus.cc:1064] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:04.515184 23061 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:04.537096 22609 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.538107 23067 tablet_replica.cc:333] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:06:04.538772 22019 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.539196 23067 raft_consensus.cc:2243] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.539881 23067 raft_consensus.cc:2272] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.541267 23063 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.543959 23034 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.544386 23067 ts_tablet_manager.cc:1916] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:04.552242 22607 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.557569 23039 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.580238 23067 ts_tablet_manager.cc:1929] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:04.585922 23067 log.cc:1199] T a6be2f940d334bd0b3c9d1b89bc17d2f P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/a6be2f940d334bd0b3c9d1b89bc17d2f
I20260709 13:06:04.588230 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet a6be2f940d334bd0b3c9d1b89bc17d2f (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:04.598140 21875 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.600216 23033 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:04.629902 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 48513.6us
I20260709 13:06:04.634577 23034 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.645188 22023 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.645898 21949 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.647280 23042 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.648303 22609 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.649149 23042 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:04.671933 21773 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.677134 23039 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.683760 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:04.687091 22023 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.690980 22607 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.701871 23004 raft_consensus.cc:1064] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:04.704124 23004 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:04.726244 21949 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.727509 21875 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.726876 21869 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.730459 22915 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.731217 23004 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.734647 21773 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.722450 22023 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.732897 21943 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.746380 22607 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:04.748021 23004 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:04.764504 21942 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:04.772805 22609 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.774994 21866 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:04.781111 23061 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:04.790825 22608 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.796657 21866 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.796295 23042 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:06:04.802176 23063 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.815148 23039 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.788522 23055 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.805547 23027 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.807041 22019 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:04.810882 21943 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.826611 23042 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:04.837129 21875 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.836141 22019 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.845324 22609 raft_consensus.cc:2955] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.857307 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd12cba9f1b74b1b908b1d598ca51a8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:04.859544 22608 raft_consensus.cc:2955] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.869057 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eda002bd6903433da20d221420291f1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:04.884848 22023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7eeff5779b544ebaac041e407041b284"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:04.885620 22023 raft_consensus.cc:606] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:04.889415 21773 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.890218 21771 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.891664 21869 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.910550 21772 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.925585 22607 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:04.938117 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet bd12cba9f1b74b1b908b1d598ca51a8c with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:06:04.956231 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet eda002bd6903433da20d221420291f1e with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:06:04.978340 23088 tablet_replica.cc:333] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:06:04.980439 23088 raft_consensus.cc:2243] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.981495 23088 raft_consensus.cc:2272] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:04.989815 23088 ts_tablet_manager.cc:1916] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:04.992542 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:04.994756 23089 tablet_replica.cc:333] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:06:04.995343 21943 raft_consensus.cc:606] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:04.996140 23089 raft_consensus.cc:2243] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:04.997773 22019 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:04.999055 23089 raft_consensus.cc:2272] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.005198 21943 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:05.006031 22609 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:05.007633 23004 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:05.008255 23089 ts_tablet_manager.cc:1916] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:05.008700 22915 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:05.014791 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:05.016664 23017 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:05.018124 22607 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:05.026926 21943 raft_consensus.cc:2955] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:05.015412 22019 raft_consensus.cc:606] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:05.040830 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9152786e68fb4b41a29fa44da39a923a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:05.045732 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:05.046343 22019 raft_consensus.cc:606] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:05.049002 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:05.049599 22019 raft_consensus.cc:606] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:05.049149 21771 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.052311 22023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:05.052969 22023 raft_consensus.cc:606] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:05.058089 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:05.059235 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:05.072420 23089 ts_tablet_manager.cc:1929] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:05.072481 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet 9152786e68fb4b41a29fa44da39a923a with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:06:05.073084 23089 log.cc:1199] T eda002bd6903433da20d221420291f1e P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/eda002bd6903433da20d221420291f1e
I20260709 13:06:05.073608 23088 ts_tablet_manager.cc:1929] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:05.073616 23067 tablet_replica.cc:333] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:06:05.074216 23088 log.cc:1199] T bd12cba9f1b74b1b908b1d598ca51a8c P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/bd12cba9f1b74b1b908b1d598ca51a8c
I20260709 13:06:05.074877 23067 raft_consensus.cc:2243] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.074870 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet eda002bd6903433da20d221420291f1e (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:05.075771 23067 raft_consensus.cc:2272] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:05.077220 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet bd12cba9f1b74b1b908b1d598ca51a8c (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:05.079360 23067 ts_tablet_manager.cc:1916] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:05.092126 23067 ts_tablet_manager.cc:1929] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:05.092554 23067 log.cc:1199] T 9152786e68fb4b41a29fa44da39a923a P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/9152786e68fb4b41a29fa44da39a923a
I20260709 13:06:05.093986 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet 9152786e68fb4b41a29fa44da39a923a (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:05.144119 23027 raft_consensus.cc:993] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:05.144730 23033 raft_consensus.cc:1081] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:05.146225 22019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:05.146732 22019 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:05.147050 22019 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.151638 22019 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.153347 22019 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:05.153833 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:05.154340 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:05.154523 21866 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.154875 21943 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:05.155169 21943 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:05.155889 21943 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.157022 21943 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.161008 21866 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:05.162227 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:05.162880 23017 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.163170 21943 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:05.163381 23017 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:05.164350 23017 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.173628 21771 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.334710 23004 raft_consensus.cc:993] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.335250 23017 raft_consensus.cc:1081] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.336243 23017 raft_consensus.cc:993] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.336723 23004 raft_consensus.cc:1081] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.336867 21866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7eeff5779b544ebaac041e407041b284"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:06:05.337513 21866 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:05.337872 21866 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.338317 21869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:06:05.338830 21869 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:05.339057 21869 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.344111 21866 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.345759 21869 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.346585 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:05.347123 21943 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.348062 21869 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:05.351883 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:05.352407 22019 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:05.352692 22019 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:05.353185 21943 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.353320 22019 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.354206 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:05.354372 22019 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.354945 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:05.355059 23073 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.355674 23073 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:05.355406 21866 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:05.356485 23073 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.358542 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:05.359095 22016 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:05.359376 22016 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:05.360049 22016 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.362730 22016 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.365304 22019 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.366637 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:05.367611 23039 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.368090 23039 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:05.368899 23039 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.376072 21943 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.377710 22016 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.378612 23055 raft_consensus.cc:993] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.379212 22915 raft_consensus.cc:1081] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.383045 21866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:06:05.383515 21866 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:05.383818 21866 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.388350 21771 catalog_manager.cc:5697] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.390180 21943 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.397493 21866 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.400501 23055 raft_consensus.cc:993] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.400350 21866 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:05.401223 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:05.403002 22016 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:05.403309 22016 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:05.402282 23017 raft_consensus.cc:1081] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.404033 22016 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.406038 22016 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.407184 21866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:06:05.407714 21866 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:05.408058 21866 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.413213 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:05.413796 21943 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.414238 22016 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.414402 21866 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.414717 21768 catalog_manager.cc:5697] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.415453 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:05.416272 23073 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.416744 23073 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:05.417521 23073 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.420244 21943 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.423482 21866 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:05.424113 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:05.424693 21943 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.424657 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:05.425310 22016 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:05.425575 22016 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:05.426210 22016 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.427296 22016 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.429013 21943 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.430045 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:05.431658 23073 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.432091 23073 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:05.432921 23073 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.433600 22016 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.435518 21768 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.453795 21768 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.470281 23017 raft_consensus.cc:993] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.470692 23004 raft_consensus.cc:1081] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:05.471920 21875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:06:05.472357 21875 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:05.472632 21875 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.477131 21875 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.478816 21875 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:05.481580 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:05.482257 22023 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:05.483139 22023 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:05.483919 22023 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.485186 22023 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.481654 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:05.486161 21943 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.496622 21943 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.499444 22023 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:05.499732 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:05.501006 23039 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:05.501781 23039 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:05.502772 23039 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:05.516799 21768 catalog_manager.cc:5697] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.548081 21943 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.549258 23017 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.560839 21875 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.562216 23017 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.764586 21942 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.765714 23039 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.774173 22016 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.775888 23039 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.823457 21942 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.824559 23069 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.834218 22016 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.837541 23039 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.875883 21942 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.877099 23039 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.889792 22023 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.891196 23073 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:05.908046 22016 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.909371 23069 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.918699 21942 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.920892 23073 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.948990 21942 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.950301 23069 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.954743 22016 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.957444 23039 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.060197 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:06.112110 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:06.156567 22023 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:06.159440 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:06.160878 22020 raft_consensus.cc:606] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:06.165158 21943 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.166870 23017 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.172540 21869 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:06.174984 21988 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06e4c126dc6f477daa840b84b452bb59. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.176514 23017 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:06.178301 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:06.178892 21943 raft_consensus.cc:606] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:06.185134 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:06.185719 21943 raft_consensus.cc:606] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:06.186276 23055 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.189281 21942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:06.189858 21942 raft_consensus.cc:606] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:06.188709 21943 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.192514 21869 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.197288 23004 raft_consensus.cc:993] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:06.197778 23004 raft_consensus.cc:1081] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:06.198808 21942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:06.199358 21942 raft_consensus.cc:606] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:06.199478 21875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:06:06.203725 22023 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:06.204793 21768 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.215700 21875 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.216185 21875 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.239462 21875 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:06.254871 23063 raft_consensus.cc:993] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:06.255368 23063 raft_consensus.cc:1081] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:06.257673 22609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:06:06.258556 22609 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.259032 22609 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.262702 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:06.263310 21943 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.265842 21942 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.267320 23017 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.269069 21869 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:06.270365 21988 consensus_peers.cc:597] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0aeb7bdadb4e4d378fb5799fdc7eaa72. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.268926 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:06.271351 22016 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:06.271234 23017 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.271706 22016 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:06.272734 22016 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:06.274327 22016 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.312827 21943 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:06.314543 21838 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:06.315187 22609 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.256845 21875 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:06.317414 23042 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.318110 23042 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:06.318809 21875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eda002bd6903433da20d221420291f1e"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:36954
I20260709 13:06:06.318992 23042 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:06.319669 21875 raft_consensus.cc:606] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:06.322880 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:06.324486 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:06.325034 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:06.325587 21949 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:06.325883 21949 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:06.326843 22016 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:06.326510 21949 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.327701 21949 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.337679 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:06.338304 22020 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.338676 22609 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:06.346517 22020 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:06.347257 21949 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:06.348034 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:06.350442 23124 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.357501 23055 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.359890 21875 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.361730 21771 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.365814 21942 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.371881 23124 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:06.377621 23124 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.385860 21771 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.391322 21875 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:06:06.432029 21839 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad0b6a949ee94dddab00a0afe84da820. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.434712 22020 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.436383 21949 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.437655 23073 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.438549 23069 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.444571 21768 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.460727 23063 raft_consensus.cc:993] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:06.461197 23063 raft_consensus.cc:1081] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:06.465783 22023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:06.464236 23042 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.466361 21949 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.466375 22023 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.469182 22023 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.476315 22020 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.481921 22023 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:06.484448 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.485175 21866 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:06.486394 22023 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:06.486423 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:06.487350 21949 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:06.487656 21949 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:06.488341 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:06.488976 21869 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.488375 21949 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:06.489969 21949 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.496397 21949 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:06.499744 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:06.496397 21869 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:06.501557 23114 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.502063 23114 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:06.492789 21768 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.502934 23114 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:06.506729 21839 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 130319e952f14561b08ef212107e1666. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.512858 21949 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.517525 22023 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:06.518836 23073 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:06.525110 23073 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:06.532342 21771 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.546977 23073 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.550504 22020 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.568014 21942 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.574800 21771 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:06.641537 23027 raft_consensus.cc:993] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:06.642046 23027 raft_consensus.cc:1081] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:06.643433 22020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:06.643899 22020 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.644187 22020 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.651605 22020 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:06.654541 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:06.655159 21869 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.655638 22020 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:06.656701 23073 raft_consensus.cc:993] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:06.657169 23073 raft_consensus.cc:1081] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:06.657179 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:06.658506 21942 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:06.658803 22607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eda002bd6903433da20d221420291f1e"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57070
I20260709 13:06:06.658840 21942 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:06.659425 22607 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.659785 22607 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.659907 21942 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:06.661203 21942 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.662847 21869 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:06.664104 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:06.665118 23055 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.665581 23055 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:06.667623 21942 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:06.667357 23055 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:06.670998 22607 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.673664 22607 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:06.674163 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:06.674803 22020 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.674163 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:06.681496 22020 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:06.683589 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:06.684386 23124 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.684965 23124 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:06.685786 23124 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.677204 21869 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:06.690173 21869 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:06.691164 21869 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.692359 21869 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.695834 21768 catalog_manager.cc:5697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.708766 21773 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.712009 21869 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:06.730351 23027 raft_consensus.cc:993] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:06.730859 23118 raft_consensus.cc:1081] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:06.732456 22607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:06:06.733014 22607 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.733296 22607 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.738740 22607 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.741321 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:06.741555 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:06.741979 21869 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.742190 21942 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:06.742599 21942 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:06.743247 21942 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.744082 21942 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.748497 21942 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:06.749271 22607 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:06.749909 22573 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:06.750766 23124 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:06.751236 23124 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:06.752051 23124 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:06.753173 21869 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:06.761940 21773 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.767132 22020 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:06.768386 23042 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:06.798914 21942 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:06.800647 23069 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:06.809065 23137 ts_tablet_manager.cc:933] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:06.811405 23137 tablet_copy_client.cc:323] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:06:06.814514 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:06:06.815068 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-0aeb7bdadb4e4d378fb5799fdc7eaa72
I20260709 13:06:06.816833 21949 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:06.818804 23124 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:06.827283 22033 tablet_copy_source_session.cc:215] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.847330 23137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:06.851599 21839 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06e4c126dc6f477daa840b84b452bb59. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.871932 23137 tablet_copy_client.cc:806] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.872663 23137 tablet_copy_client.cc:670] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:06.879439 22020 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:06.882411 23125 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:06.895262 23137 tablet_copy_client.cc:538] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:06.906606 23137 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:06.916461 23147 ts_tablet_manager.cc:933] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:06:06.920622 21869 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:06.924786 23055 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:06.956157 23147 tablet_copy_client.cc:323] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:06:06.962687 21885 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet ad0b6a949ee94dddab00a0afe84da820 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:06:06.963274 21885 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet ad0b6a949ee94dddab00a0afe84da820 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-ad0b6a949ee94dddab00a0afe84da820
I20260709 13:06:06.970983 23137 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:06.971961 23137 tablet_bootstrap.cc:492] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:06.972240 21885 tablet_copy_source_session.cc:215] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:06.972641 23137 ts_tablet_manager.cc:1403] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.019s
I20260709 13:06:06.975675 23137 raft_consensus.cc:359] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:06.976528 23137 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:06.976691 21949 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:06.977813 23137 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:06.982101 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0b6a949ee94dddab00a0afe84da820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:06.983187 23137 ts_tablet_manager.cc:1434] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:06.984939 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-0aeb7bdadb4e4d378fb5799fdc7eaa72 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:06:06.985356 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-0aeb7bdadb4e4d378fb5799fdc7eaa72 on tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:06.989290 23004 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.016721 23147 tablet_copy_client.cc:806] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:07.017310 23147 tablet_copy_client.cc:670] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:07.029155 23137 ts_tablet_manager.cc:933] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:06:07.034472 23137 tablet_copy_client.cc:323] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:06:07.036334 21884 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet 130319e952f14561b08ef212107e1666 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:06:07.036942 21884 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet 130319e952f14561b08ef212107e1666 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-130319e952f14561b08ef212107e1666
I20260709 13:06:07.045152 21884 tablet_copy_source_session.cc:215] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:07.050379 23137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130319e952f14561b08ef212107e1666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.073019 23137 tablet_copy_client.cc:806] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:07.073786 23137 tablet_copy_client.cc:670] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:07.077332 23147 tablet_copy_client.cc:538] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:07.091609 23137 tablet_copy_client.cc:538] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:07.095171 23147 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:07.117654 23137 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:07.152060 23137 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:07.153120 23137 tablet_bootstrap.cc:492] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:07.153864 23137 ts_tablet_manager.cc:1403] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.015s
I20260709 13:06:07.153986 23147 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:07.154959 23147 tablet_bootstrap.cc:492] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:07.155503 23147 ts_tablet_manager.cc:1403] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.008s
I20260709 13:06:07.157405 23137 raft_consensus.cc:359] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:07.158284 23137 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:07.158434 23147 raft_consensus.cc:359] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:07.159255 23147 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:07.158897 23137 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:07.159899 23147 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:07.161440 23137 ts_tablet_manager.cc:1434] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:06:07.162248 23147 ts_tablet_manager.cc:1434] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:07.163952 21885 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-130319e952f14561b08ef212107e1666 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:06:07.164376 21885 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-130319e952f14561b08ef212107e1666 on tablet 130319e952f14561b08ef212107e1666 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:07.165042 21884 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-ad0b6a949ee94dddab00a0afe84da820 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:06:07.165431 21884 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-ad0b6a949ee94dddab00a0afe84da820 on tablet ad0b6a949ee94dddab00a0afe84da820 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:07.199204 22020 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:07.201689 23124 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:07.211159 21875 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:07.218241 23125 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:07.224795 21946 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:07.227051 23124 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:07.241441 21949 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:07.243122 23055 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.264022 21869 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:07.273253 23004 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.301154 22608 raft_consensus.cc:1217] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.319386 21875 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:07.321852 23157 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:07.325330 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:07.365465 23147 ts_tablet_manager.cc:933] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:06:07.377516 23147 tablet_copy_client.cc:323] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:06:07.379077 21884 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet 06e4c126dc6f477daa840b84b452bb59 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:06:07.379607 21884 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet 06e4c126dc6f477daa840b84b452bb59 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-06e4c126dc6f477daa840b84b452bb59
I20260709 13:06:07.385753 21884 tablet_copy_source_session.cc:215] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:07.388664 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e4c126dc6f477daa840b84b452bb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.395816 22608 raft_consensus.cc:1217] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.410133 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:07.427687 23147 tablet_copy_client.cc:806] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:07.428340 23147 tablet_copy_client.cc:670] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:07.433025 23147 tablet_copy_client.cc:538] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:07.445808 22608 raft_consensus.cc:1217] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:07.449074 23147 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:06:07.497030 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:07.497670 22020 raft_consensus.cc:606] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:07.497942 23147 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:07.498873 23147 tablet_bootstrap.cc:492] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:07.499611 23147 ts_tablet_manager.cc:1403] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.014s
I20260709 13:06:07.500669 21869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:36954
I20260709 13:06:07.501259 21869 raft_consensus.cc:606] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:07.502698 23147 raft_consensus.cc:359] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:07.503588 23147 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:07.504156 23147 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:07.506489 23147 ts_tablet_manager.cc:1434] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:06:07.509202 21884 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-06e4c126dc6f477daa840b84b452bb59 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:06:07.509622 21884 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-06e4c126dc6f477daa840b84b452bb59 on tablet 06e4c126dc6f477daa840b84b452bb59 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:07.511828 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:07.512442 21949 raft_consensus.cc:606] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:07.515964 21946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:07.516499 21946 raft_consensus.cc:606] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:07.525606 21946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:07.526201 21946 raft_consensus.cc:606] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:07.528864 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:07.529413 22020 raft_consensus.cc:606] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:07.530537 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:07.532263 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:07.562505 23033 raft_consensus.cc:993] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:07.563016 23027 raft_consensus.cc:1081] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:07.564627 22609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57074
I20260709 13:06:07.565164 22609 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.565541 22609 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.572074 23118 raft_consensus.cc:993] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:07.572677 23118 raft_consensus.cc:1081] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:07.574220 22020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:07.574717 22020 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.575029 22020 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.575752 22609 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.578886 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:07.579423 21949 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.579708 21949 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:07.581743 22609 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:07.582917 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:07.583490 22016 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.583194 21949 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.584391 21949 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.592579 22016 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:07.594515 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:07.595489 23157 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.595949 23157 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:07.596742 23157 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.597157 21949 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:07.598285 22020 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:07.600835 22020 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:07.601269 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:07.601714 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:07.601866 21875 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.602290 21949 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.602594 21949 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:07.603297 21949 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:07.604756 21949 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.664659 21771 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.691390 21875 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:07.709340 21949 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:07.716841 23055 raft_consensus.cc:993] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:07.716948 21987 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:07.717777 23055 raft_consensus.cc:1081] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:07.718544 23114 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.719339 23114 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:07.721052 23114 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:07.722409 22609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57086
I20260709 13:06:07.723220 22609 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.723670 22609 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.749064 21768 catalog_manager.cc:5697] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.754033 23153 raft_consensus.cc:993] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:07.754920 23033 raft_consensus.cc:1081] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:07.757171 22023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:07.757884 22023 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.758350 22023 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.767970 22023 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:07.771595 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:07.772545 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:07.773320 21946 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.773697 21946 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:07.774760 21946 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:07.776081 21946 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.778507 22609 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.780696 22023 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:07.799013 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:07.799815 21871 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.797869 22609 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:07.772511 21875 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.810537 21946 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:07.811815 21871 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:07.813992 22574 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:07.814571 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:07.814972 23157 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.815542 23157 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:07.816205 23160 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.816578 23157 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.817071 23160 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:07.819834 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:07.820482 22023 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.820815 22023 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:07.825242 23160 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:07.836817 22023 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.838732 22023 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.847446 21875 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:07.856994 22023 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:07.893363 23055 raft_consensus.cc:1064] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:07.896193 21768 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.897912 23114 raft_consensus.cc:993] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:07.897760 23055 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.898433 23114 raft_consensus.cc:1081] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:07.900174 21875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:06:07.900794 21875 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.901131 21875 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.900316 23069 raft_consensus.cc:993] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:07.903472 23069 raft_consensus.cc:1081] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:07.915715 22608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57070
I20260709 13:06:07.916435 22608 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.916877 22608 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:07.923843 23042 raft_consensus.cc:1064] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:07.926776 23042 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.934188 21771 catalog_manager.cc:5697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.943925 23175 raft_consensus.cc:1064] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:07.944438 21942 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.946815 23175 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.951128 22607 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.952016 22023 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.952584 23069 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.954620 23069 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.955581 23144 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.985951 22609 raft_consensus.cc:1217] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:06:07.987583 22023 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:07.995877 23125 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:07.988776 22608 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:07.990680 22607 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:07.991523 21949 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.012197 23175 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:08.014585 22608 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:08.015133 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:08.015703 21871 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.016034 21871 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:08.016292 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:08.017108 21949 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.016790 21871 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:08.018013 21871 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.020085 21875 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:08.022547 21875 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:08.026786 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:08.027469 21946 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:08.035034 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 81607.6us
I20260709 13:06:08.039628 21871 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:08.045687 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:08.046664 23124 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:08.047143 23124 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:08.047991 23124 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:08.055209 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:08.055835 23144 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.055889 22016 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.059681 21943 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.059983 22016 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:08.062373 22016 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:08.063633 22016 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.067539 21949 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:08.067565 23055 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:08.073508 21946 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:08.076493 21838 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:08.077527 23042 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:08.078814 23042 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:08.080106 23042 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:08.085595 22608 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.093636 22023 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.086769 21949 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.089342 23073 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:08.097481 23055 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:08.095474 22607 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.098961 22016 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:08.090365 21875 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:08.110754 21942 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:08.112455 23125 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:08.121790 23160 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.129976 23055 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:08.132493 22607 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.148025 21771 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.181586 21768 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 2 to 3, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.186136 21946 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.194644 21771 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.238729 21875 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:06:08.241874 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 115186us
I20260709 13:06:08.247291 23190 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:08.254792 21773 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.287274 22017 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:08.293879 22609 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.297977 22016 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:08.298643 21942 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.301437 21869 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.301113 23160 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:08.303368 21946 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.303584 23004 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.306595 23124 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:08.309504 23055 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.302991 23160 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 13:06:08.324896 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 49748.6us
I20260709 13:06:08.339368 21871 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:08.344671 22024 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.346208 23004 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.379499 22609 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.394531 22609 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.408402 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:06:08.428277 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 45265us
W20260709 13:06:08.428565 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 62946.5us
I20260709 13:06:08.430119 21943 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.431823 23177 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.432338 21871 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.434108 23114 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:08.434392 21943 raft_consensus.cc:2955] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.440446 21866 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:08.442039 23125 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:08.464694 21946 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:08.471025 23199 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:06:08.482450 23175 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.501899 21768 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 1 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.633036 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:08.634776 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 182281us
W20260709 13:06:08.700352 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 169214us
I20260709 13:06:08.668429 22017 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.712643 22018 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:08.716331 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 96587.7us
I20260709 13:06:08.718745 21947 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:08.721781 23124 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:08.732362 23073 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:08.742393 23192 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 13:06:08.845662 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47212.2us
W20260709 13:06:08.874704 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 429109us
I20260709 13:06:08.946394 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50234
I20260709 13:06:08.958576 21875 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:08.974077 23125 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:08.981858 21943 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:08.990694 21945 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:09.038137 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66193.3us
W20260709 13:06:09.045794 23180 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:06:08.971110 22606 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.042351 23208 raft_consensus.cc:1064] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:09.073760 23208 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.095695 23192 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.106135 22609 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.110921 23224 tablet_replica.cc:333] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:06:09.112109 23224 raft_consensus.cc:2243] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.112891 23224 raft_consensus.cc:2272] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.121322 23224 ts_tablet_manager.cc:1916] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:09.162367 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad0b6a949ee94dddab00a0afe84da820 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:09.168334 22018 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:09.169736 22609 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:09.174934 23208 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:09.167399 21768 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 2 to 3, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.181344 23224 ts_tablet_manager.cc:1929] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:09.181993 23224 log.cc:1199] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/0aeb7bdadb4e4d378fb5799fdc7eaa72
I20260709 13:06:09.181392 23073 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:09.183794 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet 0aeb7bdadb4e4d378fb5799fdc7eaa72 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:09.185443 23042 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:09.193423 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:09.224769 21943 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:09.226563 21947 raft_consensus.cc:2955] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.233268 23175 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:09.236189 23175 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.241518 22018 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.253475 22609 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.277400 21871 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.292007 22608 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:09.292203 22017 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:09.293902 23208 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:09.288208 21771 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 4, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.297927 21771 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 3 to 4, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.301157 23042 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:09.303056 23042 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.306828 22018 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.312228 22608 raft_consensus.cc:2955] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.326891 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet ad0b6a949ee94dddab00a0afe84da820 with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43288
I20260709 13:06:09.334261 21947 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.340915 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 130319e952f14561b08ef212107e1666 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:09.345996 23235 tablet_replica.cc:333] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:06:09.371325 21772 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 3 to 4, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 1 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.401085 23235 raft_consensus.cc:2243] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.403533 23235 raft_consensus.cc:2272] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.415026 23235 ts_tablet_manager.cc:1916] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:09.420464 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet 130319e952f14561b08ef212107e1666 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54874
I20260709 13:06:09.430025 23237 tablet_replica.cc:333] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:06:09.438352 23237 raft_consensus.cc:2243] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.442111 23237 raft_consensus.cc:2272] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.449731 23237 ts_tablet_manager.cc:1916] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:09.457262 23235 ts_tablet_manager.cc:1929] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:09.457881 23235 log.cc:1199] T ad0b6a949ee94dddab00a0afe84da820 P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/ad0b6a949ee94dddab00a0afe84da820
I20260709 13:06:09.466964 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet ad0b6a949ee94dddab00a0afe84da820 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:09.471463 23237 ts_tablet_manager.cc:1929] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:09.472082 23237 log.cc:1199] T 130319e952f14561b08ef212107e1666 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/130319e952f14561b08ef212107e1666
I20260709 13:06:09.480809 21875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:36954
I20260709 13:06:09.481612 21875 raft_consensus.cc:606] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:09.489631 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet 130319e952f14561b08ef212107e1666 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:09.496402 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "105015b2b463442ab34e0509af7105fb"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:09.497164 21947 raft_consensus.cc:606] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:09.511682 23175 raft_consensus.cc:993] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:09.512396 23175 raft_consensus.cc:1081] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:09.513991 22018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:09.514889 22018 raft_consensus.cc:606] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:09.514950 22608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57070
I20260709 13:06:09.517198 22608 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.522615 22608 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.532229 21875 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.550122 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "590d7eea40954779924038b15b716b58"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:09.550765 21947 raft_consensus.cc:606] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:09.558385 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:09.558980 22019 raft_consensus.cc:606] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:09.561645 22609 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:09.566031 23073 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:09.569221 22608 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.572428 22608 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:09.576846 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:09.577450 21947 raft_consensus.cc:606] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:09.579669 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:09.580323 21871 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.580732 21871 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:09.580157 23073 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.581769 21871 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.583151 21871 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.591435 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:09.592056 21947 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.599257 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:09.600922 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:09.602355 22609 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.619987 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06e4c126dc6f477daa840b84b452bb59 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:09.628368 22019 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:09.634579 21773 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 4 to 5, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.659255 21947 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:09.661185 22573 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:09.661989 23216 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.663107 23216 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:09.663776 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet 06e4c126dc6f477daa840b84b452bb59 with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54874
I20260709 13:06:09.664815 23237 tablet_replica.cc:333] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:06:09.665867 23237 raft_consensus.cc:2243] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.666476 23237 raft_consensus.cc:2272] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.664079 23216 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.667397 23208 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:09.670742 23237 ts_tablet_manager.cc:1916] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:09.661492 21871 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:09.690322 22017 raft_consensus.cc:2955] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:09.691545 21773 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.703331 23237 ts_tablet_manager.cc:1929] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:06:09.703944 23237 log.cc:1199] T 06e4c126dc6f477daa840b84b452bb59 P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/06e4c126dc6f477daa840b84b452bb59
I20260709 13:06:09.705550 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet 06e4c126dc6f477daa840b84b452bb59 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:06:09.745599 23203 raft_consensus.cc:993] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:09.746307 23203 raft_consensus.cc:1081] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:09.747923 22608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57086
I20260709 13:06:09.748463 22608 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.748831 22608 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.753697 22608 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.755347 22608 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:09.756049 23160 raft_consensus.cc:993] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:09.756428 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:09.757006 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:09.756551 23203 raft_consensus.cc:1081] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:09.757730 22017 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.757102 21947 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.758095 22017 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:09.759040 22608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57086
I20260709 13:06:09.759634 22608 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.760008 22608 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.759343 22017 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.761878 22017 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.764266 21947 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:09.765403 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:09.766070 23216 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.766516 23216 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:09.766794 22608 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.767350 23216 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.768469 22017 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:09.769376 22608 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:09.769651 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:09.770414 21947 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.772239 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:09.772800 22017 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.773061 22017 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:09.773773 22017 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.775976 22017 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.777668 21947 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:09.777170 21773 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.778288 23210 raft_consensus.cc:993] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:09.778728 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:09.779026 23027 raft_consensus.cc:1081] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:09.779445 23216 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.779906 23216 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:09.780726 21871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "105015b2b463442ab34e0509af7105fb"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:06:09.780861 23216 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:09.781355 21871 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.783793 21871 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.785064 22017 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:09.792740 21871 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.794010 23210 raft_consensus.cc:993] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:09.794553 23027 raft_consensus.cc:1081] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:09.794565 21871 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:09.796073 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:09.796671 21947 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.797130 21947 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:09.797741 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:09.798323 22019 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.797940 21947 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.799149 21947 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.796886 22017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "590d7eea40954779924038b15b716b58"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:09.801680 22017 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.802047 22017 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.806114 21947 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:09.807433 21773 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.815877 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:09.817672 23208 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.818637 22019 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:09.818832 23208 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:09.819705 23208 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.821885 22017 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.824162 22017 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:09.826831 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:09.827343 21875 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.830063 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:09.830651 21947 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.830947 21947 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:09.831647 21947 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.832805 21947 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.833277 21875 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:09.834887 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:09.835678 23160 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.836289 23160 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:09.837204 23160 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.850754 21773 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.855271 21947 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:09.855485 23210 raft_consensus.cc:993] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:09.863257 23027 raft_consensus.cc:1081] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:09.864809 22017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:09.865424 22017 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:09.865787 22017 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.872362 22017 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.871997 21773 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.874413 22017 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:09.875326 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:09.875937 21875 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.877720 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:09.878300 21947 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:09.878579 21947 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:09.879359 21947 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.880637 21947 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.885793 21875 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:09.886945 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:09.887658 23203 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:09.888152 23203 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:09.889048 21947 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:09.889003 23203 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:09.898393 21773 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.181628 22017 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:10.183589 23216 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:10.199708 21947 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:10.201113 23216 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:10.223557 21873 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:10.225584 23160 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:10.226444 21947 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:10.227865 23216 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:10.237381 21871 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:10.238929 23216 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:10.870254 21840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.018s	sys 0.064s
W20260709 13:06:10.870687 21840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.018s	sys 0.064s
W20260709 13:06:10.917306 21839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.005s	sys 0.005s
W20260709 13:06:10.917768 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.005s	sys 0.005s
W20260709 13:06:10.951587 21841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.001s	sys 0.015s
W20260709 13:06:10.952067 21841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.001s	sys 0.015s
W20260709 13:06:11.259310 21896 debug-util.cc:398] Leaking SignalData structure 0x7b0800309620 after lost signal to thread 20759
I20260709 13:06:11.318291 23256 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.318950 23256 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.321202 23256 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.338575 23256 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.339135 23256 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.342392 23256 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.344731 23256 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.345311 23256 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.349488 23256 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.355417 21773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 268) took 1139 ms. Trace:
I20260709 13:06:11.357769 21773 rpcz_store.cc:276] 0709 13:06:10.215735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.221736 (+  6001us) service_pool.cc:224] Handling call
0709 13:06:11.355280 (+1133544us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:06:11.360927 23256 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.368309 23263 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.371356 23256 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.371412 23263 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.374573 23256 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.374609 23263 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:11.384203 23256 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.384888 23256 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.387001 23256 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.389365 23263 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.389940 23263 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.396710 23259 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.397372 23259 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.405174 23255 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.405772 23255 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.406523 23210 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.407907 23255 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.408576 23255 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.409590 23255 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.412206 23255 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:11.413070 21838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.018s	sys 0.028s
W20260709 13:06:11.413484 21838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.019s	sys 0.028s
I20260709 13:06:11.416074 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.441838 23275 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.442833 23272 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.444286 23272 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.446900 23272 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.447588 23275 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.464493 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.463707 23261 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.467226 23272 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.467983 23261 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.468506 23272 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.469918 23262 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.470484 23262 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.467178 23274 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.471014 23261 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.471354 23274 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.471835 23261 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.434201 23255 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.473255 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.477176 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:11.481252 23255 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.480715 23265 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.429884 23210 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.475019 23272 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.485212 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.472524 23261 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.488135 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.488894 22017 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:11.488327 23265 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.481446 23262 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.491899 23255 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.486996 23276 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.488693 23260 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.496541 23270 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.497843 23274 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.498697 23255 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.499547 23259 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.499687 23210 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.499872 23265 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.500491 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.527064 22019 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:11.500526 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:11.500926 21896 debug-util.cc:398] Leaking SignalData structure 0x7b0800308f40 after lost signal to thread 21807
I20260709 13:06:11.502130 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:11.528189 22017 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:11.493150 23271 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.516701 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.516724 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.523912 23027 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.511708 23263 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:11.517804 23270 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.532833 23210 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.537314 23027 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.546604 23270 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:11.547124 23027 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.548020 22020 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
W20260709 13:06:11.549764 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 47182.9us
I20260709 13:06:11.551401 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:11.552938 21873 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:11.507315 23260 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.532902 23255 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.574347 23285 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.575165 23285 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.578677 23275 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:11.578998 23279 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.549077 23270 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.537863 23271 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.550292 23277 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.503438 23276 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.600943 23269 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.601377 21874 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:11.604552 23027 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.604511 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:11.552886 23210 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.607353 23027 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.579597 23279 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.587530 23259 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.632304 23027 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.608078 23261 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.589077 23273 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.606391 23272 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.693703 23210 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.655500 23269 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.693989 23027 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.654115 23267 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.695024 23255 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.695675 23283 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.670459 23264 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.697552 23279 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.737390 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:11.738065 21873 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:11.699142 23265 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.699489 23276 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.699676 23263 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.700237 23290 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.602645 23277 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.660104 23282 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.588230 23270 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.700362 23293 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.701289 23295 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.701628 23285 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.703413 23271 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.655097 23259 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.669802 23284 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.704591 23260 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.409803 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:11.708478 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 93440.8us
W20260709 13:06:11.709616 21947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.476s	user 0.034s	sys 0.064s
I20260709 13:06:11.725431 23298 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:11.731601 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 106483us
I20260709 13:06:11.770118 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.698174 23286 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.739583 23027 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.712723 23261 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.735854 23264 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.740727 23279 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.748478 23283 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.732563 23210 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.763331 23289 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.763923 23288 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.764971 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:11.766109 23300 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.766636 23297 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.726212 23272 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:11.771294 21947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.538s	user 0.034s	sys 0.065s
I20260709 13:06:11.775507 21988 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:11.775766 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:11.737655 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:11.780865 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.789024 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:11.789296 23055 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:11.783815 23027 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.789927 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:11.790153 23027 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.757296 23265 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.772439 23276 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.789661 23055 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.761735 23263 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.790628 23027 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.791040 23055 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.760314 23290 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.739007 23273 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.793704 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 61) took 1557 ms. Trace:
I20260709 13:06:11.791801 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.790472 22608 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:06:11.782261 23271 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.772722 23295 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.782716 23260 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.810084 23260 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.791978 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.770749 23293 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.785882 23210 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.789553 23175 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.817673 23270 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.818066 23269 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.790031 23125 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.819388 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.740331 23267 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.783283 23261 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.794777 23255 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:11.821221 23285 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:11.794096 21947 rpcz_store.cc:276] 0709 13:06:10.230830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.230953 (+   123us) service_pool.cc:224] Handling call
0709 13:06:10.231336 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.232672 (+  1336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.232700 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.233334 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.788394 (+1555060us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:11.788433 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.788504 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.788543 (+    39us) raft_consensus.cc:1685] finished
0709 13:06:11.788555 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.788695 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":1554616,"threads_started":1,"wal-append.queue_time_us":682155}
I20260709 13:06:11.834498 23290 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.812451 23260 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.784375 23279 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.844197 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.794903 23192 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:11.824682 23296 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.780865 23284 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.820789 23288 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.807808 23289 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.797022 23297 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.796717 23276 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.854851 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.858455 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:11.861286 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.773936 23282 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.863689 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.846045 23255 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.789562 23286 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.819545 23271 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.847317 23285 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.869586 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.856365 23192 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.869844 23255 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.865010 21947 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:11.844957 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.843384 23125 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.836809 23175 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.843741 23269 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:11.887735 23289 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.888298 23289 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.888772 23289 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.889496 23286 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.890686 23289 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:11.873325 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 84350.2us
I20260709 13:06:11.891566 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:11.873354 23285 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.882594 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.784731 23298 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.864265 23291 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:11.885653 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 95785.1us
I20260709 13:06:11.886044 23305 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:11.853436 23263 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:11.878855 23192 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.893743 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.809149 23300 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.877367 23055 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:11.890944 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:11.902415 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:11.904768 21987 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:11.908722 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:11.909384 21875 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:11.870280 23296 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:11.881500 23259 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.940201 23263 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.940821 23263 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:11.941213 23263 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.942212 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.011771 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.141192 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:11.966567 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8d60 after lost signal to thread 21899
I20260709 13:06:12.147022 23307 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:12.114122 23210 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.083446 23277 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.094729 23289 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:12.092098 23296 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.157330 23309 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:12.158406 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.938831 23260 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:11.938593 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:11.911310 23270 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.058693 23264 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.145419 23282 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.011900 23261 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:11.994272 23305 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:12.145085 23259 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.965462 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:12.184527 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 199997us
I20260709 13:06:12.279254 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:12.185971 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.280563 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:12.281889 21945 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:12.137523 23297 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.285894 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.292182 23298 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:11.966724 23291 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:12.267688 23265 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:12.267091 23299 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:11.966094 23292 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:12.157784 23288 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.173274 23279 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.114346 23284 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.326122 23292 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:12.183797 23289 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:12.302174 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.300812 23125 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.187976 23260 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:12.297323 23293 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.280682 23270 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.308485 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.248493 23309 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:12.310096 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.310823 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.311628 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.312561 23160 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:12.299011 23175 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.186141 23307 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:12.341897 23260 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.328191 23291 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:11.965950 23267 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:12.155088 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 336607us
I20260709 13:06:12.322544 23305 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.325362 23300 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.293058 23310 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:12.288295 23304 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:12.281980 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.336212 21946 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:12.339800 23289 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.340806 21945 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:12.337536 23270 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:12.345072 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.287462 23259 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:12.355615 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.345870 23160 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:12.365937 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.337044 23299 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:12.380471 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:12.632689 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 277478us
I20260709 13:06:12.726792 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:12.423022 21947 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:12.728415 21873 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:12.728883 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:12.632928 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 280672us
I20260709 13:06:12.709278 23055 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:12.777379 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:12.639843 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.788571 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:12.777834 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:12.591037 23285 consensus_meta.cc:287] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.004s
W20260709 13:06:12.809041 21869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.031s	sys 0.048s
I20260709 13:06:12.369221 23160 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:12.587600 23255 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.008s
I20260709 13:06:12.362675 23304 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:12.775339 23263 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.834s	user 0.012s	sys 0.000s
I20260709 13:06:12.369973 23125 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:12.591672 23259 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.512210 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:12.851536 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73808.7us
W20260709 13:06:12.864686 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 134270us
I20260709 13:06:12.564173 23307 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:12.810532 23055 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:12.886307 23055 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:12.870990 21869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.039s	sys 0.048s
I20260709 13:06:12.565836 23292 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.590744 23270 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.403764 23305 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:12.881600 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1697) took 1122 ms. Trace:
I20260709 13:06:12.403121 23289 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:12.885001 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.773764 23265 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.896979 23055 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:12.889463 21990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.052s	sys 0.101s
I20260709 13:06:12.587682 23309 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:12.894639 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.807212 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.889110 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:12.945644 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:12.869527 23304 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:12.879026 23175 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:12.952069 21990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.053s	sys 0.102s
I20260709 13:06:12.953380 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:12.954686 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:12.949359 21873 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:12.890661 22016 rpcz_store.cc:276] 0709 13:06:11.759255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.880658 (+1121403us) service_pool.cc:224] Handling call
0709 13:06:12.880984 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.881179 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.881212 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.881269 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:12.881310 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.881381 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.881524 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:12.596942 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:12.883271 23125 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:12.880431 23285 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:13.073459 22575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.051s	sys 0.113s
I20260709 13:06:12.883028 23263 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:13.073933 22575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.051s	sys 0.113s
I20260709 13:06:12.880882 23255 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.005762 23175 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.082433 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1254) took 1173 ms. Trace:
W20260709 13:06:13.082919 21941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 782) took 1301 ms (client timeout 1511 ms). Trace:
I20260709 13:06:13.083405 23271 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.082877 21869 rpcz_store.cc:276] 0709 13:06:11.908928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.909276 (+   348us) service_pool.cc:224] Handling call
0709 13:06:11.909695 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.910081 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.910119 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.910729 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:06:12.887573 (+976844us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:12.887617 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.887696 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.082189 (+194493us) raft_consensus.cc:1685] finished
0709 13:06:13.082210 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.082347 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":245080,"thread_start_us":745819,"threads_started":1,"wal-append.queue_time_us":1095352}
I20260709 13:06:12.370219 23310 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:12.990033 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.066263 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.086921 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.089200 22017 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:13.087437 22016 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:13.057458 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.084367 23307 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:12.847769 23314 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.295s
I20260709 13:06:13.098632 22023 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:13.090276 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.066337 23308 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.093760 21946 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:12.950696 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.005061 23289 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.096431 23175 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:13.083714 21941 rpcz_store.cc:269] 0709 13:06:11.781958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.492864 (+710906us) service_pool.cc:224] Handling call
0709 13:06:13.082811 (+589947us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:13.115515 21839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.224s	user 0.022s	sys 0.134s
W20260709 13:06:13.101397 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 220410us
W20260709 13:06:13.072268 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 84334.2us
W20260709 13:06:13.126922 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.025s	sys 0.136s
I20260709 13:06:13.086027 23323 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.005813 23269 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:13.074299 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1272) took 1216 ms. Trace:
I20260709 13:06:13.065918 23291 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.104684 22017 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:13.106130 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.134075 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.032917 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.134822 22019 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:13.096648 23310 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.133047 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:13.110212 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 301956us
I20260709 13:06:12.932888 23265 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:13.102139 21874 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:13.101367 23208 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.128999 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.100561 23315 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.089969 23313 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:13.078285 23305 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.139859 21873 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:13.087184 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.142251 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.113137 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.142735 22603 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:13.143261 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 268) took 1371 ms. Trace:
I20260709 13:06:13.100951 23307 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:13.147002 23192 consensus_meta.cc:287] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.207s	user 0.017s	sys 0.003s
I20260709 13:06:13.147136 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:13.148959 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 273900us
I20260709 13:06:13.029970 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.150358 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:13.138111 21838 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.511s (SENT) [suppressed 1 similar messages]
I20260709 13:06:13.129879 23269 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.132367 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:13.156883 21896 debug-util.cc:398] Leaking SignalData structure 0x7b0800093c80 after lost signal to thread 21974
W20260709 13:06:13.162961 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08002d75e0 after lost signal to thread 22048
I20260709 13:06:13.150722 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.140657 23265 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.175371 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:13.176015 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 781) took 1379 ms. Trace:
I20260709 13:06:13.176987 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.177452 23309 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.130020 21950 rpcz_store.cc:276] 0709 13:06:11.857771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.563785 (+706014us) service_pool.cc:224] Handling call
0709 13:06:12.885040 (+321255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.942983 (+ 57943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.950938 (+  7955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.952397 (+  1459us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:13.005347 (+ 52950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.031450 (+ 26103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.069575 (+ 38125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:13.179373 23289 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.180395 23255 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.141360 23262 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.133074 23323 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.169103 23269 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.183287 23276 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.185032 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.156428 22606 rpcz_store.cc:276] 0709 13:06:11.765733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.806938 (+1041205us) service_pool.cc:224] Handling call
0709 13:06:13.137042 (+330104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:13.140827 23291 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.186604 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.188098 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.169235 23192 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:13.220628 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 58272.1us
I20260709 13:06:13.190302 23305 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.190963 23307 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.193949 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.156975 21946 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:13.206761 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.202864 21948 rpcz_store.cc:276] 0709 13:06:11.774273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.774418 (+   145us) service_pool.cc:224] Handling call
0709 13:06:11.786153 (+ 11735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.869127 (+ 82974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.869155 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.869198 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:11.869231 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.153756 (+1284525us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b5400298954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:13.153800 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.153908 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190377856}
I20260709 13:06:13.110988 23308 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.219497 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.232157 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.209226 23309 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:13.227548 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.226984 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.238966 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.157492 23313 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.233940 21875 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:13.225111 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.155983 23315 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.226919 23285 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.243606 23323 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.244203 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.235906 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.230710 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.245155 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.243654 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.245752 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.248121 21839 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:13.254103 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.244894 23027 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.251207 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.251646 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.252393 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.244894 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.253716 23125 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.252997 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.236302 23309 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.257532 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.252992 21941 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:13.257053 23175 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.260859 23192 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.259037 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.256726 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.258109 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.261406 21866 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:13.266248 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.259531 23322 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.261848 21950 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:13.265169 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.255961 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.254285 23306 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:13.272856 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1280 after lost signal to thread 22634
I20260709 13:06:13.280189 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.244203 23313 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.256220 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:13.275095 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 136998us
I20260709 13:06:13.272101 23291 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.266362 23315 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.277195 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:13.251148 22576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.036s	sys 0.133s
I20260709 13:06:13.281697 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:13.280822 22610 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:13.287231 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.288154 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.283676 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:13.279253 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.289301 23313 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.275750 23262 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.291920 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.292198 23262 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.292465 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.293107 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.293380 22604 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:13.294320 23262 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.294659 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.290920 21839 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:13.291628 22605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 270) took 1525 ms (client timeout 2015 ms). Trace:
I20260709 13:06:13.289834 23313 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:13.294268 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.296852 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:13.297340 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:13.314076 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.260141 23160 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:13.286635 22576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.037s	sys 0.133s
I20260709 13:06:13.280213 23322 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.313619 23175 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:13.350860 23175 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:13.351444 23175 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.352173 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1702) took 1567 ms. Trace:
I20260709 13:06:13.352622 22020 rpcz_store.cc:276] 0709 13:06:11.784389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.784505 (+   116us) service_pool.cc:224] Handling call
0709 13:06:11.784810 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.815413 (+ 30603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.815446 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.815485 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:11.815517 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.351877 (+1536360us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b54000de3d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:13.351926 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.352077 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69958528}
I20260709 13:06:13.356254 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1281) took 1466 ms. Trace:
I20260709 13:06:13.357046 22604 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:13.357674 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1242) took 1818 ms. Trace:
I20260709 13:06:13.319348 23328 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.319746 23285 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.319902 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.298418 23192 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.289911 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.330125 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:13.378394 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:13.378425 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 62224.9us
I20260709 13:06:13.358122 21871 rpcz_store.cc:276] 0709 13:06:11.539306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.539465 (+   159us) service_pool.cc:224] Handling call
0709 13:06:11.539824 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.586132 (+ 46308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.586172 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.586223 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:11.586282 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.357385 (+1771103us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b540044dc54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:13.357445 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.357598 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106008320}
I20260709 13:06:13.365547 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.356734 21942 rpcz_store.cc:276] 0709 13:06:11.889862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.861548 (+971686us) service_pool.cc:224] Handling call
0709 13:06:13.355531 (+493983us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:13.355739 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.355919 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.355946 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:13.355989 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:13.356021 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.356077 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.356192 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41780480}
I20260709 13:06:13.385999 23295 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:13.383148 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 84346.8us
I20260709 13:06:13.383111 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.291347 23291 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.285488 23306 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.382290 23272 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.417451 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.418298 21941 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:13.419056 23306 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.420270 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.416013 21839 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:13.416195 23310 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:13.297837 23313 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.376197 23322 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.421905 23321 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.423978 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.439147 23160 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.439424 22602 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:13.439847 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.441466 23309 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.441839 23269 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.440462 21941 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:13.443181 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.443498 23309 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.443909 23269 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.376744 23304 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:13.296792 22605 rpcz_store.cc:269] 0709 13:06:11.766395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.272043 (+1505648us) service_pool.cc:224] Handling call
0709 13:06:13.291574 (+ 19531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:13.451377 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.452316 21948 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:13.452817 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:13.453212 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.453905 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:13.454727 23322 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:13.455070 23322 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.455411 23322 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.436543 23272 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:13.463416 22608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 267) took 1695 ms (client timeout 1700 ms). Trace:
I20260709 13:06:13.463935 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 1712) took 1448 ms. Trace:
W20260709 13:06:13.464960 22608 rpcz_store.cc:269] 0709 13:06:11.764591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.764729 (+   138us) service_pool.cc:224] Handling call
0709 13:06:13.459958 (+1695229us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b5400586954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:13.460048 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14700928}
I20260709 13:06:13.465397 22023 rpcz_store.cc:276] 0709 13:06:12.011351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.011503 (+   152us) service_pool.cc:224] Handling call
0709 13:06:13.459847 (+1448344us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400199e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:13.459980 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198528256}
I20260709 13:06:13.466110 23272 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.471931 23265 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.476119 23258 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:13.476826 23258 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.477352 23258 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.478242 22022 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:13.436061 23291 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.466275 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.461496 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.465209 23256 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:13.468214 23272 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:13.480508 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 253590us
I20260709 13:06:13.444460 23321 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.501118 23175 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.511802 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.513613 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.516863 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:13.517102 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:13.509541 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 75215.2us
I20260709 13:06:13.512992 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:13.520545 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:13.478826 23308 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.528570 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.528766 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.532444 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.525203 23285 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.540575 23027 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.540691 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:13.543220 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.514526 23192 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:13.532708 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:13.547524 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1698) took 1786 ms. Trace:
I20260709 13:06:13.549397 23321 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.550189 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 778) took 1782 ms. Trace:
I20260709 13:06:13.543972 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:13.552465 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.522526 23256 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.555305 21869 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:13.550799 22021 rpcz_store.cc:276] 0709 13:06:11.760913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.761045 (+   132us) service_pool.cc:224] Handling call
0709 13:06:11.769033 (+  7988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.820293 (+ 51260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.820313 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.820340 (+    27us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:11.820357 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.547189 (+1726832us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b540017b6d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:13.547241 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.547362 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117457152}
I20260709 13:06:13.561400 23291 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.555824 21943 rpcz_store.cc:276] 0709 13:06:11.767645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.767824 (+   179us) service_pool.cc:224] Handling call
0709 13:06:11.768084 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.842101 (+ 74017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.842147 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.842207 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:11.842247 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.549981 (+1707734us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b54002788d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:13.550026 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.550133 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169679104}
I20260709 13:06:13.562603 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1706) took 1149 ms. Trace:
I20260709 13:06:13.563069 21875 rpcz_store.cc:276] 0709 13:06:12.413059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.677479 (+264420us) service_pool.cc:224] Handling call
0709 13:06:12.677834 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.241379 (+563545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.562400 (+321021us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b5400219154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:13.562554 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278360960}
I20260709 13:06:13.574157 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 780) took 1804 ms. Trace:
I20260709 13:06:13.574589 21949 rpcz_store.cc:276] 0709 13:06:11.769280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.769395 (+   115us) service_pool.cc:224] Handling call
0709 13:06:11.769647 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.777119 (+  7472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.777147 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.777186 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:11.777216 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.573952 (+1796736us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b540019cb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:13.573995 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.574104 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16708352}
I20260709 13:06:13.608759 21773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 265) took 2158 ms. Trace:
W20260709 13:06:13.631214 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 60929.8us
I20260709 13:06:13.609292 21773 rpcz_store.cc:276] 0709 13:06:11.416835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.417055 (+   220us) service_pool.cc:224] Handling call
0709 13:06:13.574670 (+2157615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":291457,"reported_tablets":1}
I20260709 13:06:13.634262 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.634904 23027 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.637540 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:13.649044 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.649721 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:13.649506 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.569233 23308 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:06:13.657198 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.655407 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.656798 23260 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.665593 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:13.666328 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.672565 23027 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.672946 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:13.674551 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.675024 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:13.675854 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.675871 21916 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:13.682121 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:13.688433 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:13.664207 23336 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:13.691843 23263 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.696738 23327 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.697553 23327 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.633545 23153 consensus_queue.cc:1059] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:06:13.705852 23337 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.665719 23175 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.704497 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.705219 23027 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.710999 23027 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:13.712049 21947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1280) took 1820 ms (client timeout 2129 ms). Trace:
W20260709 13:06:13.712505 21947 rpcz_store.cc:269] 0709 13:06:11.889560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.301862 (+412302us) service_pool.cc:224] Handling call
0709 13:06:13.709763 (+1407901us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b540019d054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:13.709864 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206270720}
I20260709 13:06:13.713733 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.714344 22023 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:13.714629 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.716260 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.672339 23306 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.607837 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:13.709506 21771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 239) took 2222 ms. Trace:
I20260709 13:06:13.720839 21771 rpcz_store.cc:276] 0709 13:06:11.486636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.486781 (+   145us) service_pool.cc:224] Handling call
0709 13:06:13.709420 (+2222639us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457994,"reported_tablets":1}
I20260709 13:06:13.718428 22019 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:13.685652 23262 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.690313 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.711453 23027 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.725907 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.635388 23322 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.706459 23337 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.729815 22019 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:13.725003 23326 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.692402 23279 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.688167 23308 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.717463 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.738952 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:13.744423 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.747833 22024 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:13.725282 23269 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.747498 22023 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:13.732491 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.747020 23308 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.752638 23301 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:13.753162 23301 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.753669 23301 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.700552 23327 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.701968 23271 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.719605 23275 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.732255 23262 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.707868 23273 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.751938 21916 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.705197 23295 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.750471 23269 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.701025 23283 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.756860 23300 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.777187 23337 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.793144 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 1722) took 1185 ms. Trace:
I20260709 13:06:13.767654 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.796516 22022 rpcz_store.cc:276] 0709 13:06:12.607442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.849797 (+242355us) service_pool.cc:224] Handling call
0709 13:06:13.792913 (+943116us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b540025f8d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:13.793083 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167789824}
I20260709 13:06:13.729012 23306 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.797627 23256 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.781190 23269 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.781345 23326 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.754370 23308 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.798091 23260 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:13.810204 23260 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:13.810340 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.810621 23260 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:13.811460 23260 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:13.768421 23275 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.813323 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:13.813776 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 809) took 1520 ms. Trace:
I20260709 13:06:13.814133 22017 rpcz_store.cc:276] 0709 13:06:12.293269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.133958 (+840689us) service_pool.cc:224] Handling call
0709 13:06:13.134322 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.227454 (+ 93132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.227482 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:13.227520 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:13.227549 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.813541 (+585992us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b5400198f54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:13.813586 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.813722 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211667840}
I20260709 13:06:13.815828 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.816642 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 1721) took 1243 ms. Trace:
I20260709 13:06:13.817026 22016 rpcz_store.cc:276] 0709 13:06:12.573284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.097616 (+524332us) service_pool.cc:224] Handling call
0709 13:06:13.815684 (+718068us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800200498. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:13.816551 (+   867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2754944}
I20260709 13:06:13.805836 23326 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:13.804181 23299 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.800477 23259 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:13.821910 23275 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.833361 23322 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:13.833643 21839 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:13.840145 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.841544 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.831970 23258 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.832319 23272 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.840687 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.843971 21873 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:06:13.844735 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 309102us
I20260709 13:06:13.847584 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.857234 23317 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:13.857882 23317 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.858350 23317 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.812738 23262 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.861562 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.835453 23260 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.867851 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.869185 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.870853 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.871429 22023 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:13.873497 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:13.835449 23326 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.835242 23306 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:13.877414 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 460270us
I20260709 13:06:13.881644 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:13.882036 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.883867 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.824319 23313 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:13.882297 21873 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:13.886600 22574 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:13.890739 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:13.892102 21838 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:13.894201 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:13.895471 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:13.898454 23321 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.898568 23318 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.900264 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:13.899855 23125 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:13.908190 21838 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:13.919796 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:13.920892 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:13.926205 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:13.930467 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.880465 23269 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.920537 23125 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:13.923846 23280 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.926483 23175 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:13.945511 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:13.937775 23318 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.933069 23256 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.952318 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.966923 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.964172 23027 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:13.972019 23272 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:13.972047 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.973474 22020 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:13.973650 23253 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:13.973902 22024 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:13.974040 23253 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:13.974463 23253 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.974524 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.975143 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.975653 22023 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:13.975587 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.976317 22017 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:13.945983 23276 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:13.976512 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.945739 23125 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:13.946646 23280 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:13.990785 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 314954us
I20260709 13:06:13.991674 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.962474 23318 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:13.962041 23256 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:13.994065 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:13.996373 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:13.995692 22015 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:14.001215 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.001775 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.991720 23280 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.004824 21949 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:13.995384 23279 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.005899 22022 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.009186 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:13.992864 23258 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:13.994655 23318 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.995327 23256 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:13.995251 23295 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.011991 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.018404 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.013360 21947 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:14.021260 23153 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.028848 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:14.029785 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.032150 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.056865 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.002736 23027 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.027680 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.003587 23304 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:14.043186 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.102236 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.103906 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:14.107055 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49574.8us
I20260709 13:06:14.043591 23313 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:14.041528 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:14.116696 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 337120us
I20260709 13:06:14.128316 21871 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.123955 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.124799 21987 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:14.129151 21916 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.107753 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.061391 23300 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.130364 22022 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:14.133447 22019 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:14.136078 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.044373 23273 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:06:14.138516 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:14.107755 23275 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.087224 23279 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:06:14.145495 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:14.149201 21947 raft_consensus.cc:606] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:14.146641 23265 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:14.131683 23287 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.150003 23269 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:14.151507 23273 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.151954 23273 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:14.152067 23344 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.097s	user 0.000s	sys 0.006s
I20260709 13:06:14.154104 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.153147 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.153141 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.143923 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.141209 23346 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.157691 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:14.159106 23343 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:06:14.159380 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.160522 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.148663 23275 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:14.159377 23347 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.187475 21772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 269) took 1011 ms. Trace:
I20260709 13:06:14.161993 23253 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.165988 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.189222 23326 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.199963 23253 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.195264 23347 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:14.199891 21949 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:14.200049 23326 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.196708 21772 rpcz_store.cc:276] 0709 13:06:13.176056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.176225 (+   169us) service_pool.cc:224] Handling call
0709 13:06:14.187386 (+1011161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396286,"reported_tablets":1}
I20260709 13:06:14.201548 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.202936 21942 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:14.203903 21942 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.205622 23347 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.166383 23317 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:14.208834 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 54805.4us
I20260709 13:06:14.209939 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.168361 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.207763 23273 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.168936 23301 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.169688 23291 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.213845 23273 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.212177 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.160768 23284 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.170984 23276 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:14.171766 23290 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.174203 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:14.153023 23287 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:14.177161 22610 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.177646 21871 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.179232 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.181471 21946 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:14.181708 23269 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.169889 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:14.185782 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.197955 23292 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.197587 23275 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.167184 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.216337 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.240407 23287 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.241052 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.199856 23318 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.186374 23256 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.207994 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:14.244799 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 91677.3us
I20260709 13:06:14.218298 23284 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:14.252951 23306 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:14.241212 23280 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.256160 21948 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:14.214905 23295 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.256868 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.254946 23307 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:14.267482 23295 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.267673 23307 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.268146 23307 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:14.256129 23279 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.258498 23300 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.258980 23285 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:14.270305 23285 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.270741 23285 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:14.270229 23307 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.271247 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.271698 23279 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:14.271608 23285 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.272217 23279 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.253968 23292 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:14.275095 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:14.278525 21873 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.280241 23304 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.280717 23304 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:14.281172 23304 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.277479 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.281796 21948 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.277590 23256 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:14.287030 22021 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:14.290808 21948 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:14.292559 23285 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.274492 23292 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.273149 23306 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.294039 23280 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:14.295316 23306 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.297750 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:14.298560 23291 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:14.299036 23291 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:14.299787 23291 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.218748 23276 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.217902 23345 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.220256 23346 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:14.263444 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 96339.8us
I20260709 13:06:14.309844 21988 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.311002 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.264556 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.265259 23269 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.313395 23253 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:14.313908 23253 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.314338 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.313386 23263 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.239346 23290 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:14.315335 23283 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.316020 23290 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.316576 23306 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:14.317203 23290 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.317305 23253 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.318248 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.189203 23125 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.266458 23318 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.271631 23307 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.268296 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.255288 23301 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.301753 21871 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.303018 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:14.320780 23346 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.305034 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:14.305423 23349 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.322001 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.265774 23284 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.312148 23027 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:14.312258 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 47738.8us
I20260709 13:06:14.266628 22018 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.324070 23349 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:14.317812 23321 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.327924 23321 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:14.327849 23349 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.329248 23349 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.328964 23321 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:14.320940 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 52744.9us
I20260709 13:06:14.324080 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.324349 23327 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.327451 23337 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.329965 23265 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.333276 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.334128 23275 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.334710 23337 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.330828 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.331627 23321 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.337360 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.339047 23346 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.339140 23306 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:14.338979 23027 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.339903 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.341041 23300 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.342180 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.343457 22573 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.346131 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.346675 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.349179 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:14.350425 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.350569 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:14.352710 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.353050 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.354136 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:14.354892 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:14.356174 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:14.356863 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.357394 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.352258 23263 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.324752 23253 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:14.332450 23279 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.360069 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.352412 23153 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:14.356926 21870 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.360141 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.363981 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.365046 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.384631 23275 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:14.392442 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.393601 23153 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.393698 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.394093 23153 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:14.394615 23274 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:14.395030 23274 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:14.366242 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.400911 21875 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:14.358536 23322 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.370893 23263 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:14.370911 21950 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.372201 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.374315 23256 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.374686 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.376199 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.413686 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.414237 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.415259 23259 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.415359 23300 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:14.416136 22018 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:14.418810 23350 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.419381 23299 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.419837 23299 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:06:14.420265 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60297.7us
I20260709 13:06:14.421387 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.421084 23299 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.422194 23322 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:14.422665 23299 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.422608 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.423158 23322 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:14.338050 23318 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:14.341573 23301 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.377025 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.377478 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.382046 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.382504 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.383785 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.376538 23281 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:14.386036 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.386116 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.365453 23288 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:14.396932 21942 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.358327 23271 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.403416 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.402557 23274 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.404036 23310 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.404836 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.407886 22020 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.409759 23263 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:14.424964 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 50350.1us
I20260709 13:06:14.380158 23253 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.394863 23153 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:14.451741 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68106.2us
I20260709 13:06:14.457064 21942 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:14.429675 23280 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:14.464653 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 59905.5us
I20260709 13:06:14.433880 23306 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.460888 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.461436 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.467047 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.433928 23315 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.467759 23315 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:14.467846 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:14.468369 21949 raft_consensus.cc:606] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.468571 23315 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.469506 23315 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.463366 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.459344 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.429611 23322 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:14.470868 23322 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.465341 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.456367 23265 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.386749 23347 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.479334 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.453086 23317 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:14.480552 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.489552 23281 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.490810 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.491789 23281 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.482499 23272 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.483537 21948 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.492251 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.436124 23318 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.496505 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.504089 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.505846 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.477412 23125 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:14.506656 23256 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.514670 21945 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.505897 23327 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:14.515313 23312 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.480996 23175 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:14.518013 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.517807 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.496978 23337 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.496580 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.522732 23304 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.534848 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.504272 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:14.504220 23313 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:14.541236 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 70054.1us
I20260709 13:06:14.542497 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:14.543156 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 79666.5us
I20260709 13:06:14.522991 23275 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.544828 23275 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:14.545563 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.545681 23275 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.542466 23175 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.547165 23175 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:14.547430 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.548126 23283 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.546470 23358 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.529287 23280 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.497882 23310 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:14.465662 23288 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.549255 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.560245 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.567060 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.533689 23256 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:14.607137 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 57956.1us
I20260709 13:06:14.607918 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.539743 23281 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.609341 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.543552 23262 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:14.612406 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70389us
I20260709 13:06:14.524243 23317 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:06:14.615186 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 92963.4us
I20260709 13:06:14.604246 23315 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.606361 23275 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.603062 23313 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.626928 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.627138 21871 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.627606 21874 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.629338 21868 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.610562 23270 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.621106 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.737002 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.624723 23283 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.624553 23265 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.748711 23348 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.730618 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:14.749300 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 140365us
I20260709 13:06:14.742040 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.702818 23313 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:06:14.754603 23273 consensus_meta.cc:287] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.539s	user 0.013s	sys 0.000s
I20260709 13:06:14.702499 23125 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:06:14.759429 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.621611 23300 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
W20260709 13:06:14.762017 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:14.762552 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.746169 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.760727 23301 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:14.768345 23287 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.005s
W20260709 13:06:14.786378 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 165768us
I20260709 13:06:14.793637 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:14.794458 22020 raft_consensus.cc:606] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.795846 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:14.774142 23347 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:14.800771 23272 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.778175 23253 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:14.804629 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 195342us
I20260709 13:06:14.786067 23263 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:14.808212 23367 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.808624 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.809633 21946 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:14.792762 23287 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:14.802582 23353 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:06:14.811003 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.818243 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.790068 23300 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:06:14.809906 23318 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:14.804772 23312 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:06:14.830549 23312 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.830933 23312 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:14.834216 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.823251 23304 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:14.837286 23290 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:06:14.839448 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.840682 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.817093 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.791690 23313 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.827280 23288 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.841743 23318 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.846947 21950 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:14.857990 23321 consensus_meta.cc:287] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.516s	user 0.003s	sys 0.007s
W20260709 13:06:14.861974 23307 consensus_meta.cc:287] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.002s
I20260709 13:06:14.866204 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:14.825084 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 366417us
I20260709 13:06:14.874684 23153 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.864324 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.846698 23363 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.865032 21870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:36954
I20260709 13:06:14.878958 21870 raft_consensus.cc:606] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Received request to transfer leadership to TS 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.879086 21868 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.864351 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.864156 23355 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.878094 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:14.883422 23287 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:14.883611 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:14.870189 23313 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:14.886322 23276 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.003s
I20260709 13:06:14.886747 23276 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.871640 23253 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.888968 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.889000 21943 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:14.892920 23273 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.893747 23125 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:14.893983 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.896378 23281 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:14.831769 23312 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.904465 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:14.914443 23362 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:14.904846 23373 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:14.896796 23281 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:14.918165 23292 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.910049 23285 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.917307 23295 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.936386 22022 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:14.938036 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:14.942531 22020 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.943025 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:14.943696 21871 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.945061 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.903402 23355 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:14.955466 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.936297 23285 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:14.956280 23055 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.935920 23295 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:14.915027 23362 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.957566 23175 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:14.959041 23175 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.959360 23175 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:14.960095 23175 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.960798 23327 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:14.961380 23175 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:14.961768 23327 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.962121 23327 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:14.915644 23274 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:14.954865 21950 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:14.965474 21941 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:14.940764 23373 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.971712 23285 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.973678 23285 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:14.974764 23279 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.974988 23362 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:14.975073 23337 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.976420 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:14.977769 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:14.978668 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:14.981513 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:14.918332 23321 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:15.000211 23265 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.001298 23306 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:14.968168 23349 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.000s
I20260709 13:06:14.949019 23262 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.994021 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.918938 23281 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.006639 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:15.006505 23281 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:14.989508 23284 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
I20260709 13:06:15.010282 23355 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.010577 23284 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.012746 22016 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.938448 23307 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:14.975998 23327 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:14.998138 23055 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:14.987789 23322 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:06:15.018743 23267 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.019193 23267 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:14.999531 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.003208 23265 raft_consensus.cc:993] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:15.020342 23265 raft_consensus.cc:1081] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:06:15.001739 23306 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:14.994612 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:14.985697 23274 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.003338 23360 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.021858 23360 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:15.016844 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:15.018883 23322 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.023479 23055 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.023612 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.024677 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:14.985103 23373 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.021814 23306 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.027395 22021 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.027153 21839 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:15.027604 23027 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.030464 23284 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.030535 23317 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:14.983534 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:15.031988 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 77500.3us
I20260709 13:06:15.034226 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:15.035881 22024 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.012746 23362 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.038053 22021 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.037534 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:15.039541 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:15.014744 22601 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.041164 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:15.038770 23310 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.043408 22607 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.045192 23027 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.047142 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:15.042654 23306 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.042882 23258 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.026636 23360 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.062109 23360 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.050664 21868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:06:15.052021 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.052577 22015 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:15.065513 21870 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:15.049149 23373 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.052788 23055 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.068502 21868 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.053287 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:15.069335 21868 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.069744 22024 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:15.043030 23317 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.020076 23267 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.048424 23175 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:15.052100 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:15.063338 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:15.065743 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:15.069586 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:15.054142 23322 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.062445 23372 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.063016 23312 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.068476 23295 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.075351 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:15.075771 23258 raft_consensus.cc:993] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: : Instructing follower 61893f17f34b4cc9b898114d3c0a7023 to start an election
I20260709 13:06:15.093708 23288 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.094136 23288 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:15.094234 23258 raft_consensus.cc:1081] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Signalling peer 61893f17f34b4cc9b898114d3c0a7023 to start an election
I20260709 13:06:15.095002 23288 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.095510 23258 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:15.096309 23288 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.081578 22022 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:15.044764 23307 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.086285 23271 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.103039 23271 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:15.064039 23276 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.066252 23327 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.104005 23271 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.087949 23294 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:15.096768 23274 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.076448 23355 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.098815 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:15.091737 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:15.100062 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:15.107424 21942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:54888
I20260709 13:06:15.110289 21942 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:15.110679 21942 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.103063 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:15.087319 23372 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:15.085179 23306 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:15.114781 23373 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.112078 23274 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:15.115971 23175 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:15.112106 23267 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.111708 21870 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.118301 23274 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.112334 23321 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.122591 23027 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:15.117316 23284 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:15.086954 23349 consensus_queue.cc:1175] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:06:15.098610 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:15.127733 23274 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.128535 21949 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:15.120177 23295 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.132277 23371 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.133384 23368 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.133574 23371 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:15.134733 23368 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:15.123584 23321 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:15.135536 23322 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:06:15.137602 23307 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.138002 23307 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:15.138834 23307 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.136816 23306 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:15.144500 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 59493us
I20260709 13:06:15.137086 23368 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.134341 23372 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.154995 23321 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.155714 23372 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.151371 23307 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.156431 23321 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.135447 23371 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.171875 21942 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.174268 21950 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:15.175221 21866 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:15.175603 21866 pending_rounds.cc:85] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 1
I20260709 13:06:15.175884 21866 pending_rounds.cc:107] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:15.176136 21866 raft_consensus.cc:2889] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:15.161058 23371 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.157155 23368 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.156558 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:15.193789 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:15.195399 23306 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.195554 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.196272 23306 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:15.196956 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.197307 23306 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.197971 23306 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:15.198102 23310 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.195330 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:15.198364 23306 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:15.204156 23306 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.205493 21942 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.205962 23281 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:15.206574 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.208894 22022 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:15.210021 23281 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:15.212059 23281 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.182303 21868 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.211551 23306 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.222715 23281 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.223565 21870 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.211176 23357 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:06:15.235900 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:15.234366 21944 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:15.238379 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:15.239703 23312 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:15.240137 23312 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:15.240419 23310 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.240523 23312 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.238248 23355 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.245306 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.245898 22022 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.246168 22022 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:15.198143 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.241719 23355 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:15.246935 22022 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.250774 22022 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.252106 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:15.252125 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:15.253108 21944 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.244184 21868 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.255332 23281 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.256500 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.257367 22018 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:15.261619 23355 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.263060 21942 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:15.264230 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:15.265309 23281 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:15.265794 23281 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:15.266674 23281 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.281980 22022 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:15.292369 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:15.278182 23315 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:15.294340 23315 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:15.295497 23362 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:15.296064 23315 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.296545 23362 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:15.297495 23362 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.299492 23371 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.300014 23371 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:06:15.294915 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 96841.5us
I20260709 13:06:15.307399 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:15.308097 22018 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:15.306254 23371 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.309491 21916 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:15.310181 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.310839 21868 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:06:15.311115 23371 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.311615 23371 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.312021 23371 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.305166 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:15.316231 23372 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:15.316619 23372 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:15.317022 23372 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.321557 23312 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.320824 23315 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.345888 23312 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.343494 21771 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 2 to 3, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.345760 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:15.348054 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.349043 22022 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:15.363994 23315 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.363917 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:15.373342 21944 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:15.346892 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.374863 23315 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.375327 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:15.376349 23315 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.378764 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.379599 22015 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:15.381062 22018 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:15.381721 21942 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:15.382138 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.382912 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:15.384974 23372 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.414490 22610 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.409750 23312 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:15.418335 23312 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:15.419414 23312 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.419896 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.420809 23315 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.426959 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:15.424275 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.424367 23153 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:06:15.437577 23372 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.438503 23315 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.441632 23292 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.442085 23292 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:15.442909 23292 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.444103 23292 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.444851 22610 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.447780 23274 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:15.448808 23274 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:15.449150 23274 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:15.449935 23274 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.450578 23371 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:15.451217 23274 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:15.476938 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 55297.3us
I20260709 13:06:15.486886 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:15.487327 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.487771 21866 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.488215 22022 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.496060 21866 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.497429 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:15.498386 23295 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.498906 23295 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:15.499832 23295 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:15.509976 23371 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.496285 22022 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.512789 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.519634 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:15.521859 23315 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:15.537680 21773 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.539502 21773 catalog_manager.cc:5697] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.541092 21773 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.555593 21772 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 3, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.558169 21772 catalog_manager.cc:5697] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 3, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.588656 21772 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1), VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2), VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3), NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:15.631713 22610 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:15.633277 23292 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:15.641093 22018 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:15.643060 23292 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:15.655380 23312 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.655948 23312 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.658174 23312 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.659219 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:15.659365 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:15.659994 22610 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:15.660058 21941 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:15.661284 21839 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:15.662463 23312 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.662884 23312 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.663246 23312 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.671773 23312 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.675110 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:15.675552 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:15.676317 22610 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.683476 22610 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:15.675829 21941 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.685783 23292 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.686403 23292 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.690485 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.684010 23312 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.692381 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:15.691192 21868 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:15.693156 22018 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:15.688494 23292 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.694057 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:15.694389 21941 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:15.695315 23292 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.695770 21942 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.695889 21839 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:15.696547 23292 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.697005 23292 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.697170 23312 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.701056 23281 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.698630 23312 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:15.702653 22018 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:15.704303 23312 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.705447 23259 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:15.706648 23292 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.708791 23292 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.709877 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:15.710486 22022 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.710623 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:15.711287 21868 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.717466 21868 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.718739 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:15.719807 23292 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:15.719962 22022 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.720790 23292 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:15.722366 23292 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.738471 22022 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.740197 23281 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:15.785518 21868 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:15.788390 23259 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:15.798796 21772 catalog_manager.cc:5697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.817402 21772 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.821132 22018 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.823220 23312 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.844210 21942 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.845901 23368 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.856720 23360 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:15.857296 23360 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.858064 23357 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:15.858848 23357 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.859494 23360 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:15.864333 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:15.865171 21941 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:15.867545 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.867848 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.868498 21868 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:15.868673 21870 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:15.870857 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:15.871945 23284 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:15.872421 23284 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:15.872815 23284 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.880327 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:15.881098 21941 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:15.882397 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:15.883256 23360 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:15.871855 23357 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:15.896291 23357 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:15.896776 23357 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:15.897159 23357 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:15.897550 23292 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.898393 23292 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.902854 23295 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.895700 23360 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.903864 23295 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.905761 23360 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:15.906386 23360 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.906919 23295 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.914405 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.914677 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.915154 21866 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:15.915367 21870 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:15.907773 23371 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.916512 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:15.916406 23371 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.917119 22607 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.916872 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:15.914016 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:15.918051 22610 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.918174 21941 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:15.918522 23371 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.923311 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:15.923695 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:15.924299 22610 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:15.924808 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.925850 21868 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:15.925746 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:15.926971 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:15.927742 23153 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.928138 23153 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.928534 23153 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.928805 23259 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.929482 23259 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.930068 23259 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.932871 23371 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.933563 23371 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.934092 23371 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.907035 23360 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.945389 23153 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.946063 23360 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.947449 23153 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.908846 23292 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.908581 23284 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.951290 23284 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:15.954051 23259 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.958330 23259 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.958818 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:15.955550 23371 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:15.956465 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 64835.7us
I20260709 13:06:15.962984 23371 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.963565 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.964313 21868 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:15.966282 23362 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.966427 21941 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:15.966459 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:15.966957 23362 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.968071 21870 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:15.969791 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:15.970235 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:15.970526 21870 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:15.970893 22607 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:15.970989 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:15.971614 23362 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:15.971949 23401 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:15.972643 23401 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:15.973464 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:15.973968 23401 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.975250 23368 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:15.975656 23368 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.976047 23368 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.972409 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:15.977092 22610 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:15.981679 23400 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:15.982959 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:15.986181 21868 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:15.984292 23371 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:15.987612 23371 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.992623 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:15.994019 22015 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:15.994422 23274 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.994997 23274 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:15.995772 23371 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:15.996532 23400 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:15.997968 23274 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.004662 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.020083 23400 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.020974 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.021991 22022 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:16.022316 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.023202 21941 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:16.023277 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.006214 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:16.007654 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:16.026237 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:16.027487 23400 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.027961 23400 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.028407 23400 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.029449 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.030244 22604 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:16.030350 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:16.032106 22015 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:16.031188 21870 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:16.027194 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:16.040202 21868 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:16.043741 23400 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.046309 23400 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.047319 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:16.010389 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.049629 23400 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.050062 23400 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:16.050488 23400 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.014451 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.055114 22610 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:16.008533 23368 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.015897 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.040161 23402 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.007413 23357 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.056556 21866 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:16.060807 22022 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:16.063230 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:16.064332 22015 raft_consensus.cc:2368] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:16.064905 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.065532 23400 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.067981 23400 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.047420 23312 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:16.068815 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:16.069833 21941 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:16.071717 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.074398 23400 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.057046 23402 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:16.080894 23402 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.086669 22608 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:16.063285 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:16.124711 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61521.2us
I20260709 13:06:16.126159 21841 leader_election.cc:400] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:16.126480 21841 leader_election.cc:403] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:16.077454 22607 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:16.127676 23362 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.128113 23362 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.128481 23362 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.132761 23274 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.133333 23274 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.135519 23274 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.136054 23274 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.142964 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.149276 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:16.150457 23327 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.151026 23327 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:16.147600 23362 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.151976 23327 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.153605 23360 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.154175 23360 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.157095 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:16.157802 22022 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.158147 23274 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:16.158207 23292 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.159044 23362 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.158887 23292 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.161201 23292 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.162983 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.163740 22018 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:16.164920 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:16.164968 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.166499 23292 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.166917 23292 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.167299 23292 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.167582 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.168303 21870 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:16.169729 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:16.156581 23360 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.175578 23360 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.176019 23360 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.176476 23360 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.058264 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:16.088402 23371 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.186002 23371 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.188576 23371 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.189570 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.192291 22018 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:16.194188 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:16.195417 23295 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.195835 23295 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.196197 23295 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.203142 21772 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 2, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.204288 23295 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.208352 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:16.209075 22018 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.214402 23362 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.215039 23362 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.216946 22018 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:16.218039 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:16.218415 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:16.219496 23371 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:16.219666 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.220362 23371 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:16.218451 23362 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.221395 23371 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.223009 23360 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.224691 22022 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
W20260709 13:06:16.226203 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56557.6us
I20260709 13:06:16.227412 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:16.228533 23362 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.229696 23362 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:16.230695 23362 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.231444 23360 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.233086 23295 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.238279 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.184422 23292 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.239252 22015 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
W20260709 13:06:16.089809 23399 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:16.090096 22601 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:16.074966 23400 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.241660 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:16.242318 22015 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.243088 23400 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.098781 23284 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.243785 23284 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.245754 23284 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.101296 22604 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.105978 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:16.122603 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:16.249990 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 143025us
I20260709 13:06:16.115772 23281 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.251879 23281 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.253975 23281 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.252347 21942 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:16.118882 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:16.250928 23292 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.256510 23292 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:16.122200 23368 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.256865 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.256942 23292 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:16.257575 21949 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:16.123942 23357 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.107575 23402 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.259864 23402 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.123395 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.260481 22610 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.257547 23292 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:16.263456 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.264178 21942 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:16.264251 22604 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.269168 22610 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:16.272500 23368 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.269335 21839 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:16.273331 23368 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.274507 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:16.271749 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:16.272364 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.275802 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:16.274055 23281 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.274600 22018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:16.276021 23368 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.276613 22018 raft_consensus.cc:606] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:16.276896 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:16.277573 23153 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.277820 23259 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.277976 23292 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.278771 23281 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.281345 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:16.281512 23281 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.282114 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.282810 22608 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:16.280968 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.283950 22601 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:16.285033 23259 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:16.285552 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:16.286039 23292 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.286334 22022 raft_consensus.cc:606] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:16.288239 22022 raft_consensus.cc:614] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:16.275924 21942 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.290681 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.291294 22607 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.282114 22018 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:16.297531 23411 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:16.281699 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.297425 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "590d7eea40954779924038b15b716b58"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:16.298570 22609 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.299113 22022 raft_consensus.cc:606] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:16.299571 22022 raft_consensus.cc:614] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:16.286316 23259 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.304687 21870 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:16.309420 21866 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.270211 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.311630 23292 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.313567 23292 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.314339 22018 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:16.317126 23411 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:16.320686 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.327086 23412 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.327322 21950 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:16.321399 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:16.328995 23274 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:16.330164 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:16.330204 23411 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.332583 23312 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.333225 23312 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.333634 23312 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.334704 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.335395 22022 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:16.318854 23281 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.336686 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:16.337412 23292 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.338025 23292 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.338425 23292 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.338846 23292 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.338575 23274 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:16.343062 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.344007 22604 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.345822 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.346458 21949 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.347138 22022 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:16.354007 22609 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:16.361938 22607 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:16.374848 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:16.387827 21949 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:16.388494 21987 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:16.396050 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48270.4us
I20260709 13:06:16.396739 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.397431 21943 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:16.349879 23281 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.366859 21950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:16.389861 23371 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:16.408294 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.401155 23284 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.409293 22022 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.428772 21987 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:16.422760 21914 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8f404cd14ba4c2687ffe2b7637e1da7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:16.408058 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:16.434043 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:16.436095 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:16.446935 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:16.447570 21866 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.429916 23284 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.448367 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:16.428561 21950 raft_consensus.cc:606] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:16.447937 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 99379.4us
I20260709 13:06:16.429486 23153 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:16.403067 23259 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:16.441118 23360 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.459203 21870 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:16.465637 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:16.473537 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.474437 21870 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:16.481148 22609 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:16.483861 21773 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 2 to 3, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.452941 21950 raft_consensus.cc:614] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:16.449404 23420 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.453508 23416 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.464570 23402 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:16.462538 23284 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:16.508692 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 100630us
I20260709 13:06:16.486397 23423 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.477577 21941 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:16.476989 23360 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.512817 21868 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:16.453236 23410 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:16.462299 23362 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.518005 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:16.518265 21866 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:16.522493 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.486537 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.534233 22604 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:16.539286 23312 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.540587 23153 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.462919 23417 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:16.511034 22015 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:16.560904 21871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:36954
I20260709 13:06:16.484164 23368 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.569687 21870 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:16.572019 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:16.506773 23371 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:06:16.564337 23274 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.564239 23360 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.583640 21773 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 3, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.569293 23362 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.519560 23420 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.581338 21867 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:16.592015 23417 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:16.605142 23362 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.623059 23429 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:16.626046 23418 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:16.609175 23412 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.555634 23416 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.565086 23423 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.635206 21874 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:16.593554 23432 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:16.614351 23413 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:16.636266 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 71229.5us
I20260709 13:06:16.654342 21871 raft_consensus.cc:606] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:16.653553 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 167817us
I20260709 13:06:16.613468 23401 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:16.661456 21871 raft_consensus.cc:614] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:16.590889 23368 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.664799 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:16.572647 23410 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.603775 23274 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:16.671830 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 99937.2us
I20260709 13:06:16.673456 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:16.629225 23402 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:16.660032 23418 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.663156 23432 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.665132 23412 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.704761 23312 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.706329 23281 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:16.706938 23412 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.709401 23416 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.711769 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:16.712423 21943 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.664250 23295 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.725031 21943 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.704303 23432 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.734200 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:16.740861 23432 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.659968 23429 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.734014 23357 raft_consensus.cc:2764] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:16.744973 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:16.747503 23357 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:16.747673 23429 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:16.748265 23386 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:16.747225 23292 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.726183 23418 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.727758 23424 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:16.748060 23357 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.674654 23401 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.748744 23402 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.753894 23419 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.751649 23429 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.669013 23413 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.736788 23295 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:16.802704 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53407.2us
I20260709 13:06:16.745527 23432 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.838990 22604 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:16.839145 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.798669 23429 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:16.884037 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 128717us
W20260709 13:06:16.884057 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 222086us
I20260709 13:06:16.886656 21839 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:16.889313 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.890151 22018 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:16.756418 23417 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.895468 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:16.896340 22018 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:16.791540 23419 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:16.902303 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 227559us
W20260709 13:06:16.902882 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 99097.3us
I20260709 13:06:16.872886 23411 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:06:16.907728 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:16.900803 23368 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.895591 23424 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:16.887457 23284 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:16.924819 23284 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.900298 23274 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:16.944028 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 57357.7us
I20260709 13:06:16.927997 23420 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:16.966966 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 80379.2us
I20260709 13:06:16.970252 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:16.970851 22609 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.973457 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.974380 22607 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:16.947502 23295 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.976691 21916 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:16.980700 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:16.981287 21874 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:16.982129 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.982738 21870 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:16.993327 23419 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.993479 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.993963 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.994155 21867 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:16.944808 23452 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:16.994685 22610 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:16.995235 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:16.995644 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:16.995914 22601 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.997259 23429 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:16.963351 23453 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:16.997777 23429 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.996232 21949 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.998122 23453 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:16.998209 23429 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.001799 23453 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:16.944877 23434 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:17.002250 23432 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.937706 23410 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.948112 23292 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:16.972324 21950 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:17.005020 21874 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:16.944726 23438 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.967993 23401 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:17.007550 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:17.000387 23413 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.036479 21866 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:17.009029 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.009696 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.011025 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.944823 23441 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:16.972049 23435 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:06:16.944861 23442 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.003757 21916 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:17.034752 23434 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:17.003437 23436 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:06:16.994310 23446 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.056634 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:16.991899 22609 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:16.951558 23357 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.048954 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.039034 21870 raft_consensus.cc:2368] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:17.045949 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.046332 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:17.047187 22019 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:16.985137 23450 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:17.012585 23433 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:17.054666 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.020866 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:17.058843 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:17.038597 21869 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:17.074527 21949 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:17.064203 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50629.6us
W20260709 13:06:17.037221 23386 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:17.057037 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.060679 22022 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:17.078580 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.081887 21866 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:17.079216 21942 raft_consensus.cc:2368] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:16.946218 23424 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.056414 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:17.074923 22610 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:17.018477 23452 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:17.079687 21871 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:17.041792 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.095460 21944 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:17.002213 23429 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.096129 23465 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.096944 23465 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.091909 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.101686 21946 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:17.037341 23459 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.060066 23413 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.102684 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.037413 23457 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:17.051707 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:17.059823 23441 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:17.111387 22601 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:06:17.058872 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.054032 23438 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.116925 23438 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:17.101899 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 78989us
I20260709 13:06:17.087450 23450 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:17.090014 23153 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.040095 23442 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.112040 23441 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.105535 23459 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.109902 23419 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.124558 23450 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.107349 23413 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.127998 23465 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.137346 23357 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:17.139736 23360 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 13:06:17.142398 23442 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.142639 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.142314 23360 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.143251 21872 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
W20260709 13:06:17.145025 23422 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.684s	user 0.006s	sys 0.000s
I20260709 13:06:17.145303 23360 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:17.146010 23413 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.132578 23459 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:17.150357 23415 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.683s	user 0.003s	sys 0.000s
I20260709 13:06:17.132406 23419 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.153154 23419 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.128321 23153 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.168107 23153 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.168876 21946 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:17.169298 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.170224 21868 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:17.083372 23433 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.174265 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:17.174377 23433 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.175014 21875 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:06:17.070006 23446 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.178807 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:17.179945 21949 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.182667 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:17.184902 23281 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.185281 23281 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.093461 23434 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.185600 23281 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.198954 23449 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:06:17.164788 23452 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:17.202946 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 118406us
W20260709 13:06:17.190219 23362 consensus_meta.cc:287] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.001s
I20260709 13:06:17.204505 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:17.188135 23442 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.211676 21914 leader_election.cc:400] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:17.211988 21914 leader_election.cc:403] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:17.213310 22019 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:17.214646 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.215173 21949 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:17.215207 22019 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:17.216630 21987 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:17.216943 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.217921 22019 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:17.220758 23400 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:17.224028 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.225844 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.226462 21872 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:17.229746 23446 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.232491 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:17.233146 22607 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:17.230835 23425 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.251988 21944 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.252619 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.223253 23442 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.255096 23442 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.121181 23457 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.256461 23462 raft_consensus.cc:993] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:17.222144 23292 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.258876 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.261085 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:17.261678 22608 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:17.182013 23418 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.272765 21873 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:17.221342 23400 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:17.256999 23462 raft_consensus.cc:1081] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:17.212173 23362 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.283259 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.260238 23292 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.285408 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.285890 23292 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.286101 21948 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:17.293583 21987 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:17.294854 23467 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:17.295421 23467 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:17.295650 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 239358us
I20260709 13:06:17.295876 23467 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.306304 23467 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.281467 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.315294 21839 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:17.322319 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.323215 21948 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:17.323352 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:17.324831 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:17.327696 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:17.327833 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:17.328693 22607 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:17.329649 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:17.333014 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:17.333441 21873 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:17.333849 21872 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.336968 22573 leader_election.cc:400] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:17.337301 22573 leader_election.cc:403] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:17.304203 23292 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.337790 21914 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:17.338073 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:17.338961 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:17.341832 21871 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:17.343401 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.350168 22607 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:17.355634 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.356429 22022 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:17.356670 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.357257 22018 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:17.358958 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:17.361330 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:17.362140 21871 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:17.362365 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.354923 22574 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:17.364854 22574 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:17.363806 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.366834 22018 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:17.351421 23259 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.330647 23433 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.369837 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:17.370425 21870 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:17.368046 23259 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.371997 23259 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.372664 23292 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.375428 21944 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:17.375553 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:17.336994 23412 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.377733 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:17.381645 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:17.376562 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:17.442420 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 77666.6us
W20260709 13:06:17.526103 23473 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:17.448014 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.562844 22022 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:17.377457 23463 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.530462 23419 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.347481 23438 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:17.443228 23413 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.529520 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:17.601919 22607 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:17.407588 23412 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.351481 23429 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:17.606061 23452 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:17.606307 23429 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:17.525297 23482 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.606986 23482 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.606721 23452 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.607343 23482 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.378384 23295 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:06:17.606060 23412 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.378576 23457 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.451041 21867 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:17.379562 23433 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.614020 23452 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.614439 23433 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.563251 23362 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.347301 23455 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.616487 23455 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.617014 23455 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.381656 23432 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.620867 22601 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:17.621368 23432 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.533991 23469 ts_tablet_manager.cc:933] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:17.361809 23400 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.383332 23471 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.182s
W20260709 13:06:17.552779 21990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.008s	sys 0.016s
W20260709 13:06:17.634354 21990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.009s	sys 0.016s
I20260709 13:06:17.550393 21871 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.635581 21943 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:17.559558 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 183065us
I20260709 13:06:17.636509 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:17.559041 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 177459us
I20260709 13:06:17.637655 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:17.454559 23443 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.641417 21872 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:17.561647 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:17.550319 23478 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:06:17.604108 21839 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:17.606724 23429 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.615931 23463 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.621942 23432 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.564731 23449 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:17.601006 23418 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.604673 23447 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.651223 21871 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:17.659740 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:17.680235 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 76206.1us
I20260709 13:06:17.691840 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:17.694175 22016 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.655289 23443 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:17.655506 23362 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:17.706133 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:17.696012 23281 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.006s
I20260709 13:06:17.679675 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:17.752621 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:17.763540 22018 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.679318 23476 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:17.665784 23463 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.697386 23418 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.778937 23418 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.779629 23418 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.780690 23411 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.710357 23443 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.786207 23463 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.786705 23467 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.788691 23463 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:17.790712 22601 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:17.707914 23362 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:17.792833 23362 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:17.679386 23449 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:17.794931 22606 raft_consensus.cc:2368] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:06:17.844902 22607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57086
I20260709 13:06:17.863962 22607 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:06:17.795485 23428 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:06:17.849923 23479 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:06:17.835762 23470 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:06:17.870393 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:17.871140 22610 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:17.846079 23476 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:17.776453 22605 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.850605 23419 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:17.696825 23434 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.135s
I20260709 13:06:17.745090 23439 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.769001 23452 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:17.883041 23452 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.885764 23452 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.864487 22607 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:17.888615 23425 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.001s
I20260709 13:06:17.889086 23425 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:17.888890 23439 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:17.890504 23459 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260709 13:06:17.890950 23459 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.892042 23439 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:17.888025 23482 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.896386 23429 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:17.911226 23476 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.918413 23423 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.766288 23281 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:17.921243 23281 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.897037 23413 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.898123 23482 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:17.877746 23464 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:17.859530 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:17.858525 22016 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:17.862857 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:17.875689 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:18.034008 21945 raft_consensus.cc:2368] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:18.051329 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:18.052968 21772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 282) took 1144 ms. Trace:
I20260709 13:06:18.044075 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1806) took 1037 ms. Trace:
I20260709 13:06:18.030066 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 1812) took 1021 ms. Trace:
I20260709 13:06:18.088003 22609 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.034870 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:18.161036 21772 rpcz_store.cc:276] 0709 13:06:16.907939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.908106 (+   167us) service_pool.cc:224] Handling call
0709 13:06:18.052637 (+1144531us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105822,"reported_tablets":1}
W20260709 13:06:18.171032 21946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.043s	sys 0.041s
W20260709 13:06:18.171800 21946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.043s	sys 0.041s
I20260709 13:06:18.161346 21875 rpcz_store.cc:276] 0709 13:06:17.008070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.009405 (+  1335us) service_pool.cc:224] Handling call
0709 13:06:18.029360 (+1019955us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540044fa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:18.029717 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313033600}
I20260709 13:06:18.032189 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:17.931645 23435 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:06:17.935261 23487 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:17.876536 23449 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:18.039531 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:18.202441 21947 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.943333 23459 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.049315 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:18.161087 21867 rpcz_store.cc:276] 0709 13:06:17.006080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.006252 (+   172us) service_pool.cc:224] Handling call
0709 13:06:17.006667 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.624415 (+617748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.043395 (+418980us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54003769d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:18.043849 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015875968}
I20260709 13:06:18.217298 23371 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:17.942579 23455 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.070389 21773 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.948311 23432 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:18.230624 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 370895us
I20260709 13:06:18.232028 22602 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:18.232748 21838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.005s	sys 0.015s
W20260709 13:06:18.233353 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 482347us
I20260709 13:06:18.234138 23416 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:18.199528 23412 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.590s	user 0.004s	sys 0.004s
W20260709 13:06:18.201906 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 167417us
I20260709 13:06:18.240490 23368 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.939127 23443 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:18.245093 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 889) took 1033 ms. Trace:
W20260709 13:06:18.250193 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 543949us
W20260709 13:06:18.256635 22604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.012s	sys 0.021s
I20260709 13:06:18.261633 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1406) took 1074 ms. Trace:
I20260709 13:06:18.254262 22015 rpcz_store.cc:276] 0709 13:06:17.212039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.219541 (+  7502us) service_pool.cc:224] Handling call
0709 13:06:17.220776 (+  1235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.220978 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:17.347228 (+126250us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.934547 (+587319us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b24001bd9b8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352e0b9c4 00007f6352e09acb 00007f6352fc4dc9 00007f6352fc4a55 00007f6352fc409d 00007f6355bf610e 00007f6355c0d88c 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221
0709 13:06:18.234900 (+300353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:18.238406 (+  3506us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:18.244430 (+  6024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.244569 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.244829 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15595,"prepare.queue_time_us":232354,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":64408,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9552,"spinlock_wait_cycles":70958336,"thread_start_us":936024,"threads_started":3,"wal-append.queue_time_us":387158}
I20260709 13:06:18.279312 23455 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:18.280987 23259 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.908s	user 0.014s	sys 0.004s
I20260709 13:06:18.281586 23259 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.283355 23498 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:18.283825 23498 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:18.285313 23498 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:18.285454 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 165624us
W20260709 13:06:18.284147 21990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.016s	sys 0.044s
W20260709 13:06:18.274199 21873 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.053s	sys 0.095s
W20260709 13:06:18.269016 22604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.013s	sys 0.021s
I20260709 13:06:17.952066 23433 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:18.272867 21941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.050s	sys 0.091s
I20260709 13:06:18.291728 21949 raft_consensus.cc:2368] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3.
I20260709 13:06:18.289223 23445 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:06:18.293501 23464 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.294868 23482 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:18.295779 23463 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:18.293351 22601 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:18.266443 23416 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:18.296674 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.004s	sys 0.018s
W20260709 13:06:18.273425 23469 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.025s	sys 0.019s
I20260709 13:06:18.264372 21946 rpcz_store.cc:276] 0709 13:06:17.178081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.179278 (+  1197us) service_pool.cc:224] Handling call
0709 13:06:17.193560 (+ 14282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.193860 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.193885 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.194211 (+   326us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.172643 (+978432us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:18.172764 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.172912 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.242422 (+ 69510us) raft_consensus.cc:1685] finished
0709 13:06:18.242446 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.252762 (+ 10316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674,"raft.queue_time_us":115,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11239,"thread_start_us":950261,"threads_started":1,"wal-append.queue_time_us":1025768}
W20260709 13:06:18.299350 21873 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.054s	sys 0.095s
I20260709 13:06:18.299453 23259 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:18.315924 21945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1400) took 1294 ms (client timeout 1542 ms). Trace:
W20260709 13:06:18.388525 21945 rpcz_store.cc:269] 0709 13:06:17.021636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.026180 (+  4544us) service_pool.cc:224] Handling call
0709 13:06:18.315614 (+1289434us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b540019cb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:18.315846 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110570752}
I20260709 13:06:18.308400 21773 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 3, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.315178 23429 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:18.390023 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1414) took 1015 ms. Trace:
I20260709 13:06:18.390641 23429 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:18.390491 21773 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 3, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:18.304869 21941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.051s	sys 0.091s
I20260709 13:06:18.391396 23429 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.391670 22601 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:18.404563 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 372749us
I20260709 13:06:18.405520 23482 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.406968 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:18.411046 21839 leader_election.cc:400] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:06:18.410929 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:18.412861 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:18.415619 22610 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.417126 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:18.418519 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:18.419389 21867 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.419495 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:18.420454 21875 raft_consensus.cc:2368] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:18.411708 23467 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:18.411933 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:18.322576 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:18.327615 23433 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:18.390512 21949 rpcz_store.cc:276] 0709 13:06:17.374632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.375334 (+   702us) service_pool.cc:224] Handling call
0709 13:06:18.389741 (+1014407us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54000fd054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:18.389956 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077564160}
I20260709 13:06:18.423352 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:18.309159 23432 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.301232 23412 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:18.435020 22609 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:18.437433 21947 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
W20260709 13:06:18.434842 22607 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.004s
W20260709 13:06:18.382467 23469 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.026s	sys 0.020s
I20260709 13:06:18.446609 22607 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.447144 21874 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.447508 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:18.433738 21773 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 3, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.433367 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:18.447975 21944 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:18.448634 23432 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.463095 23432 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.465396 21949 raft_consensus.cc:2368] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:18.449376 23429 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.405184 23443 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:18.449257 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:18.450142 23484 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
I20260709 13:06:18.450747 23412 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.302879 23371 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:18.451627 22606 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.452265 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:18.457628 23463 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.275981 23446 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.273s
I20260709 13:06:18.458138 22607 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.314860 23416 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:18.459601 23362 consensus_meta.cc:287] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.007s
I20260709 13:06:18.460100 22021 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:18.460707 21950 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:18.430563 23500 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.315407 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1817) took 1084 ms. Trace:
I20260709 13:06:18.469717 22019 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:18.512858 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 80829.1us
I20260709 13:06:18.428512 23464 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:18.308831 23418 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.528168 23469 tablet_copy_client.cc:323] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:06:18.544925 22022 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:18.547834 21872 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:18.548666 23412 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:18.549721 23412 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:18.550123 23412 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:18.551182 23412 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:18.526036 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 76842.2us
I20260709 13:06:18.541440 23500 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:18.542202 23476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.034s	sys 0.014s
W20260709 13:06:18.542937 22018 consensus_meta.cc:287] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.779s	user 0.004s	sys 0.012s
I20260709 13:06:18.543381 23371 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.543881 23362 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.544692 22608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 355) took 1186 ms. Trace:
I20260709 13:06:18.526190 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:18.334127 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:18.572999 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 180995us
I20260709 13:06:18.587529 22019 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
W20260709 13:06:18.591102 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 112013us
I20260709 13:06:18.631083 21869 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:18.709540 22609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 324) took 1137 ms. Trace:
I20260709 13:06:18.712713 23429 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:18.715512 21870 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:18.716027 23465 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.179s
I20260709 13:06:18.717455 23451 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:18.721525 23494 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:06:18.552525 23412 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:18.562908 23476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.034s	sys 0.014s
I20260709 13:06:18.722733 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:18.712538 22609 rpcz_store.cc:276] 0709 13:06:17.561191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.561332 (+   141us) service_pool.cc:224] Handling call
0709 13:06:18.656665 (+1095333us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400525654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:18.698510 (+ 41845us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023829376}
I20260709 13:06:18.659065 22018 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:18.733702 21866 raft_consensus.cc:2368] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:18.736017 23463 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.713475 23429 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.738548 23429 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.739706 23467 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:18.740110 22610 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:18.741978 21871 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:18.741425 22601 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:18.698490 22608 rpcz_store.cc:276] 0709 13:06:17.358036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.358164 (+   128us) service_pool.cc:224] Handling call
0709 13:06:17.358498 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.359126 (+   628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.359153 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.359895 (+   742us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.681619 (+321724us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:17.681676 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.681768 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.544124 (+862356us) raft_consensus.cc:1685] finished
0709 13:06:18.544162 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.544450 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":308666,"threads_started":1,"wal-append.queue_time_us":748249}
I20260709 13:06:18.757176 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 318) took 1759 ms. Trace:
I20260709 13:06:18.740619 23467 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:18.757737 22604 rpcz_store.cc:276] 0709 13:06:16.997394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.002615 (+  5221us) service_pool.cc:224] Handling call
0709 13:06:17.002996 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.025084 (+ 22088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.034691 (+  9607us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.041301 (+  6610us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.633722 (+592421us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18003861a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:06:18.309949 (+676227us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:18.310088 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.310304 (+   216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.723835 (+413531us) raft_consensus.cc:1685] finished
0709 13:06:18.728767 (+  4932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.757090 (+ 28323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10771,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":14606,"spinlock_wait_cycles":5174656,"thread_start_us":657888,"threads_started":1,"wal-append.queue_time_us":1525943}
I20260709 13:06:18.760502 23453 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:18.761343 23453 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:18.762930 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 70128.3us
W20260709 13:06:18.763584 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 179521us
I20260709 13:06:18.724066 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1410) took 1505 ms. Trace:
I20260709 13:06:18.740350 23327 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:18.812956 23327 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.813844 23467 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:18.815199 23327 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:18.796897 21941 rpcz_store.cc:276] 0709 13:06:17.202674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.206487 (+  3813us) service_pool.cc:224] Handling call
0709 13:06:17.257536 (+ 51049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.312266 (+ 54730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.315030 (+  2764us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.368269 (+ 53239us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.530271 (+1162002us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:18.562865 (+ 32594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.598843 (+ 35978us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.631008 (+ 32165us) raft_consensus.cc:1685] finished
0709 13:06:18.631024 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.708303 (+ 77279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2835,"raft.queue_time_us":33030,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":6868,"thread_start_us":1033924,"threads_started":1,"wal-append.queue_time_us":1005915}
W20260709 13:06:18.817821 22605 consensus_meta.cc:287] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.937s	user 0.012s	sys 0.003s
I20260709 13:06:18.818248 22601 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:18.818444 22605 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:18.819411 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 358) took 1239 ms. Trace:
I20260709 13:06:18.819868 22605 rpcz_store.cc:276] 0709 13:06:17.580385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.602106 (+ 21721us) service_pool.cc:224] Handling call
0709 13:06:18.819308 (+1217202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:18.820762 23453 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:18.740892 23402 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:18.764190 23482 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.805624 22606 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:18.741489 23432 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.741227 23500 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:18.808837 23498 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.005s
I20260709 13:06:18.790277 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 902) took 1013 ms. Trace:
I20260709 13:06:18.879328 22021 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:18.881600 22610 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:18.882946 23510 raft_consensus.cc:2764] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:18.886642 22018 rpcz_store.cc:276] 0709 13:06:17.752088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.752266 (+   178us) service_pool.cc:224] Handling call
0709 13:06:18.754097 (+1001831us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:18.976658 23449 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.004s
I20260709 13:06:18.977208 23449 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.595567 23464 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.383s
I20260709 13:06:18.978624 23444 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:18.979275 23444 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:18.979630 23449 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:18.979694 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 645726us
I20260709 13:06:18.980664 23418 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:18.980979 21943 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:18.981437 21943 pending_rounds.cc:85] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 5
I20260709 13:06:18.982942 23362 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:18.983686 23402 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:18.986858 23402 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:18.878546 23445 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:18.988885 23445 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:18.991741 23445 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:18.991595 23498 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.010656 23451 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.038915 23447 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:19.039507 23444 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:19.039674 23447 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.040908 23498 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.027799 23451 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.062933 23447 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:19.226415 23509 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:06:19.251514 23451 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.253911 23451 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:19.324079 21875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.000s	sys 0.023s
W20260709 13:06:19.324508 21875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.000s	sys 0.023s
I20260709 13:06:18.537120 21868 rpcz_store.cc:276] 0709 13:06:17.231161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.241000 (+  9839us) service_pool.cc:224] Handling call
0709 13:06:17.241562 (+   562us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:17.255419 (+ 13857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.255469 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:17.256714 (+  1245us) log.cc:844] Serialized 518 byte log entry
0709 13:06:17.765329 (+508615us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:17.777613 (+ 12284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.061082 (+283469us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b540044f054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:18.061200 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.298049 (+236849us) raft_consensus.cc:1685] finished
0709 13:06:18.299132 (+  1083us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.315145 (+ 16013us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":237,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":30519040,"thread_start_us":487980,"threads_started":1,"wal-append.queue_time_us":955374,"wal-append.run_cpu_time_us":4481,"wal-append.run_wall_time_us":1118908}
I20260709 13:06:19.403244 23447 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.403955 23447 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.406309 23447 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.410053 23508 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:19.410739 23508 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.413064 23508 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:19.418207 23507 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.684s	user 0.002s	sys 0.000s
I20260709 13:06:19.420940 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:19.422224 23500 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:19.422799 23500 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:06:19.423015 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.423174 23451 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.423768 23416 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:19.423689 23500 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.424666 23416 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.425499 23495 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.426106 23495 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.423753 23451 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.426972 23416 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.426914 23506 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.427830 23506 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.428315 23495 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.429184 23451 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.429277 23465 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.429831 23451 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:19.430001 23465 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.430356 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:19.430413 23451 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.431226 23495 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:19.431777 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:19.432144 23465 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.432454 23495 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:19.434325 23495 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:19.436502 23506 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.436759 23495 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.438733 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:19.440419 23447 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:19.440421 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1368) took 1014 ms. Trace:
I20260709 13:06:19.440997 23447 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.432581 23451 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.441450 21869 rpcz_store.cc:276] 0709 13:06:18.425728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.435737 (+ 10009us) service_pool.cc:224] Handling call
0709 13:06:19.440234 (+1004497us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001b7954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:19.440364 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369087232}
I20260709 13:06:19.441669 23447 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.445302 21841 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:19.449409 23465 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.459791 23495 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:19.458949 23416 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.460681 23445 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:19.460034 23465 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.466122 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:19.460569 23416 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.466607 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:19.467279 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 579051us
I20260709 13:06:19.468359 23416 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.469239 23465 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.470535 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:19.471626 22574 leader_election.cc:400] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:19.461478 23445 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.471925 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.459090 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:19.464550 23500 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:19.464509 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.473003 23500 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.473740 23445 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.473752 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:19.474766 21944 raft_consensus.cc:2368] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:06:19.474712 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:19.475646 22610 raft_consensus.cc:2393] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:19.475796 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.477351 22608 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:19.478399 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:19.479074 21941 raft_consensus.cc:2393] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:19.479499 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:19.472041 23447 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.480129 22608 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.480024 23412 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:19.482029 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:19.483003 21947 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:19.483840 23447 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.449728 23451 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.485792 21874 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:19.467432 21866 raft_consensus.cc:2393] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:19.486398 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 101) took 1067 ms. Trace:
I20260709 13:06:19.487010 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.485348 23451 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.489427 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.490041 23501 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:19.490557 23451 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.490636 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.490609 23501 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.491848 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.486754 21874 rpcz_store.cc:276] 0709 13:06:18.418821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.421110 (+  2289us) service_pool.cc:224] Handling call
0709 13:06:19.486314 (+1065204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:19.493769 23501 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:19.464296 23522 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.494589 23522 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.495914 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:19.496568 22610 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:19.499523 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:19.500517 21866 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.460464 23495 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:19.502573 21874 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:19.503268 23416 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.503906 23445 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.504326 23416 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.504801 23445 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.507066 23445 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.485994 21868 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:19.509280 23522 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.471937 22574 leader_election.cc:403] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.508502 23416 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.510412 23508 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:19.475662 23500 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.512490 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:19.513381 21947 raft_consensus.cc:2393] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:19.518100 23508 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.518708 23508 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.523581 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:19.524879 22605 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:19.526074 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:19.527391 21867 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.107s	user 0.014s	sys 0.007s
I20260709 13:06:19.527776 21867 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:19.527894 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.528469 21947 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:19.528345 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 99) took 1111 ms. Trace:
I20260709 13:06:19.529560 21867 rpcz_store.cc:276] 0709 13:06:18.417987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.418142 (+   155us) service_pool.cc:224] Handling call
0709 13:06:19.528274 (+1110132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:19.531857 22608 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:19.532974 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 824319us
I20260709 13:06:19.537036 21866 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:19.537750 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:19.533871 23522 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.540140 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.541649 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:19.542526 21946 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:19.542438 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:19.543188 22610 raft_consensus.cc:2368] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:06:19.543367 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.541730 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.544498 21947 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:19.546415 21838 leader_election.cc:400] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:06:19.546772 21838 leader_election.cc:403] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.547016 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:19.546463 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:19.548120 22609 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:19.548563 21959 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet d8f404cd14ba4c2687ffe2b7637e1da7 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:06:19.549283 21959 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet d8f404cd14ba4c2687ffe2b7637e1da7 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-d8f404cd14ba4c2687ffe2b7637e1da7
I20260709 13:06:19.550053 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:19.553287 22574 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:19.555244 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:19.540210 23522 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.559665 23522 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.560253 23522 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:19.556210 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:19.562094 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.563333 22610 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:19.556320 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:19.564949 21773 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.009s	sys 0.039s
W20260709 13:06:19.562441 21987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.008s	sys 0.014s
W20260709 13:06:19.565666 21987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.008s	sys 0.014s
I20260709 13:06:19.569382 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:19.570659 21773 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.009s	sys 0.039s
I20260709 13:06:19.572559 23528 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:19.573465 23528 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.574533 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.575501 21867 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:06:19.576543 23528 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.577363 23528 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.577600 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.578059 23528 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.580348 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.582369 23531 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:19.583048 23531 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.583252 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.583441 23531 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:19.582451 21875 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:19.583896 21874 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:19.587613 23528 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:19.591118 23527 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:19.591745 23527 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:06:19.592350 21873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.025s	sys 0.026s
I20260709 13:06:19.592734 23527 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:19.598001 21873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.027s	sys 0.026s
W20260709 13:06:19.606145 21987 connection.cc:256] RPC call timeout handler was delayed by -1.1863968200000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:06:19.605566 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 59351.3us
I20260709 13:06:19.610126 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.610749 21866 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:19.612125 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:19.596637 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.613874 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.604449 23508 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:19.616425 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 63221.5us
I20260709 13:06:19.617401 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.618703 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.619416 21866 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:19.619452 23516 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:19.620465 23516 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.621969 22605 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:19.623215 23516 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:19.619571 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.617097 22574 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:19.638037 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.639942 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.657367 23508 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:19.658231 23508 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:19.659515 23508 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.665660 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1819) took 2325 ms. Trace:
I20260709 13:06:19.677376 23464 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:19.678298 23464 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.673666 21873 rpcz_store.cc:276] 0709 13:06:17.340179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.344718 (+  4539us) service_pool.cc:224] Handling call
0709 13:06:17.345073 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.345300 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:18.435352 (+1090052us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.664672 (+1229320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.664775 (+   103us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:19.664833 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.665310 (+   477us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.665577 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108777,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"thread_start_us":2167598,"threads_started":3,"wal-append.queue_time_us":784721}
I20260709 13:06:19.652249 23516 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.692060 23516 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:19.702075 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 89168.1us
I20260709 13:06:19.702953 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:19.704913 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75739.2us
W20260709 13:06:19.710520 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 98447.7us
I20260709 13:06:19.703559 21948 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:19.711546 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:19.714946 21987 leader_election.cc:400] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:19.716286 23528 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:19.717065 23528 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.720340 23528 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:19.709692 23516 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.720853 23537 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.721532 23537 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.725942 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:19.726614 21947 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:19.728226 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1826) took 1717 ms. Trace:
I20260709 13:06:19.728566 21872 rpcz_store.cc:276] 0709 13:06:18.011451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.014416 (+  2965us) service_pool.cc:224] Handling call
0709 13:06:18.015029 (+   613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.548267 (+533238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.728039 (+1179772us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54003ad254. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:19.728178 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224423808}
I20260709 13:06:19.729331 23530 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.739015 23538 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:19.741475 23531 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:19.738093 23447 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:19.745913 23537 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:19.785140 21872 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:19.789028 21987 leader_election.cc:400] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3.
I20260709 13:06:19.789513 21987 leader_election.cc:403] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.795034 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:19.733493 23530 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.104947 23539 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:20.110591 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 323437us
I20260709 13:06:20.110870 23539 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:19.791220 23447 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.105419 23528 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.122972 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.101s (SENT) [suppressed 4 similar messages]
W20260709 13:06:20.132057 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 420525us
I20260709 13:06:20.150017 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:20.160259 21987 leader_election.cc:400] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:20.161893 21987 leader_election.cc:403] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:06:20.217186 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 84170.4us
I20260709 13:06:20.137167 23528 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.220079 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:20.201365 23550 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:20.220661 21914 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:20.222522 21872 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:20.226670 21839 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:20.209406 23527 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:20.248251 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:20.248924 23533 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:20.260991 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:20.262895 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:20.264209 21875 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:20.250934 23531 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.251228 23532 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:20.218546 23548 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:20.290421 23530 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.270167 23495 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.293135 23548 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:20.297699 23548 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:20.273500 21839 leader_election.cc:400] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:06:20.279635 23536 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:20.298907 23536 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:20.299569 23508 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:20.300141 23508 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.300024 23536 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.302788 23508 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.304025 21839 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:20.272318 23498 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:20.280495 23447 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.280645 23545 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.282107 23528 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.284925 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:20.271512 23535 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:20.286072 23550 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3.
I20260709 13:06:20.266620 23527 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.271638 23552 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:20.268934 23516 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:20.269361 23551 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:20.289407 23539 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.279526 23532 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:20.325619 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 208446us
W20260709 13:06:20.336643 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 116065us
W20260709 13:06:20.337895 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 178580us
I20260709 13:06:20.339671 23495 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:20.345552 23498 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.344487 23535 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:20.349336 23552 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.351029 23562 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:20.380379 23541 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:20.380760 23540 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.380970 23541 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.381356 23541 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:20.381546 23556 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:20.382351 23556 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.366878 23549 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.385731 23563 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.385557 23549 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.386343 23563 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.387001 23498 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:20.387813 23498 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.375000 23551 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.373318 23495 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.346251 23545 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.375818 23552 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:20.388449 23549 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:20.374028 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:20.389003 23561 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:20.416374 23561 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:20.417399 23561 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.418717 23561 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:20.418772 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:20.368676 23550 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:20.420971 23550 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.422813 23527 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.390691 23535 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:20.427817 23412 consensus_meta.cc:287] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.946s	user 0.014s	sys 0.010s
I20260709 13:06:20.396138 23495 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.430119 23495 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.430455 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:20.422923 23550 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:20.491338 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 275125us
I20260709 13:06:20.716195 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:20.539304 23412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35474 (request call id 8) took 8639 ms. Trace:
I20260709 13:06:20.718497 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:20.723004 23464 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.541671 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:20.411948 21871 consensus_meta.cc:287] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.629s	user 0.012s	sys 0.009s
I20260709 13:06:20.724949 21871 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:20.725631 23522 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:06:20.405673 23556 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:20.448248 23552 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.730839 23552 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:20.388540 23563 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.393136 23551 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:20.413516 23541 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.706233 23566 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.381618 23562 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.743984 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:20.744087 23562 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:20.429081 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55129.1us
I20260709 13:06:20.732353 23553 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.399438 23549 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.676772 23535 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.396158 23545 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.733384 23528 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.381376 23540 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:20.414680 21945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 886) took 1687 ms (client timeout 1672 ms). Trace:
I20260709 13:06:20.735986 23464 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.736440 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 432468us
I20260709 13:06:20.570334 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:20.602676 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:20.429071 22020 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:20.415414 23532 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:20.388917 23548 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.743745 23566 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.382372 23554 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:20.745648 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:20.795689 23554 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:20.796065 22019 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:20.571233 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:20.723531 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:20.799561 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:20.800187 23560 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:20.498538 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 49492.3us
I20260709 13:06:20.415884 22024 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:20.721871 23412 rpcz_store.cc:276] 0709 13:06:11.913129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.113461 (+1200332us) service_pool.cc:224] Handling call
0709 13:06:13.247301 (+133840us) log.cc:844] Serialized 492 byte log entry
0709 13:06:13.472992 (+225691us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b1800226f60. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f6355fcbb0b 00007f6356050b63 00007f6356078752 00007f635b038d29
0709 13:06:20.539144 (+7066152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257598,"raft.queue_time_us":189949,"raft.run_cpu_time_us":1982,"raft.run_wall_time_us":38323,"spinlock_wait_cycles":12572416,"thread_start_us":38415,"threads_started":1,"wal-append.queue_time_us":204082,"wal-append.run_cpu_time_us":2344,"wal-append.run_wall_time_us":1133001}
I20260709 13:06:20.719419 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:20.762984 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 387597us
I20260709 13:06:20.757084 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:20.767630 21839 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:20.541541 23465 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:20.763634 21945 rpcz_store.cc:269] 0709 13:06:18.727611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.414456 (+1686845us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:20.414594 (+   138us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:20.761981 23549 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.774199 23464 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.774816 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:20.585382 23568 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:20.758353 23553 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.576565 23527 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.767146 23528 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.762006 23535 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.797144 23554 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:20.431052 23495 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.800885 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:20.949080 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:20.946565 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:20.802603 22017 raft_consensus.cc:2410] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:06:20.950203 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 182635us
I20260709 13:06:20.956676 22016 raft_consensus.cc:2393] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:20.803404 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:20.956115 21942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 896) took 1537 ms (client timeout 1664 ms). Trace:
W20260709 13:06:20.957360 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 200387us
I20260709 13:06:20.802685 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:20.800786 23560 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.962853 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:20.765746 23541 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:20.952306 22023 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
W20260709 13:06:20.961244 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 158669us
W20260709 13:06:20.957309 21942 rpcz_store.cc:269] 0709 13:06:19.418800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.903097 (+1484297us) service_pool.cc:224] Handling call
0709 13:06:20.956065 (+ 52968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.918231 23557 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.964263 22020 raft_consensus.cc:2410] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:20.963506 22610 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:20.965945 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 365) took 2256 ms. Trace:
I20260709 13:06:20.763173 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:20.954926 22015 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:20.948949 23568 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:20.971293 22607 rpcz_store.cc:276] 0709 13:06:18.709258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.878724 (+2169466us) service_pool.cc:224] Handling call
0709 13:06:20.948307 (+ 69583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.960951 (+ 12644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.960981 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.961020 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:20.965727 (+  4707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.965794 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.965894 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.975135 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:20.977205 22574 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:20.963167 23574 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:20.960475 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50121.3us
I20260709 13:06:20.967382 23563 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:20.991446 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:20.996155 22024 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:20.972384 23529 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:20.954939 23465 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:20.962509 23447 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:20.978417 22602 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:21.019312 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:21.010269 22019 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:20.987219 23445 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:06:20.990351 23562 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:21.035576 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:21.039397 21874 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:21.040812 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:21.053633 21869 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:21.039937 22024 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:20.951550 23527 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:21.037029 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9060 after lost signal to thread 20759
I20260709 13:06:21.041435 23532 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:20.978767 23568 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.054692 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:21.064256 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75867.5us
I20260709 13:06:20.998891 23540 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:21.038426 23560 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:20.975414 23550 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:21.009068 23566 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:21.067411 23539 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:21.067677 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:21.068085 23555 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:20.976192 23557 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:21.069959 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 71630.9us
W20260709 13:06:21.060732 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 102173us
W20260709 13:06:21.062012 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 58252.9us
W20260709 13:06:21.077431 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100290us
I20260709 13:06:21.109645 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:21.050455 23552 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:21.056929 23530 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:21.055851 23541 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.090950 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:21.035956 23572 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:21.097683 23529 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:21.102260 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:21.036535 23549 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:21.069480 23532 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:21.110448 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 127441us
I20260709 13:06:21.111891 22574 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:21.118922 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:21.119681 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:21.112758 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:21.068866 23567 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.157s
I20260709 13:06:21.101917 23539 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:21.120527 22607 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:21.464048 21875 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
W20260709 13:06:21.223975 21871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 98) took 2739 ms (client timeout 2413 ms). Trace:
W20260709 13:06:21.465843 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 354287us
I20260709 13:06:21.465065 22608 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:21.246156 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:21.473070 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:21.465617 21871 rpcz_store.cc:269] 0709 13:06:18.416263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.416729 (+   466us) service_pool.cc:224] Handling call
0709 13:06:21.155834 (+2739105us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b540044fa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:21.155936 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745356544}
W20260709 13:06:21.110325 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9740 after lost signal to thread 21807
I20260709 13:06:21.249887 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:21.492980 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.335460 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:21.471946 21942 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:21.117300 23587 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.494645 23587 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:21.487964 23581 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:06:21.476739 23588 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:21.497278 23588 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.497786 23588 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:21.499981 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:21.490895 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:21.501353 22608 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:21.503207 23574 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:21.504001 23574 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:21.505826 23528 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:21.507457 23589 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:06:21.510286 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1832) took 2042 ms. Trace:
I20260709 13:06:21.512460 23588 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:21.514539 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:21.517506 23553 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:21.518872 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:21.519750 21869 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
W20260709 13:06:21.542361 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 69350.2us
I20260709 13:06:21.543421 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:21.587487 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 44185.6us
I20260709 13:06:21.121896 21867 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:21.472847 23532 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:21.252475 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:21.592890 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:21.225272 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 105607us
I20260709 13:06:21.148874 23541 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:21.620028 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:21.620908 21875 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:21.586658 23416 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:21.630616 23592 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:21.631436 23592 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:21.633899 23501 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:21.634344 23416 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:21.593432 23557 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:21.216540 23530 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:21.205045 23529 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:06:22.089479 21987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.020s
I20260709 13:06:21.517861 21870 rpcz_store.cc:276] 0709 13:06:19.468053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.493017 (+2024964us) service_pool.cc:224] Handling call
0709 13:06:21.509782 (+ 16765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.509981 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.510005 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.510041 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:21.510066 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.510120 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.510224 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:21.914790 21946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.007s	sys 0.014s
W20260709 13:06:21.828539 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.026036 21840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.022s	sys 0.014s
W20260709 13:06:22.092411 21840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.027s	sys 0.016s
I20260709 13:06:21.748632 23527 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.093791 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.098217 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:22.099117 22603 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.015504 21959 tablet_copy_source_session.cc:215] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.102525 21959 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:35490 (request call id 97) took 2557 ms. Trace:
I20260709 13:06:22.095228 23535 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.103045 21959 rpcz_store.cc:276] 0709 13:06:19.545527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.548290 (+  2763us) service_pool.cc:224] Handling call
0709 13:06:22.014940 (+2466650us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540029a754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635607c3f7 00007f635b012036 00007f635b01ba3e 00007f63528df27b 00007f635b01b9ba 00007f635b016acc 00007f635b011c7b 00007f635b0068d1 00007f635a0ba4b4 00007f635a0ba442
0709 13:06:22.102416 (+ 87476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3512436480}
I20260709 13:06:22.095906 23536 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.104429 23536 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:21.686131 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 473597us
I20260709 13:06:22.109226 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.109741 21988 leader_election.cc:400] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:22.110736 23537 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.111164 23537 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.109884 21944 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:22.111666 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:21.637286 23447 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.113610 23537 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:22.113346 23447 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.114389 23537 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:22.115546 23603 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.116256 23600 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:22.116144 23603 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:21.914659 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 447911us
I20260709 13:06:21.813292 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 1829) took 2347 ms. Trace:
I20260709 13:06:22.117730 22574 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:22.088996 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 487530us
I20260709 13:06:22.119508 23563 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:22.120883 23602 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:22.096947 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1821) took 1679 ms. Trace:
I20260709 13:06:22.116679 23600 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:22.121973 23600 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.636667 23592 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:22.121883 22022 rpcz_store.cc:276] 0709 13:06:20.417588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.420706 (+  3118us) service_pool.cc:224] Handling call
0709 13:06:20.421036 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.769272 (+348236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.769300 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.782523 (+ 13223us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:20.782569 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.816938 (+1034369us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b180031c6c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f532a6 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419
0709 13:06:21.818297 (+  1359us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b540025f8d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:21.818357 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.096863 (+278506us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4358,"raft.queue_time_us":101,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":126,"spinlock_wait_cycles":837142784}
I20260709 13:06:22.103717 21947 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:21.593915 23445 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:21.618541 23451 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.124565 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1444) took 1025 ms. Trace:
W20260709 13:06:22.090006 21987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.004s	sys 0.020s
W20260709 13:06:22.090790 21946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.011s	sys 0.014s
I20260709 13:06:22.117446 21868 rpcz_store.cc:276] 0709 13:06:19.465653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.465809 (+   156us) service_pool.cc:224] Handling call
0709 13:06:21.812956 (+2347147us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54001d8dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:21.813198 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43591424}
I20260709 13:06:22.095461 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1443) took 1004 ms. Trace:
I20260709 13:06:22.119513 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:21.810004 23595 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:22.127959 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.128165 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:22.134466 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1446) took 1033 ms. Trace:
I20260709 13:06:22.131349 21947 rpcz_store.cc:276] 0709 13:06:21.098910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.099112 (+   202us) service_pool.cc:224] Handling call
0709 13:06:22.016732 (+917620us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:22.103236 (+ 86504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.124253 (+ 21017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.124511 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7350400}
I20260709 13:06:21.725178 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:18.981736 21943 pending_rounds.cc:107] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:21.635644 23416 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.136802 21946 rpcz_store.cc:276] 0709 13:06:21.100762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.100895 (+   133us) service_pool.cc:224] Handling call
0709 13:06:21.101219 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:21.111560 (+ 10341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.111589 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.117143 (+  5554us) log.cc:844] Serialized 26 byte log entry
0709 13:06:22.131835 (+1014692us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:22.131893 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.134154 (+  2261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.134214 (+    60us) raft_consensus.cc:1685] finished
0709 13:06:22.134233 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.134395 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4692,"raft.queue_time_us":4973,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9427,"thread_start_us":907509,"threads_started":1,"wal-append.queue_time_us":939938}
I20260709 13:06:22.137329 21943 raft_consensus.cc:2889] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:22.194034 21873 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.194432 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:22.194896 21990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.000s	sys 0.021s
I20260709 13:06:22.139130 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:22.194010 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.195386 21875 raft_consensus.cc:2368] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3.
I20260709 13:06:22.196137 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1382) took 1090 ms. Trace:
W20260709 13:06:22.195297 21990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.000s	sys 0.021s
I20260709 13:06:22.126267 23445 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:22.196450 21875 rpcz_store.cc:276] 0709 13:06:21.106075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.135689 (+1029614us) service_pool.cc:224] Handling call
0709 13:06:22.196085 (+ 60396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.198571 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:22.199149 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 60145.2us
I20260709 13:06:22.126817 23588 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.201709 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:22.129227 23451 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:22.202153 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:22.126816 23495 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.136159 23563 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:22.208340 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 80251.6us
I20260709 13:06:22.209559 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:22.210350 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 116) took 1098 ms. Trace:
I20260709 13:06:22.210624 21870 rpcz_store.cc:276] 0709 13:06:21.112085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.137947 (+1025862us) service_pool.cc:224] Handling call
0709 13:06:22.210303 (+ 72356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.634831 23501 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.193183 23543 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.202656 23445 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.216013 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.216574 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.202039 23535 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:22.200098 23592 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:22.208365 23451 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.223937 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.207957 23506 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:22.233718 23609 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.234189 23506 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.234879 23506 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.202337 23606 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.214306 23573 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.237030 23573 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:22.237601 23573 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.231791 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.239496 22020 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:06:22.240949 23606 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.229380 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.249709 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.250526 23536 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:22.250770 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.241500 23529 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.240513 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.252949 23606 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:22.245364 23568 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.164s	user 0.010s	sys 0.001s
I20260709 13:06:22.253888 23568 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.246112 22609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 372) took 1278 ms. Trace:
I20260709 13:06:22.215977 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.247398 23588 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:22.248119 22604 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:22.253070 22020 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:22.242744 23501 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:22.313638 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.234287 23609 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.256208 22609 rpcz_store.cc:276] 0709 13:06:20.967376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.967610 (+   234us) service_pool.cc:224] Handling call
0709 13:06:20.967946 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.973171 (+  5225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.973212 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.993544 (+ 20332us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.126994 (+133450us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:21.127050 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.127149 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.245899 (+1118750us) raft_consensus.cc:1685] finished
0709 13:06:22.245920 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.246058 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4941,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":16552,"thread_start_us":58466,"threads_started":1,"wal-append.queue_time_us":698805}
I20260709 13:06:22.315475 23609 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.245365 22603 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:22.318493 23588 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.319182 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 887) took 3553 ms. Trace:
I20260709 13:06:22.319703 21943 rpcz_store.cc:276] 0709 13:06:18.766127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.766519 (+   392us) service_pool.cc:224] Handling call
0709 13:06:18.878409 (+111890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.193042 (+3314633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.318862 (+125820us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540009c4d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:22.319077 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234605952}
I20260709 13:06:22.321774 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 421) took 3448 ms. Trace:
I20260709 13:06:22.322299 22604 rpcz_store.cc:276] 0709 13:06:18.873367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.247492 (+3374125us) service_pool.cc:224] Handling call
0709 13:06:22.247865 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.321386 (+ 73521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.321699 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.323524 23557 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.324193 23557 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.324545 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1383) took 1218 ms. Trace:
I20260709 13:06:22.276659 23563 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:06:22.325590 23563 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:22.325973 23563 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:22.326409 23553 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.327119 23550 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:22.229422 23539 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.327653 23550 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:22.224187 23543 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.133766 21945 rpcz_store.cc:276] 0709 13:06:21.090588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.103155 (+ 12567us) service_pool.cc:224] Handling call
0709 13:06:21.248350 (+145195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.411794 (+163444us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:21.524108 (+112314us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.957619 (+433511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.095055 (+137436us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:22.095119 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.095277 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.095406 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":110411,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":10274,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":57742,"thread_start_us":357441,"threads_started":1,"wal-append.queue_time_us":584301}
I20260709 13:06:22.293700 23603 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.339395 23506 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.342280 23506 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.345643 23464 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:21.487159 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:22.373643 23532 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.744s	user 0.002s	sys 0.016s
I20260709 13:06:22.374218 23532 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.375416 23568 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.376106 23554 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.372025 21773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 249) took 4622 ms. Trace:
I20260709 13:06:22.290723 23573 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.376260 23550 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:22.295528 23594 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.488s	user 0.000s	sys 0.001s
I20260709 13:06:22.295383 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.301601 23447 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.305802 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:22.252404 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1381) took 1146 ms. Trace:
I20260709 13:06:22.383104 21870 rpcz_store.cc:276] 0709 13:06:21.105788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.251679 (+1145891us) service_pool.cc:224] Handling call
0709 13:06:22.251971 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.252122 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.252146 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.252187 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:22.252213 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.252262 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.252353 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.326828 23563 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.327026 23553 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.325181 21874 rpcz_store.cc:276] 0709 13:06:21.106383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.323473 (+1217090us) service_pool.cc:224] Handling call
0709 13:06:22.323907 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.324133 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.324170 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.324226 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:22.324268 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.324342 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.324480 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.270993 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 426) took 1163 ms. Trace:
I20260709 13:06:22.269325 23606 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:22.269506 23505 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 3.536s	user 0.024s	sys 0.048s
I20260709 13:06:22.385357 23563 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.385241 22602 rpcz_store.cc:276] 0709 13:06:21.107534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.116720 (+  9186us) service_pool.cc:224] Handling call
0709 13:06:22.270161 (+1153441us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:22.270390 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.270621 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.270649 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.270693 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:22.270726 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.270794 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.270927 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10832128}
W20260709 13:06:22.394008 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 88293.4us
W20260709 13:06:22.403208 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 193705us
W20260709 13:06:22.291958 23580 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.214s	user 0.009s	sys 0.015s
W20260709 13:06:22.379724 21841 leader_election.cc:336] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.870s (SENT)
I20260709 13:06:22.256175 23592 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.381052 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1451) took 1225 ms. Trace:
W20260709 13:06:22.381920 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 246542us
I20260709 13:06:22.410607 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:22.410571 21942 rpcz_store.cc:276] 0709 13:06:21.155455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.517423 (+361968us) service_pool.cc:224] Handling call
0709 13:06:22.295159 (+777736us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:22.380977 (+ 85818us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10425216}
I20260709 13:06:22.411662 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:22.409606 22024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.026s	sys 0.006s
I20260709 13:06:22.410013 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:22.412879 22024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.026s	sys 0.006s
W20260709 13:06:22.404022 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 131134us
I20260709 13:06:22.414167 22023 raft_consensus.cc:2393] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:22.376541 23532 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.413846 21839 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:22.421330 23530 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.424651 21916 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:22.425709 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2995485480000752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.317s for a response
I20260709 13:06:22.408073 23617 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:22.429757 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 225527us
I20260709 13:06:22.377393 21773 rpcz_store.cc:276] 0709 13:06:17.749503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.749681 (+   178us) service_pool.cc:224] Handling call
0709 13:06:19.571220 (+1821539us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.571264 (+    44us) write_op.cc:454] Released schema lock
0709 13:06:22.371901 (+2800637us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:19.244778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:19.245274 (+   496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:19.245306 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:06:19.245329 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:19.245818 (+   489us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:19.245902 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:19.245919 (+    17us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:19.246289 (+   370us) tablet.cc:701] Row locks acquired
0709 13:06:19.246372 (+    83us) write_op.cc:260] PREPARE: finished
0709 13:06:19.248052 (+  1680us) write_op.cc:270] Start()
0709 13:06:19.248205 (+   153us) write_op.cc:276] Timestamp: P: 1783602379247972 usec, L: 0
0709 13:06:19.248243 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:06:19.250313 (+  2070us) log.cc:844] Serialized 1662 byte log entry
0709 13:06:19.258797 (+  8484us) op_driver.cc:464] REPLICATION: finished
0709 13:06:19.260215 (+  1418us) write_op.cc:301] APPLY: starting
0709 13:06:19.260329 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:19.260526 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:19.260728 (+   202us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:19.262591 (+  1863us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:19.262871 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:19.262936 (+    65us) write_op.cc:312] APPLY: finished
0709 13:06:19.263268 (+   332us) log.cc:844] Serialized 41 byte log entry
0709 13:06:19.263447 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.263547 (+   100us) write_op.cc:454] Released schema lock
0709 13:06:19.263615 (+    68us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":286176,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":1100,"apply.run_cpu_time_us":2825,"apply.run_wall_time_us":3765,"num_ops":4,"prepare.queue_time_us":713822,"prepare.run_cpu_time_us":7732,"prepare.run_wall_time_us":13582,"raft.queue_time_us":991,"raft.run_cpu_time_us":1452,"raft.run_wall_time_us":1452,"replication_time_us":10372,"thread_start_us":1014091,"threads_started":4,"wal-append.queue_time_us":4649,"wal-append.run_cpu_time_us":4013,"wal-append.run_wall_time_us":1011913}]]}
I20260709 13:06:22.435050 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:22.435613 22609 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:22.435767 22604 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:06:22.436921 23506 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:22.437321 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:22.437523 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:22.438617 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:22.439188 23600 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:22.424424 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08000beb60 after lost signal to thread 21899
I20260709 13:06:22.441162 23532 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:22.441738 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2500 after lost signal to thread 21974
W20260709 13:06:22.442152 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2420 after lost signal to thread 21975
W20260709 13:06:22.443424 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3480 after lost signal to thread 22048
I20260709 13:06:22.445462 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.446118 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1388) took 1330 ms. Trace:
I20260709 13:06:22.446400 22020 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:22.446571 21867 rpcz_store.cc:276] 0709 13:06:21.115901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.445278 (+1329377us) service_pool.cc:224] Handling call
0709 13:06:22.445601 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.445781 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.445814 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.445857 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:22.445893 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.445953 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.446063 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.447304 23538 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:22.447841 23538 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:22.448302 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:22.448484 23567 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.448958 23567 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:22.448745 23538 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.449323 23567 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.449738 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:22.451093 23534 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:22.451645 23534 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.452239 23362 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.452327 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:22.414813 23447 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:22.436869 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:22.454334 21875 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:06:22.460021 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 80332.5us
I20260709 13:06:22.465520 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:22.433272 23539 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:22.482600 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.465535 23572 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:22.477415 23588 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:22.479377 23608 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:06:22.481158 22609 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 1.
I20260709 13:06:22.491659 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:22.481678 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 55302.9us
I20260709 13:06:22.492524 22610 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.485446 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:22.484485 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1836) took 2008 ms. Trace:
I20260709 13:06:22.485030 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 115) took 1376 ms. Trace:
I20260709 13:06:22.493302 21872 rpcz_store.cc:276] 0709 13:06:21.108578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.459244 (+1350666us) service_pool.cc:224] Handling call
0709 13:06:22.484967 (+ 25723us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:22.477617 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08003310e0 after lost signal to thread 22634
I20260709 13:06:22.498605 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:22.503525 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:22.456979 23536 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:22.478382 23551 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.484031 23600 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:22.512779 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.513490 23621 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:22.514667 23534 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.514938 23573 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:22.515554 23611 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:22.516161 23613 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:22.516826 23616 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:22.590567 21841 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.101s (SENT)
W20260709 13:06:22.495862 22631 debug-util.cc:398] Leaking SignalData structure 0x7b0800258760 after lost signal to thread 22635
W20260709 13:06:22.591804 22631 debug-util.cc:398] Leaking SignalData structure 0x7b0800352480 after lost signal to thread 23284
W20260709 13:06:22.592756 22631 debug-util.cc:398] Leaking SignalData structure 0x7b0800352b40 after lost signal to thread 23469
I20260709 13:06:22.494012 22024 rpcz_store.cc:276] 0709 13:06:20.476394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.038409 (+562015us) service_pool.cc:224] Handling call
0709 13:06:21.039487 (+  1078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.039746 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:21.560883 (+521137us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.483702 (+922819us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.484003 (+   301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.484073 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:22.484133 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.484229 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.484401 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49547,"raft.queue_time_us":14057,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":23801,"thread_start_us":852331,"threads_started":1,"wal-append.queue_time_us":860635}
W20260709 13:06:22.598068 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 94631.6us
I20260709 13:06:22.599686 21942 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:22.601493 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:22.563477 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 134392us
I20260709 13:06:22.480727 23522 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:22.452786 23362 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:22.500922 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.509967 23548 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:22.611562 23548 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:22.506824 23572 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:22.511317 23606 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.525493 23621 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:22.590984 23616 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:22.606797 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.606976 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.600716 23613 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.607640 23445 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.608023 23362 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:22.602149 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 78555.5us
I20260709 13:06:22.610961 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:22.616901 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.584215 23611 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:22.524159 23536 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.588866 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 340) took 1852 ms. Trace:
W20260709 13:06:22.602934 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 117557us
I20260709 13:06:22.653712 21988 leader_election.cc:400] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3.
I20260709 13:06:22.654047 21988 leader_election.cc:403] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:22.626940 23621 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.625634 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.628557 21943 raft_consensus.cc:2410] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:22.634291 21916 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:22.636664 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.612027 23548 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.605793 23615 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:22.650461 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:22.527820 23551 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.655208 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:22.657899 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 233672us
I20260709 13:06:22.628190 23616 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:22.670059 21866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1391) took 1415 ms (client timeout 1871 ms). Trace:
I20260709 13:06:22.675745 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.626794 23606 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.678575 21942 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:22.653964 23592 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:22.652974 22602 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:22.648247 23611 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:22.648389 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:22.677788 21866 rpcz_store.cc:269] 0709 13:06:21.255115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.620835 (+1365720us) service_pool.cc:224] Handling call
0709 13:06:22.669995 (+ 49160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.691565 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:22.692523 22022 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.653025 22601 rpcz_store.cc:276] 0709 13:06:20.734676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.745574 (+ 10898us) service_pool.cc:224] Handling call
0709 13:06:20.745914 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.746164 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.746194 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.760651 (+ 14457us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.113581 (+352930us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:21.117992 (+  4411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.122970 (+  4978us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.480369 (+1357399us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b540062aaa0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fe7dbe 00007f6355ff2930 00007f6355ff28d8 00007f6355ff2858 00007f6355ff2813 00007f6355ff1a9c 00007f635bedd626 00007f635bed7dd8 00007f635602e7cb 00007f63560312c0
0709 13:06:22.484978 (+  4609us) raft_consensus.cc:1685] finished
0709 13:06:22.488906 (+  3928us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.584173 (+ 95267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9053952,"thread_start_us":151898,"threads_started":1,"wal-append.queue_time_us":340859}
I20260709 13:06:22.694509 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:22.683391 22610 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:22.677335 23445 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.698637 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.698390 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:22.689973 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:22.690913 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.694214 23630 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:22.661816 23624 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.672752 23615 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:22.707146 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.715978 21866 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:22.707546 21947 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:22.708189 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.691562 23573 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:22.717901 21943 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:22.698378 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:22.711933 23619 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:06:22.690145 23362 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:06:22.775146 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.775946 22021 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:22.707578 21945 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
W20260709 13:06:22.807474 22017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 1825) took 2306 ms (client timeout 1888 ms). Trace:
I20260709 13:06:22.713925 23630 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:22.717777 23615 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.832165 22022 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:22.832382 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.834290 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.865656 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:22.866317 21947 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:22.866958 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.839430 23557 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:22.807438 21867 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:22.842527 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1445) took 1742 ms. Trace:
I20260709 13:06:22.871982 21949 rpcz_store.cc:276] 0709 13:06:21.099919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.100061 (+   142us) service_pool.cc:224] Handling call
0709 13:06:21.815564 (+715503us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:22.841697 (+1026133us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4de9c 00007f6352f4da5b 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:22.841920 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.842106 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.842134 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.842260 (+   126us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:22.842296 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.842356 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.842465 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70786176}
I20260709 13:06:22.846012 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:22.846866 21873 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
W20260709 13:06:22.847221 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.850939 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.852236 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.853631 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.813119 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.854240 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:22.857944 22017 rpcz_store.cc:269] 0709 13:06:20.418885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.534665 (+115780us) service_pool.cc:224] Handling call
0709 13:06:22.722436 (+2187771us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b5400181ad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:22.725012 (+  2576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79660928}
I20260709 13:06:22.865495 22021 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:22.867537 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:22.876674 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 182250us
I20260709 13:06:22.879092 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.877923 21916 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:22.874296 21873 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:22.874212 22016 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:22.865127 23630 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:22.881872 21873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 102) took 2746 ms (client timeout 2124 ms). Trace:
W20260709 13:06:22.882671 21873 rpcz_store.cc:269] 0709 13:06:20.135705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.148523 (+ 12818us) service_pool.cc:224] Handling call
0709 13:06:21.725087 (+1576564us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5c000a800c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f63599dc161 00007f6359b7da79 00007f635b0379b6 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:22.881821 (+1156734us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544743296}
I20260709 13:06:22.883893 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.890216 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:22.712572 23572 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:22.886157 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.900616 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.887084 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:22.902300 23620 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:22.902508 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.902824 23620 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.903196 21949 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:22.903795 23625 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:22.904341 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:22.885584 23618 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:06:22.904861 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.905283 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.906037 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.906548 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:22.907184 21947 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:22.907328 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:22.907862 21866 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.909401 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:22.910449 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:22.911048 21872 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:22.912180 21872 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:22.904994 22017 raft_consensus.cc:2376] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4. Re-sending same reply.
I20260709 13:06:22.910527 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1385) took 1795 ms. Trace:
I20260709 13:06:22.933801 21875 rpcz_store.cc:276] 0709 13:06:21.114967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.406724 (+1291757us) service_pool.cc:224] Handling call
0709 13:06:22.415425 (+  8701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.477042 (+ 61617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.910308 (+433266us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b54003773d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:22.910475 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88715136}
I20260709 13:06:22.885706 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.934949 23625 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:22.935401 23625 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:22.935758 23625 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:22.935685 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.936934 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.937999 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.938535 22018 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:22.939340 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:22.935019 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.942474 22017 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:22.903234 23620 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:22.912520 23554 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.000s
I20260709 13:06:22.956359 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.957357 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:22.957804 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.958021 21875 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:22.958053 21943 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:22.968957 21950 raft_consensus.cc:2410] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:22.959939 23451 consensus_meta.cc:287] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.007s
I20260709 13:06:23.009007 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.009747 21873 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.969190 23637 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:23.016199 23465 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:23.019121 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 74432.6us
I20260709 13:06:23.021039 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.026082 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.026778 22022 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:22.946302 23498 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:22.960953 23588 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:23.031394 22017 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:23.027346 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.032967 21946 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:23.028404 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:22.963141 23536 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:23.034933 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.037217 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.045413 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:23.037688 23588 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:23.038738 23609 consensus_meta.cc:287] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.002s
I20260709 13:06:23.040810 23550 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.042913 23616 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.048805 21866 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
W20260709 13:06:23.063208 21869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1389) took 1947 ms (client timeout 1906 ms). Trace:
W20260709 13:06:23.063730 21869 rpcz_store.cc:269] 0709 13:06:21.116179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.063016 (+1946837us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:23.063142 (+   126us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:23.050551 23625 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.064939 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.065930 22022 raft_consensus.cc:2410] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:23.066699 23625 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:23.066920 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.027073 23631 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:23.069121 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:23.062633 23630 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.044795 23606 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.076644 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.077178 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.083205 22017 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:23.072551 21866 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:23.028407 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 66305.1us
I20260709 13:06:23.125425 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.021943 23451 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.127246 22021 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:23.068967 23631 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.077095 23535 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.075347 23640 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:23.152477 23640 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:23.149936 21943 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:23.145926 21866 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:23.151352 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:23.154563 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.159274 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.157858 21873 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:23.160149 22017 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:23.155045 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.161692 21946 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:23.053958 23609 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.029753 23637 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:23.140694 23613 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:23.171284 22573 connection.cc:256] RPC call timeout handler was delayed by -1.5206929940001146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 13:06:23.139153 22576 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.585s (SENT)
W20260709 13:06:23.173534 22573 connection.cc:256] RPC call timeout handler was delayed by -1.4081067370000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:06:23.173681 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:23.174170 22573 connection.cc:256] RPC call timeout handler was delayed by -1.2462917980000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:06:23.175068 22573 connection.cc:256] RPC call timeout handler was delayed by -1.0347921689999566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 13:06:23.175489 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:23.176324 21949 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.156453 23640 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.181146 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:23.179360 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.184576 22015 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:23.168540 22603 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:23.184679 23557 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.189112 23557 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.191504 23624 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3.
I20260709 13:06:23.192932 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:23.193866 23543 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:23.173468 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:23.254366 21941 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:23.255162 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.257603 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:23.269670 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.189132 21945 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:23.270983 21949 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
W20260709 13:06:23.305574 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.306485 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 125397us
W20260709 13:06:23.307632 23567 consensus_meta.cc:287] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.858s	user 0.009s	sys 0.003s
I20260709 13:06:23.498687 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:23.329780 21841 leader_election.cc:336] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.502s (SENT)
I20260709 13:06:23.525472 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:23.354192 22020 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:23.526710 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.500095 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.391512 22024 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:23.498340 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 120) took 1052 ms. Trace:
I20260709 13:06:23.529171 21875 rpcz_store.cc:276] 0709 13:06:22.446180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.965849 (+519669us) service_pool.cc:224] Handling call
0709 13:06:23.022708 (+ 56859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.028971 (+  6263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.029017 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.029592 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.177036 (+147444us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:23.177080 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.177147 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.179261 (+  2114us) raft_consensus.cc:1685] finished
0709 13:06:23.179278 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.498254 (+318976us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5768,"raft.queue_time_us":5912,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":21053,"thread_start_us":100404,"threads_started":1,"wal-append.queue_time_us":120517}
I20260709 13:06:23.562258 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 1847) took 1329 ms. Trace:
I20260709 13:06:23.321626 22604 raft_consensus.cc:2410] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:23.524333 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.562767 22019 rpcz_store.cc:276] 0709 13:06:22.198501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.203567 (+  5066us) service_pool.cc:224] Handling call
0709 13:06:23.526505 (+1322938us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800200498. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:23.528068 (+  1563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3990400}
W20260709 13:06:23.330948 23621 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.643s	user 0.006s	sys 0.004s
W20260709 13:06:23.409240 23611 consensus_meta.cc:287] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.000s
I20260709 13:06:23.394739 23451 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:23.555238 23548 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.847s	user 0.015s	sys 0.004s
I20260709 13:06:23.588303 21916 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:23.564410 23561 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.002s	sys 0.016s
I20260709 13:06:23.523531 23557 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:23.394420 23631 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:23.443745 23630 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:23.528406 23609 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:23.594622 23561 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.002s	sys 0.016s
I20260709 13:06:23.607684 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.587872 23625 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.371994 23640 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.346633 23620 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.563580 23567 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.635697 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.605180 23557 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:23.599939 23548 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.634104 23625 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.649147 21944 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:23.649873 23625 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:23.601158 23649 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.604769 23451 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:23.604879 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.594099 23611 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.611590 23637 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.594471 23621 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.601274 23651 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:23.657550 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 158922us
I20260709 13:06:23.658466 21947 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:23.658638 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.640434 23616 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.662606 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1852) took 1453 ms. Trace:
I20260709 13:06:23.665894 23553 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.666272 23567 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.639278 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.610550 23588 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.669353 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.673564 21772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 159) took 4228 ms. Trace:
I20260709 13:06:23.680552 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 123) took 1214 ms. Trace:
I20260709 13:06:23.680428 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.661854 23451 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.676482 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1449) took 2559 ms. Trace:
I20260709 13:06:23.682318 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:23.687141 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.687014 22022 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:23.686822 21772 rpcz_store.cc:276] 0709 13:06:19.445504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.445681 (+   177us) service_pool.cc:224] Handling call
0709 13:06:23.673493 (+4227812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2067591,"reported_tablets":1}
I20260709 13:06:23.688570 21948 rpcz_store.cc:276] 0709 13:06:21.117423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.016127 (+898704us) service_pool.cc:224] Handling call
0709 13:06:23.675729 (+1659602us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:23.675947 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.676136 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.676164 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:23.676211 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:23.676245 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.676307 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.676419 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60248960}
I20260709 13:06:23.691185 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.686945 21872 rpcz_store.cc:276] 0709 13:06:22.466102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.036846 (+570744us) service_pool.cc:224] Handling call
0709 13:06:23.070706 (+ 33860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.071033 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.071062 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.078402 (+  7340us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.525378 (+446976us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:23.525426 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.525513 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.680308 (+154795us) raft_consensus.cc:1685] finished
0709 13:06:23.680334 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.680491 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":409,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":8567,"thread_start_us":372452,"threads_started":1,"wal-append.queue_time_us":452401}
I20260709 13:06:23.694083 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.694494 22020 raft_consensus.cc:2376] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4. Re-sending same reply.
I20260709 13:06:23.695542 22573 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:23.697943 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.693622 23651 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:23.699565 23651 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:23.699687 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.700035 23651 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.700446 22019 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:23.701256 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:23.702273 23623 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 1.110s	user 0.005s	sys 0.007s
I20260709 13:06:23.702334 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.683495 22015 rpcz_store.cc:276] 0709 13:06:22.209184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.276403 (+ 67219us) service_pool.cc:224] Handling call
0709 13:06:22.334264 (+ 57861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.185110 (+850846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.662312 (+477202us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b5400198f54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:23.662539 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1944342784}
I20260709 13:06:23.704998 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.705629 22022 raft_consensus.cc:2376] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4. Re-sending same reply.
I20260709 13:06:23.708099 22015 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:23.709010 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.709141 22022 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:23.710275 22019 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:23.698673 23588 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.713965 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.714439 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.714645 21948 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:23.715664 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.712306 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.716811 23551 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.718492 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.719080 23620 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:23.719748 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.720520 22022 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:23.721361 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.723062 21771 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 4, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 4 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.724675 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.726195 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.726728 22022 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:23.717393 23541 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:23.720142 23640 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:23.727830 23615 consensus_meta.cc:287] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.853s	user 0.006s	sys 0.003s
I20260709 13:06:23.721419 23611 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.730978 23615 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.733249 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.728371 23621 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:23.735925 23615 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:23.722193 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.736922 22015 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:23.737253 21950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 892) took 4319 ms (client timeout 3053 ms). Trace:
I20260709 13:06:23.737774 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:23.737677 21950 rpcz_store.cc:269] 0709 13:06:19.417630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.067370 (+1649740us) service_pool.cc:224] Handling call
0709 13:06:23.736978 (+2669608us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400162e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:23.737159 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4269818752}
I20260709 13:06:23.738607 22015 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:23.739566 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.739655 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.740373 22016 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:23.740547 23651 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.741390 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.741726 21942 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:23.742105 21942 pending_rounds.cc:85] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 5
I20260709 13:06:23.742074 22016 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:23.742470 21942 pending_rounds.cc:107] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:23.742781 21942 raft_consensus.cc:2889] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:23.743005 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.744007 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.744709 22016 raft_consensus.cc:2410] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:23.745471 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.746464 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.747437 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.747968 22016 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:23.722577 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.723560 23469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f404cd14ba4c2687ffe2b7637e1da7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:23.748732 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 418979us
I20260709 13:06:23.748790 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.749722 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:23.751780 21841 leader_election.cc:336] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.664s (SENT)
I20260709 13:06:23.727479 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.756007 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.756156 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.756790 21871 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:23.734050 22023 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:23.761732 21771 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 3, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.764453 22610 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:23.764799 22016 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:23.761080 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 923) took 1049 ms. Trace:
I20260709 13:06:23.765712 21942 rpcz_store.cc:276] 0709 13:06:22.712165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.712385 (+   220us) service_pool.cc:224] Handling call
0709 13:06:23.741398 (+1029013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:23.743227 (+  1829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.744561 (+  1334us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400162e50. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:23.761015 (+ 16454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2365538560}
I20260709 13:06:23.766777 22022 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:23.768153 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.769393 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.773247 22609 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 3. Ops: []
I20260709 13:06:23.773756 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.776911 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:23.777760 21942 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 2: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:23.753189 23362 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.778828 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.783015 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:23.779119 22023 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:23.780048 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.783843 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.754977 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:23.787045 21988 connection.cc:256] RPC call timeout handler was delayed by -1.255774261000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 13:06:23.787544 21988 connection.cc:256] RPC call timeout handler was delayed by -1.2089742609999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:06:23.787683 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:23.753513 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.788445 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:23.789175 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:23.789323 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.776134 23651 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:23.790839 21875 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:23.791263 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:23.793022 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.768313 23541 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.795007 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:23.795986 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:23.798167 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:23.774032 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:23.799788 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.803191 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.803628 21875 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:23.805804 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.794385 23625 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:23.794505 23630 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.808331 23625 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:23.798447 23567 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:23.808787 23625 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.809155 23501 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.809233 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:23.809923 23501 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:23.810602 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:23.811267 23501 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:23.811672 23501 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:23.811823 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:23.798249 23416 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:23.812705 22603 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:23.812877 23416 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:23.813207 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:23.801012 23572 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:06:23.813938 22606 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:23.814251 23572 consensus_queue.cc:1243] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:23.814875 23572 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:23.815325 23572 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:23.815894 23652 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:23.816319 23652 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:23.804097 23637 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:23.817077 23637 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.817544 23637 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.817296 23652 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.817775 23631 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:23.818614 23652 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.801153 23616 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:23.819602 23616 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.820186 23616 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.813365 23416 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.812091 23501 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.820748 23561 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.840404 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:23.835904 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.794200 23611 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.842023 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.843779 21942 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:23.841264 21875 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
W20260709 13:06:23.846091 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.849313 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.805549 23554 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:23.802645 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.851886 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.851792 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.820938 23613 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:23.845302 22015 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:23.854915 21871 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.809082 23567 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:23.860051 21868 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 3. Ops: []
I20260709 13:06:23.861222 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.862430 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.854770 21875 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:23.863621 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.820785 23616 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:23.870095 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.845124 23574 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:23.871230 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.805063 23541 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.821820 22601 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:23.809041 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:23.874317 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:23.864640 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.878836 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.867785 21867 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:23.864946 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:23.877560 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.880381 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:23.867170 23554 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:23.816339 23572 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.856338 23613 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:23.847286 23611 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:23.890224 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:23.882653 22607 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:23.881286 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.889830 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.926299 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:23.957326 22022 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
W20260709 13:06:23.900049 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.957901 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 83653.5us
I20260709 13:06:23.868813 23567 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.929111 21869 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:23.872956 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:23.882159 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.905278 22604 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:23.896776 21871 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:23.962744 21874 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:23.904345 22602 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:23.964408 22016 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:23.871017 23609 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:06:23.891353 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.882489 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:23.952220 23651 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.873595 23592 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:06:23.969878 21839 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:23.904808 23658 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:06:23.961730 23620 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:23.881819 23445 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:06:23.965638 23572 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.973969 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:23.930506 23556 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:06:23.903888 23625 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:23.963757 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 152730us
I20260709 13:06:23.979198 22023 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:23.977324 23620 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:23.973150 22605 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:23.987147 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:23.990383 21916 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:23.976819 23554 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:23.992120 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:23.999771 21916 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:24.001219 23630 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.005018 23541 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:24.006726 23541 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.007128 23541 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.007481 23541 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.988086 23620 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.008957 23649 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.009889 23649 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.010187 23649 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:24.011062 23649 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.011422 23637 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.012252 23649 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.012737 23621 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:24.008311 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.013515 23637 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:24.013643 23362 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:24.014139 23362 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:24.014994 23362 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.016343 22017 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:24.022004 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.024258 22574 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:23.980461 23616 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:24.022109 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.040086 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.042613 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 97) took 1363 ms. Trace:
I20260709 13:06:24.043028 22024 rpcz_store.cc:276] 0709 13:06:22.679665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.689717 (+ 10052us) service_pool.cc:224] Handling call
0709 13:06:24.042421 (+1352704us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54000dded4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:24.042559 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137512832}
I20260709 13:06:24.001221 23416 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.048270 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:24.052073 22018 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:23.998874 23640 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:23.978623 23613 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.066565 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.031424 23651 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:24.041893 23588 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:24.076257 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 219084us
I20260709 13:06:24.052374 23617 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:24.076962 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 117722us
I20260709 13:06:24.071363 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:24.052117 23553 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.078687 22608 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:06:24.047955 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61603.7us
I20260709 13:06:24.062769 23640 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:24.094961 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:24.096819 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:24.096904 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:24.071022 23563 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.106715 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:24.109165 22606 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:24.110167 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 110) took 1260 ms. Trace:
I20260709 13:06:24.126727 22018 rpcz_store.cc:276] 0709 13:06:22.849965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.980922 (+130957us) service_pool.cc:224] Handling call
0709 13:06:24.042563 (+1061641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.052579 (+ 10016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.109960 (+ 57381us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000dded0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:24.110110 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350082432}
I20260709 13:06:24.111306 23451 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:24.083724 23651 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.129787 23651 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:24.088116 22602 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:24.073612 23445 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:06:24.113582 23625 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:24.123899 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:24.111857 23501 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.108264 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:24.094805 23613 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.135874 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:24.136880 21942 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.098800 23640 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.126534 22015 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:24.133293 23631 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:24.146096 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 295464us
I20260709 13:06:24.135332 23611 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:24.157420 21838 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:24.145359 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:24.132589 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:24.161670 23501 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:24.163172 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:57074 (request call id 320) took 7117 ms. Trace:
I20260709 13:06:24.168951 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:24.138033 22605 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:24.174182 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:24.174808 21942 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.155009 23609 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.187587 23609 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:24.188892 21944 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:24.189927 23658 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.190333 23658 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:24.156867 23556 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.193310 23556 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.194279 23620 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.195348 23556 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:24.195593 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.157433 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:24.177506 23548 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:24.173802 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:24.181880 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.226032 22017 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.183238 22021 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:24.183777 22601 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:24.184469 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:24.185204 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.185762 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:24.185940 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.151969 23631 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:24.169508 21941 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.181098 21946 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.155444 23663 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.224903 21942 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:24.233500 22573 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:24.239351 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 265032us
I20260709 13:06:24.243556 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.238121 23677 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:24.238360 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 309248us
I20260709 13:06:24.172685 23416 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:24.247661 21942 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:24.252332 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:24.258656 23684 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:24.254912 23537 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.241127 23631 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.255676 22015 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.245369 21945 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:24.257189 23644 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.257768 22024 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:06:24.257851 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 93600.3us
I20260709 13:06:24.258069 23682 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:24.260372 22018 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:24.265699 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:24.239588 23553 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:24.277252 21944 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.277215 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.254552 23658 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.285621 22020 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 13:06:24.286563 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 211369us
W20260709 13:06:24.148267 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 51478.5us
I20260709 13:06:24.259112 23615 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:24.241067 21950 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:24.268383 23677 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.389860 23677 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:24.390272 23677 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.308164 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.286164 23684 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.397668 23652 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:24.400216 23592 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.400667 23592 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:24.401134 23553 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.401609 23592 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.402980 23592 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.235484 23535 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:24.278721 23537 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:24.244032 23567 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.163717 23469 rpcz_store.cc:276] 0709 13:06:17.055215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.055375 (+   160us) service_pool.cc:224] Handling call
0709 13:06:17.622463 (+567088us) ts_tablet_manager.cc:934] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
0709 13:06:23.696079 (+6073616us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:23.894469 (+198390us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:23.894576 (+   107us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:24.162167 (+267591us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:24.162524 (+   357us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:24.162906 (+   382us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:24.163024 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10269,"tablet-copy.queue_time_us":292831,"thread_start_us":1031142,"threads_started":2}
I20260709 13:06:24.404330 23469 tablet_copy_client.cc:806] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:24.404968 23469 tablet_copy_client.cc:670] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:24.404491 23537 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.405579 23567 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:24.300498 23620 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:24.405903 23537 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.406636 22022 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.301267 23644 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:24.244635 23609 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.409245 23686 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:24.410449 23686 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:24.410801 23686 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:24.385006 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:24.387359 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:24.387682 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 145245us
I20260709 13:06:24.387513 23561 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:24.388231 23529 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:24.387516 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 230187us
I20260709 13:06:24.434635 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:24.372781 23598 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.386287 22020 pending_rounds.cc:85] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 3
I20260709 13:06:24.412310 21943 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:24.438890 21943 pending_rounds.cc:85] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 4
I20260709 13:06:24.439152 21943 pending_rounds.cc:107] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:24.439383 21943 raft_consensus.cc:2889] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:24.433655 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:24.437536 21838 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:24.441608 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.386744 23615 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:24.442041 22020 pending_rounds.cc:107] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:24.455477 22020 raft_consensus.cc:2889] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:24.413209 23630 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:24.308200 23574 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
W20260709 13:06:24.454170 21839 consensus_peers.cc:597] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5375c76fdd4d4624b9b6cbaa44ae40c0. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.473222 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 58525.1us
I20260709 13:06:24.441735 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:24.471026 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 317199us
W20260709 13:06:24.477099 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 204849us
I20260709 13:06:24.478251 21988 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:24.482717 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:24.436769 23529 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:24.494784 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.440670 23598 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:24.441432 23676 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:24.437049 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69304.3us
I20260709 13:06:24.454794 23620 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.457512 23416 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.524509 22017 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:24.524978 21916 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:24.448400 23682 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:24.537974 21988 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.453938 23663 raft_consensus.cc:2764] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:24.439582 23572 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:06:24.441038 23567 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
W20260709 13:06:24.542403 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 65869.2us
I20260709 13:06:24.548174 21948 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.513895 23611 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.516733 23658 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.543916 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:24.520785 23541 consensus_meta.cc:287] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 13:06:24.494818 23445 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:24.546036 21947 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:24.546895 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.523715 23551 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:24.524204 23598 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.407788 23644 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.542450 23416 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.524360 23676 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.596261 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:24.529506 23529 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:24.543670 23561 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.542076 23682 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:24.625468 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 151171us
W20260709 13:06:24.626780 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 79965.3us
I20260709 13:06:24.627559 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:24.618422 23465 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:24.570304 23551 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:24.618955 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:24.543411 23666 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:06:24.530232 23563 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:06:24.594390 23362 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:06:24.620549 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 52767.4us
I20260709 13:06:24.628391 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:24.493212 23548 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
W20260709 13:06:24.629228 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60478.8us
I20260709 13:06:24.635151 21839 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:24.640437 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:24.800292 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 159924us
I20260709 13:06:24.643188 23663 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:06:24.494365 23630 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.647925 23567 consensus_queue.cc:1243] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:24.548115 23614 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:24.634203 23682 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:24.648394 23622 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.619809 23416 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.596546 23620 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 13:06:24.648417 23551 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.805550 23690 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.568905 23685 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.162s
I20260709 13:06:24.716226 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:24.652047 21950 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:24.883852 23567 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:24.576741 23541 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.619203 23676 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:24.707329 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.598054 23445 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.567234 23621 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:06:24.653616 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:24.788807 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 160469us
I20260709 13:06:24.524984 23686 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.596761 23615 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.544090 23675 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:24.802774 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:24.805091 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 170028us
W20260709 13:06:24.976748 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.977442 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 174752us
I20260709 13:06:24.655222 23640 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:24.984588 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:24.835261 23677 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.986464 23640 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:24.738031 23563 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:24.987152 23694 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:06:24.842770 23362 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:24.845041 23631 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:06:24.850899 23556 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.863030 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 939) took 1021 ms. Trace:
I20260709 13:06:24.869985 21941 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:24.873374 23695 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:06:24.726405 23699 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:24.906992 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 107667us
I20260709 13:06:24.909904 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 390) took 1055 ms. Trace:
I20260709 13:06:24.819808 23684 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:25.007647 22610 rpcz_store.cc:276] 0709 13:06:23.854288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.854521 (+   233us) service_pool.cc:224] Handling call
0709 13:06:24.032431 (+177910us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:24.032712 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.131796 (+ 99084us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:24.174241 (+ 42445us) log.cc:844] Serialized 14 byte log entry
0709 13:06:24.437424 (+263183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.437474 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:24.437513 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.909641 (+472128us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b54005deb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:24.909701 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.909841 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1677,"prepare.queue_time_us":151087,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4180,"raft.queue_time_us":4644,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11095,"spinlock_wait_cycles":231156992,"thread_start_us":303277,"threads_started":2,"wal-append.queue_time_us":355960}
I20260709 13:06:24.566957 23652 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:06:24.809623 23557 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:06:24.876581 23625 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:06:24.980564 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:24.917529 23567 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.982378 23692 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:24.984112 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:24.984840 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:24.849943 23572 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:24.987299 23563 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:24.994097 21943 rpcz_store.cc:276] 0709 13:06:23.842020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.842169 (+   149us) service_pool.cc:224] Handling call
0709 13:06:23.853893 (+ 11724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.440082 (+586189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.862647 (+422565us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540009c9d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:24.862928 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283431168}
I20260709 13:06:24.999925 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:25.001058 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.024875 21945 raft_consensus.cc:2410] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:25.002766 23681 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.109s	user 0.001s	sys 0.001s
I20260709 13:06:25.003100 22017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "105015b2b463442ab34e0509af7105fb"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:25.064062 22017 raft_consensus.cc:606] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.003152 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:24.913647 23659 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:06:25.007669 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:25.012634 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.023355 23684 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:24.990679 23362 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:25.025863 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 45765.3us
W20260709 13:06:25.035980 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 408466us
I20260709 13:06:25.036198 21874 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:24.993875 23556 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:25.022470 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:25.075748 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 53401.6us
I20260709 13:06:24.997373 23631 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.035478 23567 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:25.078137 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.068874 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:25.065796 23537 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.010s
I20260709 13:06:25.025028 23621 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:06:25.059616 23677 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:25.080235 23649 consensus_meta.cc:287] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.047s	user 0.009s	sys 0.001s
I20260709 13:06:25.096086 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.102892 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:25.078784 23362 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:25.087854 23613 consensus_meta.cc:287] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.939s	user 0.009s	sys 0.001s
I20260709 13:06:25.111177 21949 raft_consensus.cc:2410] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:25.114130 23556 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.053934 23699 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.116554 23563 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:25.081662 23572 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:25.117316 23501 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:25.119634 23631 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.108402 22604 raft_consensus.cc:2410] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:25.140969 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 154625us
I20260709 13:06:25.139439 21872 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:25.104784 23625 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:25.140237 23598 consensus_meta.cc:287] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.005s
W20260709 13:06:25.153234 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 226267us
W20260709 13:06:25.168243 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72267.2us
I20260709 13:06:25.171269 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:25.139127 23557 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.057439 23692 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.191809 23465 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:25.192386 23465 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.192750 23692 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:25.142831 23611 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:25.193751 23714 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.194290 23714 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:25.193881 23611 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.194479 23465 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.194684 23714 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.080828 23707 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:06:25.196772 23630 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:25.198625 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 183330us
I20260709 13:06:25.189667 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.148259 23501 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:25.128710 23659 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:06:25.169723 23572 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:25.214236 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.182722 23537 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.216637 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:25.217525 22610 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.184859 23541 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:25.236124 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 167343us
I20260709 13:06:25.237920 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.238018 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:25.239176 22608 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:25.146111 23670 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:06:25.201038 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:25.206890 23445 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.206439 23630 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:25.255847 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.183959 23598 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.217291 23616 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:25.183089 23625 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:25.256654 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 255727us
I20260709 13:06:25.186201 23683 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:06:25.277801 22017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
W20260709 13:06:25.278071 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 472004us
I20260709 13:06:25.288026 22017 raft_consensus.cc:606] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:25.291694 22017 raft_consensus.cc:614] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:25.267022 23622 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.257593 21950 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:25.264170 23674 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.263341 23451 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.267374 23684 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:25.305852 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:25.303236 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 86463.3us
I20260709 13:06:25.266234 23630 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.317755 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.319449 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:25.321102 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.326066 23551 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.328143 23706 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:25.328980 23541 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:25.329385 23622 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:25.331139 23675 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:25.331596 23675 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:25.333583 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:25.336122 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:25.336755 23715 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.338477 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:25.340574 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:25.341692 22017 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:25.345157 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.351774 22017 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:25.351816 22610 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:25.353282 22574 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.353590 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:25.545663 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 192159us
I20260709 13:06:25.546387 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.549512 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.551111 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.269104 23501 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.560286 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:25.377841 23720 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 13:06:25.530803 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 133472us
I20260709 13:06:25.568497 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:25.569425 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.379667 23655 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.370384 23708 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.531855 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:25.379149 23713 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.537240 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:25.531009 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.584959 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.533314 23592 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.542201 23551 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:25.542595 23557 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.542734 23630 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:25.313920 23572 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.306553 23451 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:25.329032 23706 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:06:25.558679 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:25.560482 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 207338us
I20260709 13:06:25.378597 23716 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:06:25.574926 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:25.576874 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 255863us
W20260709 13:06:25.544631 23529 consensus_meta.cc:287] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.889s	user 0.009s	sys 0.005s
I20260709 13:06:25.543497 23445 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.552502 23553 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.633320 23563 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.561733 23684 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.576681 23541 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.567224 23675 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.312824 23674 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:25.636435 23666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.059s	sys 0.042s
I20260709 13:06:25.587405 23670 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:25.598681 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:25.579545 23567 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.591178 23713 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.637563 23501 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.636963 23592 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:25.727172 23666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.060s	sys 0.043s
I20260709 13:06:25.650542 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:25.625324 23699 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.669166 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.583545 23707 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:25.623594 23644 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.561887 23617 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:25.725764 23727 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:25.707137 21868 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:25.633786 23708 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.722039 23445 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.740890 23684 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:25.737417 23713 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.742292 23718 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:25.776670 21914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.108s	sys 0.118s
W20260709 13:06:25.753152 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 84101.3us
I20260709 13:06:25.737769 23706 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:25.718499 23529 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.746500 23553 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:25.727886 23563 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.750177 23621 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.777432 21914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.108s	sys 0.118s
I20260709 13:06:25.755113 23699 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.779980 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.795778 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.748569 23707 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:25.784142 23725 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:25.754211 21867 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:25.765735 23598 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.768373 23727 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:25.809908 23708 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:25.810921 23722 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
I20260709 13:06:25.813829 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.734931 23670 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.823717 21875 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:25.794471 23714 consensus_meta.cc:287] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.006s
W20260709 13:06:25.800251 23416 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.907s	user 0.006s	sys 0.014s
I20260709 13:06:25.840692 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.811906 23707 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.777348 23684 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.824311 23716 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.758150 23617 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:25.846982 23732 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:06:25.830216 23720 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.837090 23727 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.800518 23621 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:25.814654 23362 consensus_meta.cc:287] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.009s
I20260709 13:06:25.878938 23723 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:25.879781 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:25.880689 23588 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.892856 23588 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.895476 23469 tablet_copy_client.cc:538] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:25.895648 23588 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.897969 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:25.898615 22604 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.881122 23563 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.859892 23598 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:25.812058 23706 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.888438 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.793298 23451 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:25.907029 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 66455.3us
I20260709 13:06:25.875131 23720 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:25.912698 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.858837 23416 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.915571 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.896153 23588 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:25.917474 23567 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:25.918956 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 360383us
I20260709 13:06:25.920061 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.921666 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.858012 23714 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.908849 23674 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:25.915712 23720 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.955058 23737 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:25.955127 23745 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:25.955917 23737 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.956218 23745 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:25.957005 23715 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:25.957607 23715 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.958659 23737 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:25.959138 23745 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:25.959672 23715 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:25.960639 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:25.961232 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:25.929414 23574 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:25.962327 23445 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:25.961414 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:25.948339 23658 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.377s	user 0.010s	sys 0.005s
I20260709 13:06:25.938848 23592 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:25.968652 23715 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:25.969060 23715 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.969408 23715 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:25.971662 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:25.972848 23551 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:25.973333 23745 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:25.975795 23682 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.071s	user 0.012s	sys 0.002s
I20260709 13:06:25.969380 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:25.891993 23362 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:25.981926 23617 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.982060 23721 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:25.986112 23721 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:25.986990 23754 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:25.993836 21948 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:25.990937 23684 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:25.991470 23747 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:25.991611 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 361) took 1063 ms. Trace:
W20260709 13:06:25.991549 23746 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:06:25.964322 23574 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:25.967865 23554 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:25.967801 23598 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:25.977722 23723 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.007514 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:26.016316 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:25.932655 23588 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:26.009354 23744 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:06:26.010646 23747 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:25.992154 23734 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:06:25.976344 23682 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.023864 23755 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:26.024843 23750 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.006721 22605 rpcz_store.cc:276] 0709 13:06:24.928072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.928769 (+   697us) service_pool.cc:224] Handling call
0709 13:06:25.020187 (+ 91418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.293714 (+273527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.298933 (+  5219us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.373042 (+ 74109us) log.cc:844] Serialized 26 byte log entry
0709 13:06:25.764549 (+391507us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:25.769587 (+  5038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.776411 (+  6824us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.991366 (+214955us) raft_consensus.cc:1685] finished
0709 13:06:25.991392 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.991552 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108879,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":9914,"thread_start_us":561404,"threads_started":2,"wal-append.queue_time_us":506297}
I20260709 13:06:26.002301 23529 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.032344 23706 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:26.013908 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.018965 23574 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.019804 23554 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:26.022569 23737 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:26.040392 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61388.3us
I20260709 13:06:26.041028 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.042605 22609 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:26.043969 23738 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:06:26.043990 22020 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:26.045356 23748 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:06:26.048091 23740 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:26.050076 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.051448 22603 raft_consensus.cc:2393] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:26.028548 23747 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.053460 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 360) took 1125 ms. Trace:
I20260709 13:06:26.046507 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:26.055997 22607 rpcz_store.cc:276] 0709 13:06:24.927712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.927870 (+   158us) service_pool.cc:224] Handling call
0709 13:06:24.983786 (+ 55916us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:25.135813 (+152027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.135843 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:25.136468 (+   625us) log.cc:844] Serialized 52 byte log entry
0709 13:06:25.288292 (+151824us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:25.288331 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.288398 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.052530 (+764132us) raft_consensus.cc:1685] finished
0709 13:06:26.052550 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.053402 (+   852us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141088,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":14737,"thread_start_us":246826,"threads_started":2,"wal-append.queue_time_us":241022}
I20260709 13:06:26.060042 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:26.003901 23751 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:06:26.065737 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:26.055401 23749 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.057344 23670 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:26.068177 21841 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:26.062388 23529 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.062531 23621 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.071457 23598 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.072201 23416 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.035358 23721 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:06:26.059276 23554 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.084908 23759 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:26.085008 23598 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:26.085554 21949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1470) took 1963 ms (client timeout 1933 ms). Trace:
I20260709 13:06:26.086095 23598 consensus_queue.cc:1243] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:06:26.086035 21949 rpcz_store.cc:269] 0709 13:06:24.121892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.123625 (+  1733us) service_pool.cc:224] Handling call
0709 13:06:26.085335 (+1961710us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54003d2cd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:26.085488 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236683008}
I20260709 13:06:26.086815 23745 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.085489 23759 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:26.087189 23745 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:26.089210 23362 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.095391 23715 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:26.090623 23697 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.343s	user 0.008s	sys 0.014s
I20260709 13:06:26.087313 23757 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.072839 23749 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.104993 23749 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:26.106199 23676 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.180s	user 0.006s	sys 0.007s
I20260709 13:06:26.106600 23676 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.107658 21871 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:26.111995 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "866936931060464d858e0e11cefba859"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:26.112684 22020 raft_consensus.cc:606] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:26.112996 22020 raft_consensus.cc:614] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:26.092275 23759 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.115832 23682 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.116042 23745 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.109158 23554 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.103534 23469 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
W20260709 13:06:26.126279 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54792.7us
I20260709 13:06:26.126544 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.127200 22020 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:26.128917 23588 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:26.129120 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.129871 21873 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:26.131637 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.132143 21873 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.133225 22018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:26.133827 22018 raft_consensus.cc:606] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:26.115368 23676 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.137538 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.138078 23716 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.140353 22018 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.142520 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.144418 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.145143 22018 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:26.147341 21870 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:26.148977 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.152094 22021 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:26.144302 23745 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.156533 22018 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:26.158567 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.158870 21874 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.160741 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.164376 22021 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:26.163354 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.169278 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.159789 23704 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.174203 22604 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:26.177402 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:26.182217 23561 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:26.182780 23561 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:26.182242 23704 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:26.155092 23713 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.192871 21873 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:26.188570 23561 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.198545 22018 raft_consensus.cc:2393] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:26.177117 23683 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.008s	sys 0.000s
I20260709 13:06:26.213456 23615 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.197142 23715 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:26.206825 23683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.009s	sys 0.000s
I20260709 13:06:26.190681 23727 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.212352 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:26.226536 22606 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:26.229130 23702 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.231580 23702 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.232715 21941 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:26.222713 23574 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.232535 23720 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.240348 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1487) took 1092 ms. Trace:
I20260709 13:06:26.236390 23702 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:26.244932 21941 rpcz_store.cc:276] 0709 13:06:25.147281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.170877 (+ 23596us) service_pool.cc:224] Handling call
0709 13:06:26.212199 (+1041322us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4deee 0000000000375939 00007f635afc11e0 00007f635b08a0c4 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:26.239842 (+ 27643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19238144}
I20260709 13:06:26.254012 23548 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.254817 23548 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.245141 21868 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.257498 23548 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.259378 23713 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:26.261684 23529 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:26.215273 23704 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.270722 23616 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.271350 23616 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:26.273015 23663 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.236774 23707 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:26.273538 23663 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.274935 21866 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:26.279606 23541 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:26.280085 23541 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.272312 23616 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.280828 23616 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.282061 23675 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.262953 23747 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.290438 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 119) took 1142 ms. Trace:
I20260709 13:06:26.290829 21948 rpcz_store.cc:276] 0709 13:06:25.148139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.148294 (+   155us) service_pool.cc:224] Handling call
0709 13:06:25.377497 (+229203us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:26.290246 (+912749us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540032a854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:26.290367 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477260416}
I20260709 13:06:26.274699 23663 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.296020 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1489) took 1098 ms. Trace:
I20260709 13:06:26.296392 21942 rpcz_store.cc:276] 0709 13:06:25.197267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.197400 (+   133us) service_pool.cc:224] Handling call
0709 13:06:26.295324 (+1097924us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:26.295513 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.295682 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:26.295710 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:26.295754 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:26.295781 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.295840 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.295962 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7340288}
I20260709 13:06:26.295254 23705 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:26.300052 23705 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:26.289889 23704 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.305088 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:26.305083 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:26.305932 21948 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.307057 21947 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:26.308274 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:26.308740 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:26.309298 21946 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.309844 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:26.310384 21949 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.313650 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:26.313868 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.313759 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:26.314778 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:26.316462 21942 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:26.315138 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.316478 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.303023 23759 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.315316 21943 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:26.325471 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.325793 23701 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:26.326123 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.326332 22604 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:26.329128 21945 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:26.327620 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.329995 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.307715 23663 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.326731 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:26.328625 23669 consensus_peers.cc:313] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Unable to generate Tablet Copy request for peer: Not found: Peer not tracked or queue not in leader mode.
I20260709 13:06:26.328657 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.330530 21873 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:26.309031 23625 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.304168 23747 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:26.334558 21914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.859s (SENT) [suppressed 48 similar messages]
I20260709 13:06:26.335768 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:26.335739 21942 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:26.338493 21949 raft_consensus.cc:2410] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:26.340808 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.341388 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.343106 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.343915 22601 raft_consensus.cc:2393] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:26.345322 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.346282 21874 raft_consensus.cc:2410] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:26.347194 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.347810 21874 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:26.348788 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.349308 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:26.349835 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.350054 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.350334 23574 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.308362 23705 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.328713 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.354152 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.355365 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.355574 23757 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:26.356114 21867 raft_consensus.cc:2393] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:26.335147 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.357084 22604 raft_consensus.cc:2410] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:26.358043 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.358839 22021 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:26.358281 21871 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:26.363013 22017 raft_consensus.cc:2410] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:26.363730 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.364506 21873 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:26.319147 23631 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:06:26.349951 22024 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.319396 23529 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:26.365010 22608 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:26.364576 21948 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:26.365299 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.335722 23707 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.387975 21946 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:26.388890 21873 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:26.391733 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:26.395005 23760 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260709 13:06:26.395035 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:26.395668 23750 raft_consensus.cc:993] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:26.396150 23750 raft_consensus.cc:1081] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:06:26.395051 21873 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:26.399569 22024 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:26.400193 21873 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.401124 23759 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.401376 23725 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:26.392794 23574 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:26.401903 23669 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.368742 23727 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:26.407269 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72735.9us
I20260709 13:06:26.390759 23720 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:26.407867 21914 connection.cc:256] RPC call timeout handler was delayed by -1.1088133409999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:06:26.406587 23669 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:26.405359 21873 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.418992 21873 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.406912 23725 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.404982 23723 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.423842 23620 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.417110 23729 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.689s	user 0.002s	sys 0.001s
I20260709 13:06:26.424449 21946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:26.425319 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:26.425634 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:26.427685 21946 raft_consensus.cc:606] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:26.407305 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57086
I20260709 13:06:26.428951 22604 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:26.428834 23620 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.429502 22604 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.430688 23702 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.433387 21870 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.420871 23669 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.435870 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.436058 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:26.422359 23625 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.441339 23714 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.441967 23537 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:26.442395 23537 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:26.442850 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.443480 22021 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.438897 23640 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:26.445807 23708 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:26.446374 23640 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:26.447861 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.448473 22022 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.448839 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:26.434620 23720 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:26.424795 23631 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:26.454882 23548 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.433255 23574 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:06:26.447239 23640 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.457116 23574 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:26.457473 23574 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.458389 23574 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.459962 23574 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:26.420348 23707 consensus_queue.cc:1175] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "51e52b544fab4275aab4f7fbe81942d2" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:26.462138 23631 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:26.443706 23537 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.462527 23631 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.465018 22573 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:26.475227 23750 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.451975 23620 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.486261 22022 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:26.472255 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:26.475131 22021 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
W20260709 13:06:26.476379 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.466598 22020 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:26.478691 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.487944 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.488322 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.488502 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:26.489010 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.489013 21914 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:26.487584 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:26.453202 23708 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:26.491549 21873 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:26.449143 23625 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.493357 21873 pending_rounds.cc:85] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 2
I20260709 13:06:26.494588 21873 pending_rounds.cc:107] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:26.485774 23727 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:26.494874 21873 raft_consensus.cc:2889] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:26.497429 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:26.473884 23609 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.474757 23720 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.495602 23692 raft_consensus.cc:3055] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.504372 23692 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.504873 23720 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:26.505259 23692 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.506587 23692 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.500614 23710 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.500814 21950 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:06:26.485522 23551 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.485947 23726 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:26.493681 23598 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.502260 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:26.502435 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:26.509083 23710 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.491925 23714 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.462146 23644 consensus_queue.cc:1059] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:26.491806 23416 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:26.501706 22020 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:26.492947 23750 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.512084 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:26.512552 23551 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.516366 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:26.503566 22602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.308s	user 0.011s	sys 0.021s
W20260709 13:06:26.526075 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.511737 23621 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:26.533784 23416 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:26.533666 23655 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:26.531795 23561 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.535285 23644 raft_consensus.cc:3055] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.534762 23625 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.535285 23714 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:26.522043 23726 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:26.538468 23686 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.501817 23727 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.525885 23598 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.624974 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:26.625473 23598 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.626221 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.614957 23561 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.548944 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.550137 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.550637 22024 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:26.551155 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.551730 22019 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:26.630062 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.552821 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:26.631708 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78955.7us
I20260709 13:06:26.554176 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.552335 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:26.556128 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.633028 22016 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:26.533666 23652 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:26.605574 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.611657 22610 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:26.555771 22602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.360s	user 0.012s	sys 0.022s
I20260709 13:06:26.616395 22021 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:26.617906 22015 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:26.618040 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.511349 23609 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.635572 22023 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:26.620062 22608 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:26.503870 23631 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.605175 23644 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:26.621961 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.646236 21873 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:26.646551 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.646970 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.628213 21944 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:26.559535 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.554944 23554 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.560182 23651 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:26.620872 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.640285 22023 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.640998 23710 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.654119 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:26.655122 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.655359 22021 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:26.655781 22023 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:26.641227 23451 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.641614 23750 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.615466 23708 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.653837 23766 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:06:26.649884 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.655788 23651 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.555794 23541 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.650498 21839 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:26.637688 22015 pending_rounds.cc:85] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 2
I20260709 13:06:26.673655 22015 pending_rounds.cc:107] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:26.673988 22015 raft_consensus.cc:2889] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:26.658144 22020 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:26.674667 22020 pending_rounds.cc:85] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 5
I20260709 13:06:26.675000 22020 pending_rounds.cc:107] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:26.675287 22020 raft_consensus.cc:2889] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:26.674582 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.637006 23621 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:26.655165 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.633033 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:26.619542 23713 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:26.638547 23652 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.677819 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:26.717558 21947 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:26.719241 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:26.721040 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.721367 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.721686 22610 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:26.722010 23553 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:26.722451 23553 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:26.684278 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51289.9us
I20260709 13:06:26.661146 23677 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:26.725137 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:26.673167 23727 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:26.665233 23631 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:26.727160 21873 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
W20260709 13:06:26.730069 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.733330 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:26.734862 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.775684 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:26.683287 23613 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:26.784008 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 50799.7us
W20260709 13:06:26.780315 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 48290.5us
I20260709 13:06:26.785084 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.785993 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.682353 23621 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:26.723603 23548 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.722891 23553 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.788232 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:26.699913 23541 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.670009 23708 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.688458 23551 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.722946 23556 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:26.809899 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.787195 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 400) took 1779 ms. Trace:
I20260709 13:06:26.835109 22602 rpcz_store.cc:276] 0709 13:06:25.008017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.013596 (+  5579us) service_pool.cc:224] Handling call
0709 13:06:25.120099 (+106503us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4deee 0000000000375939 00007f635afc11e0 00007f635b08a0c4 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:25.120283 (+   184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.139052 (+ 18769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:25.142300 (+  3248us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:25.195125 (+ 52825us) log.cc:844] Serialized 26 byte log entry
0709 13:06:26.423615 (+1228490us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6352f680ac 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b
0709 13:06:26.650037 (+226422us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:26.652433 (+  2396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.661330 (+  8897us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.724832 (+ 63502us) raft_consensus.cc:1685] finished
0709 13:06:26.729438 (+  4606us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.784753 (+ 55315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4665,"raft.queue_time_us":75214,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":16255104,"thread_start_us":1441765,"threads_started":1,"wal-append.queue_time_us":1364490}
I20260709 13:06:26.837366 22604 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.838750 23754 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:26.839790 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 51713.1us
I20260709 13:06:26.841745 23651 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:26.816156 23616 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:26.844782 23551 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:26.846290 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:26.815912 23548 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.847313 23548 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.847625 23686 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:26.848017 23686 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:26.708482 23771 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:26.812873 23621 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.859220 22609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 401) took 1849 ms. Trace:
I20260709 13:06:26.859814 22609 rpcz_store.cc:276] 0709 13:06:25.009610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.010134 (+   524us) service_pool.cc:224] Handling call
0709 13:06:25.135395 (+125261us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:25.135669 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.044259 (+908590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.858929 (+814670us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54006c2854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:26.859144 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098958976}
I20260709 13:06:26.788960 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1421) took 1434 ms. Trace:
I20260709 13:06:26.862036 21872 rpcz_store.cc:276] 0709 13:06:25.354759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.551896 (+197137us) service_pool.cc:224] Handling call
0709 13:06:26.788094 (+1236198us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:26.788282 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.788502 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:26.788540 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:26.788627 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:26.788673 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.788749 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.788892 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13335936}
I20260709 13:06:26.805919 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:26.864085 22017 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:26.780150 23727 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.722048 22606 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:26.655421 23416 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:26.831182 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.775171 23554 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:06:26.689203 23609 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.682773 23714 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.827307 23613 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:26.813253 23683 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.746345 23622 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:26.891727 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.893415 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.894389 21869 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:26.816125 23759 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.832904 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.723819 23713 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.868983 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.870836 21874 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.697757 23676 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 13:06:26.888864 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:26.871805 23465 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:26.775038 23710 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:06:26.737507 23707 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 13:06:26.916962 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.736407 23644 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.897190 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.919621 21872 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:26.885847 22601 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.885278 23712 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:26.891909 23683 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:26.900202 23622 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.849792 23553 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.897667 23616 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:26.942152 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:26.953871 21872 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.909667 23759 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.957180 23713 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.957634 23759 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:26.932811 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 144136us
I20260709 13:06:26.910686 23614 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.960891 23614 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:26.969429 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:26.975189 23713 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.975759 23713 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.976186 23713 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.980919 23652 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:26.982123 23613 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.991708 22018 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:26.996392 23713 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:27.002974 23574 consensus_meta.cc:287] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.003s
I20260709 13:06:26.912168 23686 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.004777 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:27.005188 23686 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.005932 22022 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:27.013056 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:27.013841 22022 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.014190 22022 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:27.015496 23704 consensus_meta.cc:287] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.005s
I20260709 13:06:27.016304 22019 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:27.015630 22022 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.884150 23727 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.948166 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:26.950767 23616 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:26.790417 23726 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:26.939836 23683 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.946390 23622 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.032779 22024 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.029866 23705 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.020434 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:27.037626 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:27.061568 21839 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:27.066431 22017 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:26.943971 22604 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.039143 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:26.929639 23669 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.025748 23708 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.029413 23710 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:27.040257 21867 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:26.942826 23640 consensus_queue.cc:1175] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:06:27.069630 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:27.070003 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.084159 22607 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:27.053118 23644 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:27.071491 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.074334 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:27.075691 21947 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:27.075970 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 55637.7us
I20260709 13:06:27.091053 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:27.082620 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:27.091418 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.939077 23712 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:27.093778 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.104809 22574 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:27.106504 22574 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:27.071223 22602 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:27.111336 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.116166 23712 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.116673 23669 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.073771 23556 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.146818 23556 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.149245 23556 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:27.149315 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.150221 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:27.150692 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.151209 22607 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:27.055411 23548 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.089113 23710 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.117990 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.154831 23710 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.081905 23651 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.155970 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:27.156277 23727 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.111860 23616 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.121204 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:27.157900 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:27.158449 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:27.121536 23702 consensus_queue.cc:1059] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:27.125264 23713 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.125813 23553 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:27.218938 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:27.219903 22021 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:27.126926 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:27.127737 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:27.134845 23747 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:27.135190 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.141722 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1890) took 1006 ms. Trace:
I20260709 13:06:27.225584 21870 rpcz_store.cc:276] 0709 13:06:26.135176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.148062 (+ 12886us) service_pool.cc:224] Handling call
0709 13:06:26.149716 (+  1654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.433772 (+284056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.141415 (+707643us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54001b8854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:27.141644 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651956480}
I20260709 13:06:27.144387 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.108868 23557 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:27.106868 23675 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.005s
I20260709 13:06:27.161479 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:27.235350 23777 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:06:27.239734 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.240634 21945 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:27.240736 21947 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.240774 21943 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:27.152328 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:27.241590 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.169392 22017 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.242056 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:27.242808 21947 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.242866 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.243724 21949 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:27.244112 22018 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:27.244529 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.245167 21949 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
W20260709 13:06:27.177440 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.246554 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.246632 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.091430 23708 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.248941 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:27.252175 21942 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:27.067358 23574 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:06:27.227725 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60615.6us
I20260709 13:06:27.154754 23548 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.224905 23556 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.264250 23556 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.267460 23574 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.268003 23574 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:27.269340 23574 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.242233 21945 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
W20260709 13:06:27.113260 23692 consensus_meta.cc:287] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.005s
I20260709 13:06:27.247953 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.250734 23713 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.271515 23713 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.251583 23704 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.273525 23704 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.252351 23708 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:27.276185 21987 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:27.255949 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.261636 23609 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:27.263317 21942 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.276912 23747 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:06:27.260028 23631 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:06:27.276031 23708 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.278337 23708 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.278229 23747 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.277529 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.284845 21941 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:27.286043 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.286610 23611 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.287685 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.151383 21867 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:27.181173 23676 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.223126 23616 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.252146 23620 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.245639 23541 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:27.356747 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.228250 23779 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:27.288561 23611 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:27.363839 21870 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:27.289487 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:27.291625 21771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 272) took 4886 ms. Trace:
W20260709 13:06:27.373627 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.305783 23676 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.298465 21948 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:27.292312 21772 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 2 to 4, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:27.416580 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.415967 21772 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.407470 21944 raft_consensus.cc:2410] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:27.447789 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.421146 23621 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
I20260709 13:06:27.397161 23611 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:27.452378 23469 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:06:27.397418 21771 rpcz_store.cc:276] 0709 13:06:22.404951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.412459 (+  7508us) service_pool.cc:224] Handling call
0709 13:06:27.291542 (+4879083us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:23.952566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:23.993613 (+ 41047us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:23.993673 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:06:23.993725 (+    52us) tablet.cc:662] Decoding operations
0709 13:06:23.994133 (+   408us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:23.994183 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:23.994207 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:23.997385 (+  3178us) tablet.cc:701] Row locks acquired
0709 13:06:23.997407 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:06:23.997556 (+   149us) write_op.cc:270] Start()
0709 13:06:23.997667 (+   111us) write_op.cc:276] Timestamp: P: 1783602383997512 usec, L: 0
0709 13:06:23.997690 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:24.070602 (+ 72912us) log.cc:844] Serialized 907 byte log entry
0709 13:06:24.881093 (+810491us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800348760. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:25.705869 (+824776us) op_driver.cc:464] REPLICATION: finished
0709 13:06:26.019668 (+313799us) write_op.cc:301] APPLY: starting
0709 13:06:26.025564 (+  5896us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:26.027001 (+  1437us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:26.027027 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:26.047126 (+ 20099us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:26.047304 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:26.047352 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:26.047572 (+   220us) log.cc:844] Serialized 29 byte log entry
0709 13:06:26.047766 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:26.047845 (+    79us) write_op.cc:454] Released schema lock
0709 13:06:26.047891 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:26.048263 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:26.048292 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1231910,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":274327,"apply.run_cpu_time_us":2434,"apply.run_wall_time_us":41465,"num_ops":2,"prepare.queue_time_us":154783,"prepare.run_cpu_time_us":49279,"prepare.run_wall_time_us":403711,"raft.queue_time_us":411867,"raft.run_cpu_time_us":14715,"raft.run_wall_time_us":237747,"replication_time_us":1636623,"spinlock_wait_cycles":31475072,"thread_start_us":477987,"threads_started":4,"wal-append.queue_time_us":292802,"wal-append.run_cpu_time_us":22512,"wal-append.run_wall_time_us":2158552}]]}
I20260709 13:06:27.482925 21870 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:27.462865 21947 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:27.407860 23676 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.423259 21772 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 3, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 3 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.365693 23620 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.366292 23779 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:27.485366 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 378948us
I20260709 13:06:27.419634 21950 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:27.487797 21914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.047s	sys 0.062s
I20260709 13:06:27.470218 23757 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:27.487371 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 395267us
I20260709 13:06:27.493440 21870 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:27.420223 23574 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.478890 23611 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:27.494957 21914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.047s	sys 0.062s
I20260709 13:06:27.476697 23655 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:27.495083 21772 catalog_manager.cc:5697] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 3, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:27.499238 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:27.517943 21947 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.518975 21916 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:27.512331 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 236205us
W20260709 13:06:27.511770 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 736132us
I20260709 13:06:27.371599 23622 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.520651 21772 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:27.477051 23621 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:27.506727 23451 consensus_meta.cc:287] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.000s
I20260709 13:06:27.495774 23779 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:27.528002 21872 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
I20260709 13:06:27.497519 23757 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:27.532140 21872 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:27.534106 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:27.538403 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:27.539295 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:27.541517 21916 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:27.545418 21947 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
W20260709 13:06:27.558926 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.524833 21867 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:06:27.532388 23726 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.538779 23725 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.119s	user 0.008s	sys 0.005s
I20260709 13:06:27.538312 23708 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:27.585999 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55397.3us
I20260709 13:06:27.578207 21867 pending_rounds.cc:85] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 2
W20260709 13:06:27.591694 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 52474.8us
W20260709 13:06:27.591732 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50312.4us
I20260709 13:06:27.587965 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:27.592644 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:27.592573 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:27.584859 23686 consensus_meta.cc:287] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 13:06:27.585345 23780 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:27.578862 23785 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:27.594820 21867 pending_rounds.cc:107] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.3
I20260709 13:06:27.605194 21987 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:27.537091 23757 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.585002 23451 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:06:27.594554 23710 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:27.621863 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:27.626112 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:27.587710 23726 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.611948 21867 raft_consensus.cc:2917] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Aborting config change with OpId 2.3: Aborted: Op aborted by new leader
I20260709 13:06:27.605734 23785 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:27.617925 23686 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:27.610332 23712 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.634351 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:27.590830 23725 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.633054 23640 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:27.641299 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.644111 23786 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:27.634661 23780 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:27.647089 23663 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:27.647675 23663 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:27.631420 23670 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:27.651278 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.634948 23757 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.659198 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:27.659713 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:27.636214 23791 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:06:27.655160 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.655078 22022 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.660573 21870 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:27.656651 22574 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:27.630867 23805 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:27.664431 22574 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:27.638379 23686 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.639962 21867 raft_consensus.cc:2889] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:27.640939 23712 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.657933 23640 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:27.638335 23785 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.693091 23714 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.695487 23686 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.671017 23783 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:27.711228 23797 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:06:27.710865 23788 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:06:27.725790 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 133225us
I20260709 13:06:27.721040 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:27.722110 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:27.724308 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.676512 23670 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:27.724378 22022 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:27.711603 23712 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.711422 23541 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.711323 23699 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:27.714649 23675 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.726400 23683 consensus_meta.cc:287] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 13:06:27.712307 23714 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:27.752104 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 130318us
I20260709 13:06:27.715272 23795 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:27.694964 23756 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:27.726833 23622 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.733129 23621 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.740072 23807 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.740801 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:27.737715 23783 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.775247 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 48061.8us
W20260709 13:06:27.778604 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56552.7us
I20260709 13:06:27.784317 23708 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:27.785585 23779 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.763937 23714 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.711681 23794 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:06:27.743561 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44766 (request call id 9) took 5449 ms. Trace:
I20260709 13:06:27.791793 21916 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:27.755440 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:27.675207 23663 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.844074 23663 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.846829 23779 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.852932 23726 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:27.805341 23804 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:27.786109 21947 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:27.757104 23541 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.854775 23416 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:27.855100 23541 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.855166 23416 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:27.855916 23670 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.856527 23747 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:27.806030 23803 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:06:27.806742 23802 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:06:27.856942 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.763314 23795 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.752221 23451 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:06:27.857591 21873 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:27.857599 23795 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:27.857985 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.858490 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:27.821645 23705 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.004s
I20260709 13:06:27.859109 21873 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:27.796518 23622 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:27.859936 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.808388 23805 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.856968 23747 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:27.860874 23805 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.829596 23614 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:27.798951 23640 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.859954 23622 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.834097 23704 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:27.836802 23548 raft_consensus.cc:993] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:27.863088 23805 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:27.839246 21868 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:27.777388 23799 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:06:27.863698 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:27.839673 23725 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.864976 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.865514 23725 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:27.866053 23809 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:27.789762 23710 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:06:27.790704 23807 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.850061 22608 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:27.800590 23469 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.859613 23705 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.861286 21872 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:27.869204 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:27.759192 23675 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.756804 23699 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.861573 23747 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:27.807775 23644 consensus_meta.cc:287] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.704s	user 0.009s	sys 0.000s
I20260709 13:06:27.817317 21867 rpcz_store.cc:276] 0709 13:06:22.292298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.091280 (+798982us) service_pool.cc:224] Handling call
0709 13:06:23.174706 (+ 83426us) log.cc:844] Serialized 492 byte log entry
0709 13:06:23.747797 (+573091us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b1800036700. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f6355fcbb0b 00007f6356050b63 00007f6356078752 00007f635b038d29
0709 13:06:27.725448 (+3977651us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142917,"raft.queue_time_us":256538,"raft.run_cpu_time_us":2142,"raft.run_wall_time_us":85203,"spinlock_wait_cycles":46548864,"thread_start_us":35011,"threads_started":1,"wal-append.queue_time_us":408742,"wal-append.run_cpu_time_us":2642,"wal-append.run_wall_time_us":1084211}
I20260709 13:06:27.828253 23561 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.847653 23537 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.860540 21873 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
W20260709 13:06:27.870368 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.873565 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 81867us
I20260709 13:06:27.869621 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.861948 23640 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.762665 23683 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.913751 23710 raft_consensus.cc:1081] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:27.914196 23683 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:27.915033 23710 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.877959 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:27.890144 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:27.877332 23780 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:27.892252 23807 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.892915 23541 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:27.894677 23686 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.895529 23574 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.896364 23701 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:27.897380 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.931703 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.898675 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:27.899693 23676 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.798619 23783 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.902148 21869 raft_consensus.cc:3055] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.900897 23705 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.866092 23725 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:27.941735 21947 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:27.910305 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.910832 21870 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:27.918085 23710 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:27.869180 23811 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.877528 21872 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:27.877094 23726 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:27.911571 23640 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.910120 23652 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.938931 23616 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 13:06:27.863629 23622 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:27.919301 23747 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:27.935725 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.933308 21869 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:06:27.939494 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 71143.8us
I20260709 13:06:27.947597 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:27.926519 23780 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:27.929919 22602 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:27.959311 23469 tablet_bootstrap.cc:492] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:06:27.949116 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:27.985174 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:27.902530 23651 consensus_meta.cc:287] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.004s
I20260709 13:06:27.910540 23785 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.951370 22018 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:27.952011 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:27.959959 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49466.5us
I20260709 13:06:27.990108 22024 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:27.911609 23621 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:06:27.983002 21873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b83eb73076f949419556cb7ef3746784"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:36954
I20260709 13:06:27.992761 21873 raft_consensus.cc:606] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:27.993090 21873 raft_consensus.cc:614] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:27.948275 23702 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.984165 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:27.985541 21870 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:27.993884 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:27.909927 23609 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.983879 21869 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.933416 23574 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.939440 23701 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.966740 23720 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.990778 21916 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:28.000881 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:27.966461 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1439) took 1091 ms. Trace:
I20260709 13:06:27.999303 21869 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.978912 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:27.979441 23780 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:27.983831 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.983777 23821 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:27.963163 23652 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:27.998900 23702 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.006299 23712 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.002514 21867 rpcz_store.cc:276] 0709 13:06:26.873391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.411279 (+537888us) service_pool.cc:224] Handling call
0709 13:06:27.488069 (+ 76790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.940863 (+452794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.965148 (+ 24285us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:28.009727 21943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 120) took 1512 ms (client timeout 1948 ms). Trace:
I20260709 13:06:28.010031 21946 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:28.002879 23598 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:28.031603 21943 rpcz_store.cc:269] 0709 13:06:26.496938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.497142 (+   204us) service_pool.cc:224] Handling call
0709 13:06:28.009540 (+1512398us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b540009bad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:28.009668 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707903232}
I20260709 13:06:28.013131 23699 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.979916 23644 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:06:28.021378 21947 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.022145 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:28.022569 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1441) took 1148 ms. Trace:
I20260709 13:06:28.065795 22016 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:28.066188 21942 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.066119 21875 rpcz_store.cc:276] 0709 13:06:26.873872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.011833 (+1137961us) service_pool.cc:224] Handling call
0709 13:06:28.012179 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.012358 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.012385 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.012423 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:28.012453 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.012506 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.022494 (+  9988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:28.066812 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:28.000078 23824 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:27.958482 23726 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:28.026176 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.999800 23541 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:28.027452 21869 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:27.999629 23651 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:28.028811 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 984) took 1491 ms. Trace:
I20260709 13:06:28.001924 23609 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:27.996579 23710 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.028142 23781 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:28.032867 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:28.034173 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:28.090433 22024 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 2: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:28.034669 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:28.092430 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:28.093195 22021 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.035012 22018 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:28.035564 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:28.030507 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:27.958590 23811 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.075109 23699 raft_consensus.cc:2764] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:28.055307 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:28.063827 22023 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:28.064472 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:28.102989 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 65018.2us
I20260709 13:06:28.072201 22016 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:28.001401 23794 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:28.076115 23675 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:27.989495 23611 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.064673 23701 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.079234 22020 rpcz_store.cc:276] 0709 13:06:26.537105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.537263 (+   158us) service_pool.cc:224] Handling call
0709 13:06:26.546900 (+  9637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.675683 (+128783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.906864 (+231181us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540017cad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:28.028654 (+1121790us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b540017cad0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:28.028765 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276468352}
I20260709 13:06:28.084750 23808 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:28.110639 23652 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.110743 23808 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.111207 23818 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.111411 23808 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.107213 23651 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.113121 23651 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.113031 23818 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.113515 23651 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.113611 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.114464 23807 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:28.114854 23807 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:28.115093 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:28.115747 21944 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.115638 23807 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.024227 23725 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.085294 23726 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.085958 23712 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.004578 23720 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.086872 23783 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.102366 23676 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:28.096375 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.064997 23616 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:28.099220 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:28.022814 23469 ts_tablet_manager.cc:1403] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 1.939s	user 0.035s	sys 0.025s
I20260709 13:06:28.098483 21942 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:28.074669 23686 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.027362 23821 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:28.073451 21868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 135) took 1433 ms (client timeout 1569 ms). Trace:
I20260709 13:06:28.027037 23554 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.117612 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.111245 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:28.095996 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:28.133360 22022 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:28.099354 22603 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:28.122704 22023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:28.134498 21872 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.134793 22023 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.127400 22024 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:28.128679 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.100983 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.136693 21943 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:28.116888 23807 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.131673 21869 raft_consensus.cc:2376] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4. Re-sending same reply.
I20260709 13:06:28.141054 23598 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:28.141567 22574 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:28.140308 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:28.076068 23824 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.144168 22021 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:28.118171 23710 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.135265 22023 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:28.126219 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 125425us
I20260709 13:06:28.138098 21916 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:28.142390 23598 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.145280 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.145462 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:28.146081 21875 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 2: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:28.145654 21943 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.147266 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:28.117380 23677 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:28.148017 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.148058 21873 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:28.099601 23781 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.149749 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.156698 21875 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:28.151199 21870 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:28.133598 23554 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.157634 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.158324 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.158950 21870 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:28.160674 21870 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.146776 23712 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.162942 23712 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.165045 23712 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.128717 23705 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.150377 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.166105 21941 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:28.166519 23651 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.166966 23702 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.167311 21941 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:28.148406 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.153916 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:28.151273 23708 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:28.168797 23708 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.169225 23708 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:28.169412 23828 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:28.171411 23821 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.172775 22609 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:28.173190 23781 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.173419 22609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 458) took 1212 ms. Trace:
I20260709 13:06:28.173828 22609 rpcz_store.cc:276] 0709 13:06:26.960930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.961187 (+   257us) service_pool.cc:224] Handling call
0709 13:06:28.172235 (+1211048us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:28.172433 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.173160 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.173363 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166206720}
I20260709 13:06:28.175902 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.162459 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.177173 21875 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.148973 21916 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:28.181800 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.176541 21949 raft_consensus.cc:2376] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3. Re-sending same reply.
I20260709 13:06:28.190361 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:28.191934 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:28.151317 23783 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.132064 23616 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.150668 23655 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:28.225653 21872 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:28.150537 23829 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.151628 23726 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:28.156876 23574 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.161031 23554 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.177279 23613 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.250972 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.165169 23811 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.206079 23651 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:28.254063 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 100191us
I20260709 13:06:28.151348 23598 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.216804 23781 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:28.314167 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:28.243400 23551 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:28.293149 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.254813 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 457) took 1530 ms. Trace:
I20260709 13:06:28.243702 23718 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:28.299080 21949 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:28.299537 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:28.325644 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.326586 21949 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:28.327716 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:28.300485 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 245720us
W20260709 13:06:28.131286 21868 rpcz_store.cc:269] 0709 13:06:26.635935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.637586 (+  1651us) service_pool.cc:224] Handling call
0709 13:06:28.037328 (+1399742us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400317ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:28.069257 (+ 31929us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407200000}
I20260709 13:06:28.307744 21875 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:28.308919 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.309440 23613 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:28.250756 23783 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.310252 23598 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.310774 21869 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:28.253825 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.313252 23416 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.314266 23781 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:28.313290 21871 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.244131 23621 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.365119 23616 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.365306 23621 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.262377 23821 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:28.368927 23621 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.329212 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:28.341213 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:28.297950 23829 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:28.304677 23714 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.371069 23829 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.372689 23714 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.373528 23416 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.374508 22610 raft_consensus.cc:2410] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:28.375672 21949 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.331511 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:28.343108 23720 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.343915 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:28.345141 23613 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.263573 23655 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:28.345650 23783 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.263057 23726 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.352910 23705 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.353998 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:28.362180 23609 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.404451 23705 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.363580 23781 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.406863 23705 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.365890 22602 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:28.369410 23708 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.385749 22607 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:28.355795 23611 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.359006 23699 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:28.383770 23718 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.358546 23553 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:28.332645 22601 rpcz_store.cc:276] 0709 13:06:26.721245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.721365 (+   120us) service_pool.cc:224] Handling call
0709 13:06:26.721654 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:26.930535 (+208881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.248092 (+1317557us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400586954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:28.251474 (+  3382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299757824}
W20260709 13:06:28.412166 23707 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 13:06:28.336309 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.526990 23780 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.364543 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.337270 21838 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:28.331086 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.535244 23713 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.342772 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.538535 21874 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
W20260709 13:06:28.488893 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.362862 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1508) took 1124 ms. Trace:
I20260709 13:06:28.491724 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.543743 21946 rpcz_store.cc:276] 0709 13:06:27.238192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.272665 (+ 34473us) service_pool.cc:224] Handling call
0709 13:06:28.009696 (+737031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.031706 (+ 22010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.362638 (+330932us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b540009bad0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:28.362802 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694353792}
I20260709 13:06:28.545855 21866 raft_consensus.cc:2410] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:28.546422 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:28.362257 21941 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:28.549393 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.549991 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.550415 21941 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
W20260709 13:06:28.501298 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.551414 21871 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:28.551620 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.552767 21866 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:28.502478 21949 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:28.340796 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.411373 22603 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.432024 22609 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.565585 21875 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:28.338380 23551 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:28.566447 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 212449us
I20260709 13:06:28.443797 23663 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.569001 23663 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:28.569892 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.570634 23663 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.571511 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.572201 23663 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.425441 23553 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.434099 23640 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.575088 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:28.446106 23756 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:28.454061 23783 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.575106 23553 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.586141 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.586608 21946 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.587770 23783 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.588653 23756 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:28.589298 23551 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.590889 21947 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:28.440781 23824 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.597460 23551 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.358894 23811 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:28.601625 23811 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.602106 23811 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:28.602319 21875 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:28.602789 23785 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.603475 23811 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.409930 23708 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.604661 22603 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.448910 23655 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:28.607641 23815 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.668s	user 0.003s	sys 0.000s
I20260709 13:06:28.449044 23718 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.450481 23726 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:28.533445 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 196113us
I20260709 13:06:28.533732 23670 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:28.612649 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.614094 21947 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:28.616089 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:28.551633 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.619323 23701 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.619279 23838 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:28.541163 23747 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:28.619997 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:28.555567 23780 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.553618 23588 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:28.621205 23701 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:28.621572 23556 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.621466 23588 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.622982 21941 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:28.616482 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.620994 22603 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:28.518158 23469 raft_consensus.cc:359] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:28.624820 23469 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:06:28.625698 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:28.626672 22607 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 5: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:28.625888 23469 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:28.627027 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.627990 21870 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:28.627903 23554 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.620469 23747 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:28.578984 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.415202 23699 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:28.580510 23700 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.564072 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.572494 21948 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:28.580544 22609 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:28.590260 23756 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:28.453765 23795 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.001s
W20260709 13:06:28.687263 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.430398 23808 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.617825 21866 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.617558 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.493968 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.541167 23829 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:06:28.624190 21869 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:28.577250 23640 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.645298 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.624292 23588 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:28.645943 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 71043.5us
I20260709 13:06:28.674808 21946 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
W20260709 13:06:28.650569 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.644466 22608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 411) took 1991 ms. Trace:
W20260709 13:06:28.648972 21944 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.530s	user 0.003s	sys 0.017s
I20260709 13:06:28.686813 23795 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.597354 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.628566 23469 ts_tablet_manager.cc:1434] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.498s	user 0.005s	sys 0.006s
I20260709 13:06:28.645605 23811 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.630980 23554 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.638228 23620 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.652566 23670 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:28.632740 23700 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:28.635768 23838 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:28.696003 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.632357 23747 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.637465 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:28.706151 21944 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:28.715150 23714 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:06:28.632462 23699 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.706254 21868 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.717216 23699 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:28.717837 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.630281 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:28.705050 22608 rpcz_store.cc:276] 0709 13:06:26.652953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.653085 (+   132us) service_pool.cc:224] Handling call
0709 13:06:26.658114 (+  5029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.849893 (+1191779us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b540051fa20. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fe9dc0 00007f63560741c0 00007f6356075231 00007f6356071d8f 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c
0709 13:06:27.868112 (+ 18219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.643912 (+775800us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540051f754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:28.644245 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754176768}
I20260709 13:06:28.706487 23556 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:28.712178 21874 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:28.697118 23537 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.698071 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 82209.9us
I20260709 13:06:28.703506 23663 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:28.715183 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 78056.4us
I20260709 13:06:28.635900 23701 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.715538 23735 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.739212 21945 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:28.739954 23735 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:28.722548 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.723614 21875 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.724977 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:28.724949 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.726478 22602 raft_consensus.cc:2368] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:28.726279 23537 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.727284 21870 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
W20260709 13:06:28.713209 23469 ts_tablet_manager.cc:1467] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Tablet startup took 583ms
I20260709 13:06:28.727115 23556 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.728492 23548 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:28.728874 21987 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:28.713034 23838 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:28.736847 23663 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.736235 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.746711 21869 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.741406 21874 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.727108 23700 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.749933 23795 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:28.751793 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51503.2us
I20260709 13:06:28.752916 22574 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:28.754485 23554 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:28.754768 23735 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.744634 23548 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:28.759297 21821 auto_rebalancer.cc:629] Failed to schedule move for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0: Aborted: Op aborted by new leader
I20260709 13:06:28.756506 23663 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.773248 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.764864 23782 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.774919 23782 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.775282 23782 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.775995 23556 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.760583 23548 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:28.795760 23548 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.783318 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:28.780864 23838 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.782580 23756 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.779752 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:06:28.787526 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.787881 23554 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.788836 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.791251 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.749938 23537 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:28.792996 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 79598.2us
I20260709 13:06:28.794005 23808 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:28.794064 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:28.785256 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.756016 21868 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:28.792446 23551 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:28.814116 22023 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.565s	user 0.001s	sys 0.017s
W20260709 13:06:28.828058 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 59052.3us
I20260709 13:06:28.826049 21866 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:28.832145 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 46409.5us
I20260709 13:06:28.819288 23795 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:28.836280 23556 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:28.838709 23556 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.839190 23556 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.846114 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.846879 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:28.848507 23655 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:28.848824 21867 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:28.832779 23620 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:28.861147 23620 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:28.855058 23676 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.861884 23620 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.855448 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:28.862071 23676 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.866179 23676 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:28.868320 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:28.830641 23554 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.869220 22605 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:28.870756 23838 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.871416 23554 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:28.872337 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.874269 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:28.876870 21870 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:28.885608 23795 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:28.941871 23795 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:28.943007 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:28.943320 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.943742 22022 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.944284 21943 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:28.848109 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:28.829725 22023 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:28.945204 21872 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:28.946636 21872 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:28.946719 22023 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:28.948304 22021 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.885637 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:28.909046 21772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 160) took 4795 ms. Trace:
I20260709 13:06:28.949460 22019 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:28.914686 21987 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:28.885818 21868 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:28.916896 22605 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:28.918154 23611 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:28.920171 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 86564.3us
W20260709 13:06:28.923731 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 129817us
I20260709 13:06:28.927016 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:28.928288 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:28.929690 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:28.931260 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:28.976994 22024 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.890350 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:28.744163 23469 ts_tablet_manager.cc:1469] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Trace:
0709 13:06:17.055215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.055375 (+   160us) service_pool.cc:224] Handling call
0709 13:06:17.622463 (+567088us) ts_tablet_manager.cc:934] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
0709 13:06:23.696079 (+6073616us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:23.894469 (+198390us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:23.894576 (+   107us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:24.162167 (+267591us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:24.162524 (+   357us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:24.162906 (+   382us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:24.163024 (+   118us) inbound_call.cc:177] Queueing success response
0709 13:06:26.081074 (+1918050us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:28.130960 (+2049886us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:28.402262 (+271302us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:28.512924 (+110662us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":10269,"raft.queue_time_us":1721,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":165,"tablet-copy.queue_time_us":292831,"tablet-download-pool.queue_time_us":158,"tablet-download-pool.run_cpu_time_us":1503,"tablet-download-pool.run_wall_time_us":1489771,"thread_start_us":1031142,"threads_started":2}
I20260709 13:06:28.888437 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:28.942060 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:28.850739 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:28.915424 23537 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.952072 22022 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:28.956219 21875 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:28.959758 21866 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:28.961016 21874 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:28.962106 22018 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:28.954492 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:28.980589 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.981209 21869 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:28.987949 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:28.988852 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 74233.5us
I20260709 13:06:28.979511 21945 raft_consensus.cc:2368] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:28.996204 23677 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:28.993882 22016 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.998513 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:29.000051 23818 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:29.000656 23818 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.002157 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:29.001084 23818 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.003151 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:29.004499 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 116165us
I20260709 13:06:28.984241 22015 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.916522 23620 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.009037 22018 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:29.010268 23620 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:29.015272 21947 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:29.012909 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:29.016220 22574 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:29.017696 22023 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.991634 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:29.017928 22017 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:29.031514 23824 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:29.032397 23824 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.032979 23824 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:29.033066 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 142880us
I20260709 13:06:29.034265 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:29.035276 23747 raft_consensus.cc:2764] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:29.038744 22022 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:29.038640 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.039835 21987 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.039966 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:29.041841 22022 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:29.042125 23677 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:29.044044 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:29.026237 23714 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:06:29.044914 22018 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:29.045621 23714 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:29.045728 23713 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:29.046820 23735 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:29.047263 23735 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.047647 23735 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.047816 23713 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:29.048741 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.050854 22021 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:29.042502 23670 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:29.046095 23714 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:29.062439 23714 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.069032 23714 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.070883 23670 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.071331 23670 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.072337 22015 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:29.072141 23677 consensus_queue.cc:1175] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 5 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:29.023798 23655 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:29.073670 23655 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:29.074237 23655 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.066344 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:29.092499 23676 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:29.093463 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.094352 21916 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.095120 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.096472 23620 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:29.097721 23620 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:29.098111 23620 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.949357 21772 rpcz_store.cc:276] 0709 13:06:24.113772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.113918 (+   146us) service_pool.cc:224] Handling call
0709 13:06:24.434973 (+321055us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdc090 00007f635607af3a 00007f635be311cc 00007f635bf2f37e 00007f635a3f02a4 00007f635a3f0232 00007f635a3f0161 00007f635a3f00dc 00007f635a3ef392 00007f63543ad48c 00007f63543ac8c6
0709 13:06:28.908740 (+4473767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:27.789690 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:27.807951 (+ 18261us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:27.807991 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:06:27.808012 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:27.890819 (+ 82807us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:27.890875 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:27.890903 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:27.891417 (+   514us) tablet.cc:701] Row locks acquired
0709 13:06:27.891437 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:06:27.891577 (+   140us) write_op.cc:270] Start()
0709 13:06:27.891690 (+   113us) write_op.cc:276] Timestamp: P: 1783602387891534 usec, L: 0
0709 13:06:27.891709 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:06:27.892326 (+   617us) log.cc:844] Serialized 2039 byte log entry
0709 13:06:28.083713 (+191387us) op_driver.cc:464] REPLICATION: finished
0709 13:06:28.345358 (+261645us) write_op.cc:301] APPLY: starting
0709 13:06:28.345453 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:28.345627 (+   174us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:28.349475 (+  3848us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:28.389536 (+ 40061us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:28.412127 (+ 22591us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:28.412174 (+    47us) write_op.cc:312] APPLY: finished
0709 13:06:28.412434 (+   260us) log.cc:844] Serialized 47 byte log entry
0709 13:06:28.412618 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:28.414922 (+  2304us) write_op.cc:454] Released schema lock
0709 13:06:28.414972 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:28.442347 (+ 27375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:28.446130 (+  3783us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":274338,"reported_tablets":10,"spinlock_wait_cycles":431528832,"child_traces":[["op",{"apply.queue_time_us":261389,"apply.run_cpu_time_us":10778,"apply.run_wall_time_us":90622,"num_ops":5,"prepare.queue_time_us":157107,"prepare.run_cpu_time_us":11721,"prepare.run_wall_time_us":187744,"raft.queue_time_us":125487,"raft.run_cpu_time_us":53668,"raft.run_wall_time_us":208491,"replication_time_us":191842,"thread_start_us":350990,"threads_started":4,"wal-append.queue_time_us":63267}]]}
I20260709 13:06:29.102955 21943 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:29.105530 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.107453 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:29.098492 23620 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.113936 23554 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:29.114487 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:29.116182 22573 leader_election.cc:400] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:29.116881 23677 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:29.114604 22602 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:29.117547 22573 leader_election.cc:403] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:29.120976 23611 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:29.124830 23784 raft_consensus.cc:2764] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:06:29.124531 23726 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:29.114502 23554 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:29.125919 23718 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:29.126536 23588 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:29.127189 21870 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:29.098692 23808 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:29.089483 23713 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:29.085274 23782 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:29.132131 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 131614us
W20260709 13:06:29.130133 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43792.5us
I20260709 13:06:29.098635 23556 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.134564 23718 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:29.104425 23785 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:29.150003 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.151136 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 154001us
I20260709 13:06:29.127244 23747 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:06:29.168804 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.186408 22024 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:29.192466 22023 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:29.186858 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:29.158722 23718 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:29.202255 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.199397 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.139367 23808 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:29.155777 21768 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.191054 23785 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:29.205479 23537 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:29.217123 23808 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.232280 23556 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:29.210732 23780 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:29.209143 23588 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.239108 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 144059us
W20260709 13:06:29.242331 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100763us
W20260709 13:06:29.244438 21821 auto_rebalancer.cc:629] Failed to schedule move for tablet ca34a4d332f1434f8089d28952415e70: Illegal state: Replica 95296a4420ed41b69191d3d4353cf2b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:29.251142 21768 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 5, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.196719 23554 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.255754 23784 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:29.253485 21768 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 2, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added, no longer has a pending config: VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1), VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2), VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3), NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.241552 23551 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:29.257089 23551 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:29.257736 21987 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.258242 23551 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.247129 23548 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:29.259964 23551 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.263237 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:29.210500 23700 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:06:29.245419 23811 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:06:29.272486 22016 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:29.265262 21768 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 3, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:29.278429 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.242159 23756 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:29.292558 23811 raft_consensus.cc:2764] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:06:29.294853 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.249034 23588 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.305368 21916 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:29.305783 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.269759 23818 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.325452 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:29.334403 21916 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.295832 23548 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:29.335243 21768 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.331264 23556 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:29.286556 23780 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:06:29.283586 23713 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.343510 23548 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.334748 23784 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:06:29.379909 21768 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 4, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.355674 23782 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:29.400579 23750 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:29.402758 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 145216us
I20260709 13:06:29.304840 23785 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.404881 21768 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 5, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:29.392319 23548 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.383050 23677 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:29.392652 23556 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:29.398033 23861 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:29.436647 21821 auto_rebalancer.cc:629] Failed to schedule move for tablet 7dafb6252675441ca7ff8bf9e864644c: Illegal state: Replica 95296a4420ed41b69191d3d4353cf2b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:29.411594 23640 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:29.441812 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 107476us
I20260709 13:06:29.443185 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.413740 23700 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:29.417436 23537 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:29.450579 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:29.457077 23835 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:06:29.461611 23866 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.462482 22602 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:06:29.464186 23855 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:29.465274 23554 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.462253 23866 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.467391 23824 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.468364 23866 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:29.470890 22604 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEARNER]: Advancing to term 4
W20260709 13:06:29.475662 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.440876 23861 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.507025 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:29.507433 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:29.507787 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:29.508672 21944 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.510257 21946 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:29.511168 21948 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:29.474299 23795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.033s	sys 0.038s
W20260709 13:06:29.476426 23857 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:06:29.515189 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 225723us
I20260709 13:06:29.472970 23574 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.475329 23676 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:29.477860 23818 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:29.521922 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 71434.1us
I20260709 13:06:29.542294 23782 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:29.542189 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:29.436972 23735 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:29.522492 23795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.033s	sys 0.040s
I20260709 13:06:29.499146 23861 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.551640 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:29.521667 23783 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:29.558905 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:29.567651 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:29.472514 23670 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.475688 23808 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.563156 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:29.526966 23784 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.480997 23834 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:06:29.528105 23780 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:29.480835 23700 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.473151 23677 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.529706 23556 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.574421 23824 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:29.575551 23537 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.578030 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:29.578287 23655 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
I20260709 13:06:29.546733 23611 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:29.578133 23708 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:29.549780 23701 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:29.549731 23782 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:29.573365 21870 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:29.561729 23416 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:29.546788 23676 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:29.603088 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:29.553030 23640 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:29.566104 23783 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:29.818951 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.572094 23750 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.687974 23873 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.592826 23655 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:29.821413 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 270456us
W20260709 13:06:29.640743 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.782148 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.668969 23866 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:06:29.679486 23708 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.788115 21941 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:29.696519 23611 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.660815 23782 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.551155 23574 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.688308 23588 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:29.604192 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43931.7us
I20260709 13:06:29.606745 21948 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:29.834697 23824 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.834373 23537 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:29.836809 23750 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:29.811946 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 368819us
W20260709 13:06:29.796975 23551 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.005s
W20260709 13:06:29.814430 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 236604us
I20260709 13:06:29.603942 21942 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:29.825176 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:29.838251 23872 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.264s	user 0.003s	sys 0.003s
I20260709 13:06:29.838541 23670 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:29.810710 23548 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.839094 23735 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:29.834939 23873 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:29.599526 23784 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.820778 22605 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.863701 23893 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.796728 23620 consensus_meta.cc:287] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.002s
I20260709 13:06:29.843329 23701 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.881564 23780 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:29.912252 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 87185.8us
I20260709 13:06:29.903431 21916 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:29.899858 23808 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:29.924798 23886 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.925555 23718 consensus_meta.cc:287] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.712s	user 0.005s	sys 0.009s
I20260709 13:06:29.926563 21944 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:29.927529 23548 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:29.922946 23783 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.928118 23881 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.910470 23863 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.240s	user 0.006s	sys 0.003s
I20260709 13:06:29.929388 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:29.929934 23670 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:29.901960 23537 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.904062 23700 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:29.933859 23889 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.148s	user 0.000s	sys 0.004s
W20260709 13:06:29.934149 23880 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.198s	user 0.006s	sys 0.000s
I20260709 13:06:29.936259 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:29.937463 23865 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:29.941411 23655 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:29.941727 23888 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:29.943940 23873 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:29.946586 23611 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:29.948179 23869 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:30.035262 23871 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:06:30.035660 23869 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:30.036092 23869 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.036146 23871 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:30.036588 23871 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:30.037504 23871 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.038661 23871 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:29.917847 23677 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:30.014744 23640 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.040993 23677 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.041440 23677 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.041954 23895 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.042412 23895 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.042761 23895 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.012087 23718 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:29.940340 23861 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.045981 23718 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:29.957926 23750 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.046341 23861 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:29.954689 23784 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:29.960363 21945 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:29.962572 21942 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:29.967047 23838 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:30.049189 23838 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.052028 23838 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:29.958365 23876 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:29.899542 23824 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:29.999845 21987 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:30.011762 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 108464us
I20260709 13:06:29.988663 23883 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.053287 23611 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:30.053393 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.053857 23611 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.053797 23883 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:30.054499 23879 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:06:29.983983 23574 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:29.983820 23620 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.056418 23824 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:29.989907 23416 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:30.057147 23620 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:30.057708 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 121553us
I20260709 13:06:30.056329 23883 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.046065 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 159) took 1024 ms. Trace:
I20260709 13:06:29.984294 23782 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.059525 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:30.058552 21868 rpcz_store.cc:276] 0709 13:06:29.021752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.096933 (+ 75181us) service_pool.cc:224] Handling call
0709 13:06:29.097241 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.097660 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.097695 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.098238 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.427717 (+329479us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:29.427784 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.427905 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.045833 (+617928us) raft_consensus.cc:1685] finished
0709 13:06:30.045862 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.046000 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1900,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":20406,"thread_start_us":329045,"threads_started":1,"wal-append.queue_time_us":399155}
W20260709 13:06:30.053107 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58948us
I20260709 13:06:30.060921 23782 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:30.020440 23808 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:30.054459 23611 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.061762 23808 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:29.923322 23676 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:30.025893 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 96644.6us
I20260709 13:06:30.041574 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:30.061117 23708 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.057862 23620 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:30.062883 23808 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.057981 23416 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.072898 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:30.089587 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.011013 23886 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.068704 23783 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.107777 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.072929 23620 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:30.107770 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.086822 23718 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.023375 23893 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.140358 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:30.026192 23881 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.087952 23548 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:30.087579 23861 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.143543 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:30.162176 21942 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:30.067385 23818 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:30.144449 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:30.145284 21987 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.156821 23878 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:30.158340 23881 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.156867 22605 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:30.163050 23818 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:30.161012 23893 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.164834 21987 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.146698 23620 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.167807 23708 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.173049 23701 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.139319 23784 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.160732 23886 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.167357 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:30.150697 23873 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:30.185343 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45097.9us
I20260709 13:06:30.171890 23869 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:30.180845 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.163465 23866 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:30.145723 23750 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:06:30.182169 23655 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.163090 23861 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.174113 23782 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:30.104413 23780 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.190671 23548 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:30.213891 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.183293 23878 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.196641 23551 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:30.199285 23893 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.199246 23866 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.207304 23861 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.201481 23873 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:30.228611 21945 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:30.241040 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 190281us
I20260709 13:06:30.215054 23870 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:30.194325 23708 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.199084 23655 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.196939 23784 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.229583 23866 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.229667 23782 raft_consensus.cc:697] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:30.213196 23677 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.253264 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:30.235092 23895 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:30.263403 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.256834 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.231427 23811 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.234263 23877 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:30.243762 23551 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:30.243793 23870 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:30.269611 23588 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.270378 23588 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.272874 23588 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:30.229368 23893 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:30.282982 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.291589 23811 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.292373 23708 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.293056 21959 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-d8f404cd14ba4c2687ffe2b7637e1da7 received from {username='slave'} at 127.0.0.1:35490
I20260709 13:06:30.293676 21959 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-d8f404cd14ba4c2687ffe2b7637e1da7 on tablet d8f404cd14ba4c2687ffe2b7637e1da7 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:30.293965 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.295392 23895 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.295679 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:30.296463 21942 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:30.296859 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 49480.6us
I20260709 13:06:30.297673 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:30.298451 23876 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:30.299053 23876 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:30.300062 23876 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:30.302032 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53524.2us
W20260709 13:06:30.300158 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 192337us
I20260709 13:06:30.306960 23655 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.307796 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.310570 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:30.311298 22018 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:30.311678 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:30.312198 22024 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.286669 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:30.262297 23537 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:30.317246 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:30.317992 22018 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:30.300446 23876 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:30.322000 23824 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:30.331334 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.326532 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:30.335958 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:30.336199 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:30.336805 21942 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.293963 23811 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.340651 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.343048 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:30.340143 23747 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:30.344816 22020 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:30.345435 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:30.345173 23747 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.345908 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:30.346040 22609 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:30.346562 22020 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:30.345172 21914 leader_election.cc:400] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:30.250219 23818 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.343410 22021 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:30.353402 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.300150 23782 consensus_queue.cc:237] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.354394 22024 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:30.329332 23640 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:30.326149 23655 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:30.355459 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.359107 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.361192 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.361824 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.361215 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:30.362613 22020 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:30.361786 21866 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.366588 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:30.355449 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:30.367630 23902 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:30.368105 23902 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.368155 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:30.368906 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:30.370769 23551 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.371809 23886 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.372202 23886 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.372529 23886 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.368974 22021 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:30.284543 23877 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.376812 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:30.341732 23574 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.379499 22609 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:30.367551 22015 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.368053 22601 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:30.385279 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:30.363083 23871 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:30.385061 21916 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.407785 21942 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:30.406749 21871 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:30.375794 23818 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.374469 23902 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.415230 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:30.421916 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.422663 21950 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:30.423013 22020 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:30.424552 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.425210 21869 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.329510 23548 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.381021 23824 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:30.434125 21866 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:30.435515 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:30.431329 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:30.360783 23416 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:06:30.414987 21916 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.439517 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.441780 21871 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.408131 23869 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:30.445057 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.458973 21866 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.402776 23574 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.413220 23876 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:30.472113 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57194.1us
I20260709 13:06:30.379916 23655 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.422452 23883 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.475920 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:30.472270 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.492020 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.486567 23881 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.443516 23834 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:30.502180 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:30.495990 23881 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:30.514362 21866 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:30.515558 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.516240 21866 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.360996 23873 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.474606 23708 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:30.525100 21869 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:30.526122 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.385872 23870 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.531280 21866 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:30.493291 23883 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.532570 23883 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.537212 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.538057 21950 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:30.543175 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:30.518541 23834 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.544380 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.551211 21866 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.521447 23677 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:30.567513 23900 consensus_queue.cc:1175] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "51e52b544fab4275aab4f7fbe81942d2" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:06:30.569466 23877 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.552464 21873 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:30.572019 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:30.572997 21873 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:30.573246 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:30.574061 21867 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.574230 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:30.576069 21873 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:30.522174 23708 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:30.557375 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.576885 23909 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:30.577142 21942 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:30.577347 23909 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.577765 23909 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.578030 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.577363 23708 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.579183 23708 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.579545 21942 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:30.528053 23784 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.534122 23876 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.581390 23908 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.560365 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.558843 23870 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.553911 23834 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.640519 21942 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:06:30.641522 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.555102 23747 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.652136 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.654541 21942 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:30.658135 21866 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:30.566634 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:30.585413 23588 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.688189 21942 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:30.690805 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.581972 23908 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.691251 22020 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:30.696449 21942 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:30.689150 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 353010us
I20260709 13:06:30.698378 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:30.690864 23905 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.358s	user 0.000s	sys 0.003s
I20260709 13:06:30.704720 21873 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:30.705899 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.713518 21869 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.689806 23893 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:30.705051 23922 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:06:30.584681 23824 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:30.722311 23903 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:06:30.704483 23901 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:30.732082 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:30.737617 23928 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:06:30.739737 23908 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.778654 21871 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:30.764101 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.787149 21873 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:06:30.810010 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.702478 23588 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.748824 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:30.830938 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:30.835191 21869 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:30.836875 23881 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.751075 23676 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.744493 21867 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:30.735363 23869 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.744778 22015 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:30.856796 23925 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:06:30.744519 23909 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.859417 23574 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.859673 23909 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:30.861685 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 125952us
I20260709 13:06:30.831516 23655 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.835999 23901 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:30.841522 23700 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.850294 23895 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:30.871229 21872 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.520s	user 0.003s	sys 0.004s
I20260709 13:06:30.871605 21872 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:30.876117 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.876885 21944 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:30.876983 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:30.878917 22022 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:30.879218 23878 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.882061 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 437) took 1412 ms. Trace:
I20260709 13:06:30.882514 22604 rpcz_store.cc:276] 0709 13:06:29.470019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.470209 (+   190us) service_pool.cc:224] Handling call
0709 13:06:29.470585 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.926385 (+455800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.926440 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.926994 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:06:30.106337 (+179343us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:30.141202 (+ 34865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.149024 (+  7822us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.865007 (+715983us) raft_consensus.cc:1685] finished
0709 13:06:30.865029 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.881993 (+ 16964us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14431,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":174183,"threads_started":1,"wal-append.queue_time_us":298197}
I20260709 13:06:30.876367 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:30.885697 22023 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.877978 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.841460 23886 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.912209 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.913606 21945 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
W20260709 13:06:30.914705 23934 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
W20260709 13:06:30.895490 23861 consensus_meta.cc:287] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.645s	user 0.003s	sys 0.007s
I20260709 13:06:30.928169 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:30.921232 21916 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:30.899173 23620 consensus_meta.cc:287] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.002s
I20260709 13:06:30.939057 23881 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:30.939512 23881 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.939939 23881 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:30.940543 23886 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.940688 21942 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:30.943367 23877 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.943790 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.943914 23877 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.931164 23750 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.937296 23861 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.911456 23708 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:30.944588 21942 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:30.948944 21949 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:30.950232 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:30.960435 22023 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
W20260709 13:06:30.953562 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 66058.4us
W20260709 13:06:30.955833 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.963356 21916 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:30.954869 23902 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.534s	user 0.004s	sys 0.005s
I20260709 13:06:30.970528 23902 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.971127 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:30.946072 23877 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.945235 23750 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.975025 23750 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:30.953745 23910 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.936866 23780 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:30.976886 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.976478 23910 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:30.978474 23927 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:06:30.955940 23713 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.979483 23713 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:30.953534 21941 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:30.981324 21947 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:30.982508 21947 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:30.953051 23901 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:30.984977 21947 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:30.986178 21947 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:30.982434 21941 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:30.994068 21950 raft_consensus.cc:2368] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:06:30.953969 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:30.997956 22015 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:30.975574 23750 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:31.017846 23750 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:31.018410 23750 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.019305 23878 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.019640 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:31.019881 23878 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.022068 23878 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:31.022598 23878 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:31.023001 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.023330 23878 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:31.024399 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:31.013616 23838 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.014299 23932 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.014860 23937 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.014945 21987 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:31.016984 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.934736 23818 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:31.019474 23655 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.034288 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:31.039230 23713 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:31.039431 22604 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:30.897521 23640 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:06:31.030123 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:30.964206 21945 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:31.033689 23941 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:31.041000 21950 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
W20260709 13:06:31.041321 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.029908 23735 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:31.034195 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:31.034366 23869 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:31.034524 23938 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:31.030181 23895 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:06:31.030351 23877 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.037489 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:30.976336 23780 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.039004 23655 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.027321 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:31.032743 21987 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:30.947289 23861 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:30.894796 23700 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.002813 23588 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:31.040550 23640 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:31.025709 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.074669 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.061334 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:31.056457 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.077562 22024 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:31.048761 23783 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.900s	user 0.002s	sys 0.009s
I20260709 13:06:31.031596 23902 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:30.964640 23620 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:31.048429 23611 consensus_meta.cc:287] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.980s	user 0.011s	sys 0.001s
I20260709 13:06:31.081894 21943 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:31.084019 21948 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:31.050187 23818 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:31.052430 23869 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:31.092976 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.093878 22017 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:31.053510 23574 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.059098 23718 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:31.059520 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.047943 23838 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.073544 23871 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:31.106048 21947 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 1.
I20260709 13:06:31.106423 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.082726 23713 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:31.079305 23640 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:31.030962 23932 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.113271 21946 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:31.117789 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.089075 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.053385 23941 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:31.051625 23881 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:31.128204 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:31.040818 23937 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.107589 23869 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.094883 23908 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.135156 22015 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:31.142061 23780 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:31.142776 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:31.112401 23574 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.109335 23871 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:31.109126 23718 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.122798 23878 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.154634 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.078065 23877 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.083177 23551 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:06:31.168677 22018 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 4. Ops: []
I20260709 13:06:31.171816 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:31.200556 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:31.094242 23611 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.208050 21873 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:31.156427 23876 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.575s	user 0.013s	sys 0.013s
I20260709 13:06:31.174878 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:31.217754 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:31.218087 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:31.187162 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:31.188371 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.219488 21872 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:31.110050 23893 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:06:31.196041 22024 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:31.201732 21875 raft_consensus.cc:2410] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:31.204828 21947 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:31.178427 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.221125 21870 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:31.226636 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:31.127204 23902 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:06:31.172240 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:31.226154 21870 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:31.175267 23898 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:31.233462 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:31.179502 23938 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:31.179733 23871 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.197943 23718 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.237082 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:31.244474 21943 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
W20260709 13:06:31.232769 23808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.039s	sys 0.024s
I20260709 13:06:31.172780 23908 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.223451 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:31.245870 23866 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.983s	user 0.016s	sys 0.002s
W20260709 13:06:31.302913 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 192803us
I20260709 13:06:31.243716 23938 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.242395 23901 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:31.298365 23927 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:06:31.345450 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:31.278844 23588 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:31.396134 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.281913 21867 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:31.281297 23888 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:31.427204 21869 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:31.427367 21873 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.360533 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:31.359496 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:31.279280 23808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.040s	sys 0.024s
W20260709 13:06:31.429744 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 375018us
I20260709 13:06:31.297430 23898 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:31.448555 21866 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.449282 22574 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:31.454967 22024 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 4. Ops: []
I20260709 13:06:31.456144 23901 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:31.457469 23901 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.461401 23898 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:31.463464 23946 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:06:31.461392 23944 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:06:31.439591 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:31.443972 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.418836 23930 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:06:31.467090 21872 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:06:31.473416 23943 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:06:31.474617 23655 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:31.475314 23708 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.475754 23655 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.475857 23708 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.476298 23655 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.462086 22017 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:31.481467 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.483675 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:31.437408 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 243592us
I20260709 13:06:31.488862 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:31.490072 21875 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:31.491680 21875 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:31.494028 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:31.494258 23708 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:31.495198 22601 raft_consensus.cc:2410] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:31.243400 23818 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.354468 23938 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:31.480031 23883 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.005s
I20260709 13:06:31.422724 23588 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:31.487442 21941 raft_consensus.cc:2368] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
W20260709 13:06:31.488783 21838 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.238s (SENT) [suppressed 33 similar messages]
I20260709 13:06:31.289821 23640 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.534361 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:31.535583 22017 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:31.538273 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.550947 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 208473us
I20260709 13:06:31.355221 23866 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.552028 21839 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:31.581219 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 92540.6us
I20260709 13:06:31.516839 23888 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:31.521226 23588 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:31.693601 21866 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:31.527122 23620 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:31.724668 22016 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:31.725858 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:31.644351 22024 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:31.528446 21870 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.579872 23780 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.776914 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.780444 21870 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.429430 23941 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.527774 23883 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:31.751801 23713 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.880218 21949 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:31.901360 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.880862 23676 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.035s	user 0.003s	sys 0.008s
W20260709 13:06:31.953001 23954 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:06:31.954339 23952 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.317s	user 0.000s	sys 0.000s
I20260709 13:06:31.755846 23953 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.170s
W20260709 13:06:31.972124 21987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.018s	sys 0.038s
I20260709 13:06:31.859342 23611 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:31.880884 23574 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:31.810894 23780 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.936842 23937 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:32.123750 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47613.9us
W20260709 13:06:32.126523 23948 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.618s	user 0.000s	sys 0.000s
I20260709 13:06:31.940994 23701 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.962252 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:32.052503 23655 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:32.145475 22576 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.006s	sys 0.010s
W20260709 13:06:32.186666 22576 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.007s	sys 0.011s
W20260709 13:06:32.187063 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 600336us
I20260709 13:06:32.187765 23655 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:31.937281 23713 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:32.180071 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.178273 23701 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:31.876845 23932 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:32.190759 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.190945 21987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.018s	sys 0.039s
W20260709 13:06:32.216558 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 1.14007e+06us
I20260709 13:06:32.158571 21870 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:32.224648 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1961) took 1034 ms. Trace:
W20260709 13:06:32.231560 21838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.018s
W20260709 13:06:32.232204 21838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.012s	sys 0.018s
I20260709 13:06:31.719990 23871 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:32.237593 21839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.007s	sys 0.023s
W20260709 13:06:32.238078 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.007s	sys 0.023s
W20260709 13:06:32.238474 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 686516us
I20260709 13:06:32.239518 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:32.264930 23837 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:32.265744 23837 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.266736 23611 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:32.267148 23611 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.267490 23611 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:32.235523 23945 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.750s	user 0.001s	sys 0.000s
W20260709 13:06:32.275821 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.252029 23950 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.450s	user 0.000s	sys 0.001s
I20260709 13:06:32.252377 23824 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:06:32.253083 23893 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.253669 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.254817 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.258263 23574 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.247253 23877 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:32.260730 23898 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.261008 23866 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:32.261543 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.261878 23676 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:32.262326 23953 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:32.266271 23713 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:32.243168 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 699779us
I20260709 13:06:32.318760 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:32.319768 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:32.251250 23957 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.375s	user 0.000s	sys 0.000s
I20260709 13:06:32.325945 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:32.327877 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:32.243848 23937 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:06:32.329061 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:32.330132 22020 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:32.331172 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.332779 21944 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:32.333889 23611 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.225136 21870 rpcz_store.cc:276] 0709 13:06:31.190438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.191293 (+   855us) service_pool.cc:224] Handling call
0709 13:06:31.220976 (+ 29683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.445869 (+224893us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b4c00068200. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635433ea20 00007f635434fa29 00007f6354315644 00007f635433cf2d 00007f635433cb93 00007f635606d18b 00007f635606dcb5 00007f6356068f30 00007f635606a7de 00007f6356074b49 00007f6356075416
0709 13:06:32.224251 (+778382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.224548 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84338944}
I20260709 13:06:32.211102 23640 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:32.279415 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.292831 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:32.274394 23837 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.210646 23908 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:32.188473 23655 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:32.211453 23838 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.310966 21946 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:32.316803 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.136093 23888 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:32.377350 22575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.009s	sys 0.017s
I20260709 13:06:32.332458 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.379104 22020 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:32.304458 23958 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:32.309113 23574 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.366962 23611 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:32.334434 23869 consensus_meta.cc:287] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.139s	user 0.009s	sys 0.000s
W20260709 13:06:32.378280 22575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.010s	sys 0.018s
W20260709 13:06:32.371708 23901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.004s	sys 0.022s
W20260709 13:06:32.407621 23901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.005s	sys 0.022s
I20260709 13:06:32.380280 23958 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:32.382170 23883 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.406427 23784 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:32.419852 23784 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:32.419934 23971 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:32.310109 23893 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:32.409569 21950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.012s	sys 0.011s
W20260709 13:06:32.425578 21950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.012s	sys 0.012s
W20260709 13:06:32.315059 23795 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.015s
I20260709 13:06:32.411175 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.419126 23932 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:32.459517 22024 raft_consensus.cc:2368] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
W20260709 13:06:32.378638 23870 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.733s	user 0.011s	sys 0.003s
I20260709 13:06:32.394296 23574 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:32.415124 21868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.016s	sys 0.017s
I20260709 13:06:32.380959 23902 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:32.342350 23676 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.472805 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.420507 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:32.483384 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.488448 22024 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:32.413188 23869 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:06:32.474398 23795 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.008s	sys 0.015s
I20260709 13:06:32.317169 23898 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.420801 23838 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:06:32.533430 23898 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.533443 21943 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:32.424686 23655 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:32.484277 21868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.017s	sys 0.017s
I20260709 13:06:32.341069 23953 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:32.553172 21873 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.056s	user 0.007s	sys 0.007s
I20260709 13:06:32.559044 21873 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:32.553514 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.555356 21943 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:32.552279 22024 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:32.570341 22024 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:32.486950 23861 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:32.572435 22022 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:32.573072 22021 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:32.535133 23969 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:32.425051 23960 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.144s
W20260709 13:06:32.544508 23750 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.526s	user 0.005s	sys 0.005s
W20260709 13:06:32.571367 21873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 1970) took 1348 ms (client timeout 1509 ms). Trace:
I20260709 13:06:32.537900 23837 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.577390 23969 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.537678 23700 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.582684 23837 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.583887 23953 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:32.557708 23902 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:32.585095 23902 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.585764 23837 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:32.585825 23969 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.586714 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:32.587134 23959 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:06:32.587380 22021 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.533932 22601 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
W20260709 13:06:32.588521 23968 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:06:32.590579 22024 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:32.593484 23893 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:32.581557 21873 rpcz_store.cc:269] 0709 13:06:31.211105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.291306 (+ 80201us) service_pool.cc:224] Handling call
0709 13:06:32.559691 (+1268385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:32.484547 23932 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.570003 22015 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:32.616926 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.619505 22024 raft_consensus.cc:2368] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:32.607883 23871 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:32.530467 23784 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.601227 23861 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.643481 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.652006 22022 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:32.653066 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.617480 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1956) took 1912 ms. Trace:
W20260709 13:06:32.656215 21841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.000s	sys 0.022s
W20260709 13:06:32.657397 21841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.000s	sys 0.022s
I20260709 13:06:32.605738 23750 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:32.657619 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.639894 23588 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.829s	user 0.006s	sys 0.011s
W20260709 13:06:32.643576 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.567871 23962 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:32.660818 22021 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
W20260709 13:06:32.703398 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.705857 22573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.009s	sys 0.006s
W20260709 13:06:32.706425 22573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.009s	sys 0.006s
W20260709 13:06:32.695503 23834 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 2.021s	user 0.015s	sys 0.000s
I20260709 13:06:32.727299 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.728222 22021 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
W20260709 13:06:32.654577 22576 leader_election.cc:336] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.544s (SENT)
I20260709 13:06:32.693615 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.651131 23966 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:32.698603 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.694427 23877 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:32.653983 23978 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:32.757336 23975 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:06:32.757484 23978 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.759857 23978 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:32.760847 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1986) took 1221 ms. Trace:
I20260709 13:06:32.761251 22018 rpcz_store.cc:276] 0709 13:06:31.539420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.539610 (+   190us) service_pool.cc:224] Handling call
0709 13:06:31.540043 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.629911 (+ 89868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.629954 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.738341 (+108387us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.302759 (+564418us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:32.302842 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.303001 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.760572 (+457571us) raft_consensus.cc:1685] finished
0709 13:06:32.760591 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.760759 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5093,"raft.queue_time_us":28080,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":65488,"thread_start_us":421305,"threads_started":1,"wal-append.queue_time_us":778588}
I20260709 13:06:32.762586 23958 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.763557 22020 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:32.741255 22019 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:32.690493 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 370761us
W20260709 13:06:32.744320 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 46005.8us
W20260709 13:06:32.752141 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.654323 21868 rpcz_store.cc:276] 0709 13:06:30.699694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.726953 (+ 27259us) service_pool.cc:224] Handling call
0709 13:06:30.840920 (+113967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.863860 (+ 22940us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:30.934385 (+ 70525us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.558470 (+1624085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:32.570732 (+ 12262us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:32.572814 (+  2082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.601488 (+ 28674us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.611622 (+ 10134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52052,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":812063,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":1508010,"threads_started":2,"wal-append.queue_time_us":590032}
I20260709 13:06:32.706971 23977 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.756135 23980 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:32.835965 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:32.717522 21841 connection.cc:256] RPC call timeout handler was delayed by -1.059398048999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30820000000000003s for a response
W20260709 13:06:32.765043 23961 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
W20260709 13:06:32.773993 23974 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:06:32.838248 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 183683us
I20260709 13:06:32.848634 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.849707 22018 raft_consensus.cc:2368] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
W20260709 13:06:32.847184 22576 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.710s (SENT)
W20260709 13:06:32.852586 23976 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:06:32.852416 23883 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:32.739909 23588 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.853243 23990 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:32.853801 23990 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.854413 22017 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:32.855103 23588 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.856024 23990 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:32.838941 23977 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.830619 23551 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.856557 23932 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.856887 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:32.876293 21873 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:32.877449 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:32.877864 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:32.878232 21946 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:32.879177 23881 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.879679 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:32.792482 23718 consensus_meta.cc:287] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.494s	user 0.006s	sys 0.003s
I20260709 13:06:32.881726 23718 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.884019 23718 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:32.881021 23640 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.001s
I20260709 13:06:32.864347 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.893405 23783 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.893543 22017 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:32.893994 23783 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.846287 23978 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.861250 21839 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:32.885386 21942 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:32.764051 23958 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:32.787019 23938 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.225s	user 0.010s	sys 0.000s
I20260709 13:06:32.872185 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:32.907501 22024 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.843544 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:32.871817 22021 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:32.867156 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:32.868848 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.851001 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:32.912230 22022 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:32.909308 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 154) took 1722 ms. Trace:
W20260709 13:06:32.913395 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 69925.3us
I20260709 13:06:32.914780 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:32.922660 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 75522.5us
I20260709 13:06:32.775660 23877 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.921769 21945 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:32.860057 23973 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.860302 23977 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:32.927903 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.847144 23869 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:32.912634 21950 rpcz_store.cc:276] 0709 13:06:31.174642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.174764 (+   122us) service_pool.cc:224] Handling call
0709 13:06:31.208304 (+ 33540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.239370 (+ 31066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.239405 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.274449 (+ 35044us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.484926 (+1210477us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:32.484974 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.485052 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.896508 (+411456us) raft_consensus.cc:1685] finished
0709 13:06:32.896535 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.896732 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30715,"raft.queue_time_us":34364,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":23913,"thread_start_us":1002841,"threads_started":1,"wal-append.queue_time_us":1302936}
I20260709 13:06:32.918640 23960 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.865520 22605 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:32.801133 23834 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:32.942562 22576 leader_election.cc:336] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.998s (SENT)
I20260709 13:06:32.959903 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:32.862994 23871 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.937558 23677 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:32.773054 23966 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.963359 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:32.964427 22019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 1962) took 2655 ms (client timeout 1573 ms). Trace:
I20260709 13:06:32.969372 23750 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:32.969874 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.983181 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1981) took 2019 ms. Trace:
I20260709 13:06:32.971412 23818 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:32.907027 23611 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:32.873207 23551 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:32.904518 23870 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:06:32.983760 22023 rpcz_store.cc:276] 0709 13:06:30.963539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.967100 (+  3561us) service_pool.cc:224] Handling call
0709 13:06:30.967542 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.030532 (+ 62990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.030573 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.040344 (+  9771us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.519350 (+479006us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:31.519398 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.519485 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.982887 (+1463402us) raft_consensus.cc:1685] finished
0709 13:06:32.982918 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.983093 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60007,"raft.queue_time_us":60500,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5257,"thread_start_us":478595,"threads_started":1,"wal-append.queue_time_us":1381108}
I20260709 13:06:33.004834 21942 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:32.937217 23718 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.934854 23980 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:32.895673 23978 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:32.962932 22024 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:32.923628 23640 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:32.976579 21874 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:06:32.977567 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 134199us
I20260709 13:06:32.978071 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:33.012830 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.013967 22023 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:32.959547 22603 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 3: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:32.981556 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:32.982813 22019 rpcz_store.cc:269] 0709 13:06:30.309019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.317497 (+  8478us) service_pool.cc:224] Handling call
0709 13:06:32.964214 (+2646717us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54004196d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:32.964332 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4918098176}
I20260709 13:06:33.016350 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:33.018600 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:32.958654 23960 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.975832 23834 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.023195 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:32.986542 22022 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:32.981389 23981 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.028970 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.029960 22018 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:32.922922 23938 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.015569 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.033154 22024 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:33.020960 23960 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:33.035785 21949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 992) took 1939 ms (client timeout 1846 ms). Trace:
I20260709 13:06:32.949951 23973 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.038398 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.039183 22024 raft_consensus.cc:2368] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
W20260709 13:06:33.036374 21949 rpcz_store.cc:269] 0709 13:06:31.089943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.094884 (+  4941us) service_pool.cc:224] Handling call
0709 13:06:33.028982 (+1934098us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54001ac2d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:33.029108 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777058176}
I20260709 13:06:33.011338 23750 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:33.065917 23750 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.066569 23985 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.067269 23985 raft_consensus.cc:697] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:33.074301 23938 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:33.075440 23949 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.895s	user 0.000s	sys 0.014s
I20260709 13:06:32.986923 23677 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:33.077366 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.078037 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.078562 23677 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:33.080461 23818 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.081126 23973 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:33.030632 23883 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.029024 23981 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:33.082538 23981 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:33.084734 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.031240 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:33.085822 22019 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:33.086894 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.031744 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:33.089082 22604 raft_consensus.cc:2368] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:33.027959 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.090047 22023 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:33.090153 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 390) took 1607 ms. Trace:
I20260709 13:06:33.090667 22604 rpcz_store.cc:276] 0709 13:06:31.482897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.483342 (+   445us) service_pool.cc:224] Handling call
0709 13:06:33.089920 (+1606578us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54000b1b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:33.090056 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3689578368}
I20260709 13:06:33.091092 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.092072 22023 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:33.044138 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:33.028558 23997 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:06:33.028019 23620 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:06:32.981141 23871 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.045989 23877 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:33.061952 23701 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.063772 23966 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.065267 23861 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.081970 23883 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:33.092448 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 393) took 1291 ms (client timeout 1689 ms). Trace:
I20260709 13:06:33.058816 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:33.078577 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.088275 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.097502 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:33.119125 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 211058us
I20260709 13:06:33.119813 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.042881 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.102833 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:33.107578 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.028330 23989 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.068356 23750 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.123262 22023 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:33.148537 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:33.149297 22023 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.124846 22024 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:33.122326 22574 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:33.146426 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:33.152146 22018 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:33.157159 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.148252 21987 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:33.159351 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:33.159655 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:33.160624 21869 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:33.163534 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:33.163988 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.163609 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:33.168541 22606 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:33.119482 23883 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.170404 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:33.181665 22019 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:33.171679 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.068280 23985 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.169610 23588 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.147080 23989 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:33.157231 23993 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.192991 23588 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.203028 23960 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.213081 22018 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:33.231833 22023 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:33.081156 23818 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:33.120142 22603 rpcz_store.cc:269] 0709 13:06:31.801424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.811970 (+ 10546us) service_pool.cc:224] Handling call
0709 13:06:33.092227 (+1280257us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54000519d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:33.092385 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1632858496}
I20260709 13:06:33.238601 23588 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:33.313469 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.169963 23611 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:33.322111 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 997) took 2109 ms. Trace:
I20260709 13:06:33.322540 23611 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:33.287554 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:33.324182 21950 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:33.325300 23780 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.325227 23611 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:33.286284 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:33.327046 21949 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:33.307217 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:33.329456 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:33.328155 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:33.328372 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:33.342563 21943 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:33.341454 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:33.322623 22015 rpcz_store.cc:276] 0709 13:06:31.213078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.456261 (+243183us) service_pool.cc:224] Handling call
0709 13:06:31.456665 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.615486 (+1158821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.321846 (+706360us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400332f54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:33.322034 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2559847680}
I20260709 13:06:33.347102 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:33.332142 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:33.332613 23784 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:33.349293 23780 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:33.334338 23818 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:33.312399 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 293881us
I20260709 13:06:33.292611 22019 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:33.353614 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.339020 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1959) took 3031 ms. Trace:
I20260709 13:06:33.354305 22016 rpcz_store.cc:276] 0709 13:06:30.308002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.310873 (+  2871us) service_pool.cc:224] Handling call
0709 13:06:30.328389 (+ 17516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.735530 (+1407141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.338697 (+1603167us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540025eed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:33.338907 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3210468608}
I20260709 13:06:33.355522 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.349445 23960 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.227948 23861 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.357744 23861 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.243883 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:33.350579 23955 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:33.335991 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:33.360173 23955 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:33.360576 23955 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.362947 22019 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:33.364138 22019 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:33.349807 23780 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:33.365320 23861 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.366124 23784 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:33.365983 23780 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.366525 23784 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.366906 23784 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.367234 23780 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.356895 22016 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:33.348628 22015 raft_consensus.cc:2376] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4. Re-sending same reply.
I20260709 13:06:33.370111 21942 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:33.380031 23967 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.382558 23967 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:06:33.383354 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.383219 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:33.383579 23967 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:33.393424 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.393941 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.394335 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.384780 23620 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:33.385205 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:33.286178 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:33.387380 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 55141.6us
I20260709 13:06:33.402660 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:33.404143 21866 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:33.306135 23834 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.376955 23818 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:33.299685 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.421875 21916 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:33.413584 24005 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.412544 23861 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:33.409847 21841 leader_election.cc:336] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.570s (SENT)
I20260709 13:06:33.406809 23990 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.425925 22019 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:33.420912 23967 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.409993 23958 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.207248 23993 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:33.413800 23881 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:33.408834 23677 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:06:33.410370 23877 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:33.407332 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:33.206533 23989 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.410133 23987 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.437879 22024 raft_consensus.cc:2410] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:33.432144 23980 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:33.428289 23978 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:33.431726 23640 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:33.414438 23834 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:33.499863 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.523784 22024 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
W20260709 13:06:33.522454 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 115193us
W20260709 13:06:33.479326 23574 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.992s	user 0.009s	sys 0.005s
W20260709 13:06:33.473016 23994 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:06:33.529171 22024 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:33.527168 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.439237 23898 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.452231 23881 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:33.530864 23881 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.440821 24005 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.534675 24005 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:33.535710 23640 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:33.449370 23990 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.528450 23574 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:33.537190 24004 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:06:33.452433 23958 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:33.538353 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.539053 22018 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:33.460249 23993 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.530249 23834 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:33.598687 23910 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.601934 23910 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:33.602483 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1012) took 1294 ms. Trace:
I20260709 13:06:33.602902 22020 rpcz_store.cc:276] 0709 13:06:32.308585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.530188 (+221603us) service_pool.cc:224] Handling call
0709 13:06:32.763392 (+233204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.798241 (+ 34849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.602277 (+804036us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400236750. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:33.602421 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529886592}
I20260709 13:06:33.537083 23980 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:33.515854 23987 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:33.539949 24009 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.224s
I20260709 13:06:33.949190 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 1999) took 1083 ms. Trace:
W20260709 13:06:33.651342 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.950615 22017 rpcz_store.cc:276] 0709 13:06:32.865937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.894321 (+ 28384us) service_pool.cc:224] Handling call
0709 13:06:32.894660 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.894884 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.894909 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.895344 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.116957 (+221613us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:33.117177 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.117245 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.948948 (+831703us) raft_consensus.cc:1685] finished
0709 13:06:33.948968 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.949122 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":220172,"threads_started":1,"wal-append.queue_time_us":501458}
W20260709 13:06:33.952683 23611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.040s	sys 0.074s
I20260709 13:06:33.605361 21872 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:06:33.683147 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.551767 23898 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:33.954545 23898 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:33.713655 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.711910 23993 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.957713 22019 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:33.959010 23993 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:33.954800 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.959937 23611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.041s	sys 0.074s
I20260709 13:06:33.607060 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:33.552304 23881 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:33.962568 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 453) took 1098 ms. Trace:
I20260709 13:06:33.963096 22601 rpcz_store.cc:276] 0709 13:06:32.863819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.908340 (+ 44521us) service_pool.cc:224] Handling call
0709 13:06:33.606897 (+698557us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:33.962498 (+355601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13041536}
I20260709 13:06:33.604954 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:33.965366 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.965844 22024 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 2.
I20260709 13:06:33.780251 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.968750 22020 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:33.975581 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.582398 23902 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:33.690948 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:33.990531 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.996377 22017 raft_consensus.cc:2368] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
W20260709 13:06:33.948945 24002 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.536s	user 0.000s	sys 0.001s
W20260709 13:06:33.950538 23955 consensus_meta.cc:287] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.590s	user 0.001s	sys 0.009s
I20260709 13:06:34.006531 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:34.007335 22024 raft_consensus.cc:2376] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3. Re-sending same reply.
W20260709 13:06:34.025415 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.604585 23910 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:34.030905 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:34.012483 23981 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.929s	user 0.011s	sys 0.002s
I20260709 13:06:34.033526 22017 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
W20260709 13:06:34.011454 24001 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.581s	user 0.000s	sys 0.001s
W20260709 13:06:34.036296 21916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.017s	sys 0.013s
W20260709 13:06:34.036729 21916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.017s	sys 0.013s
W20260709 13:06:34.037051 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 563623us
I20260709 13:06:34.038520 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:34.029609 23574 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:34.051734 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:33.779301 23588 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:34.006059 23955 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:34.060735 21841 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.010s	sys 0.023s
W20260709 13:06:34.080825 21841 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.010s	sys 0.024s
W20260709 13:06:34.081315 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 640086us
I20260709 13:06:34.091269 21948 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:34.069047 21914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.019s	sys 0.084s
I20260709 13:06:33.960924 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.070881 22573 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:34.052709 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.050315 23993 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:34.069411 23876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.005s	sys 0.017s
I20260709 13:06:34.092912 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:34.131047 21950 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:34.093189 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:34.113595 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.099936 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:34.094893 21914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.019s	sys 0.085s
W20260709 13:06:34.142195 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 616633us
W20260709 13:06:34.100039 21841 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.687s (SENT)
I20260709 13:06:34.143677 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:34.038789 23981 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:34.057252 23932 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.004s	sys 0.005s
W20260709 13:06:34.163388 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 63390.8us
W20260709 13:06:34.164669 24013 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:06:34.166050 21841 leader_election.cc:336] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.737s (SENT)
I20260709 13:06:34.166230 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:34.149792 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.181284 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:34.189808 21841 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.758s (SENT)
I20260709 13:06:34.190653 22019 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:34.148996 21914 leader_election.cc:400] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
W20260709 13:06:34.191713 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 48591.8us
I20260709 13:06:34.193063 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.193266 22017 raft_consensus.cc:2376] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3. Re-sending same reply.
W20260709 13:06:34.217530 24007 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:06:34.224136 21946 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.224136 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:34.178678 21838 connection.cc:256] RPC call timeout handler was delayed by -1.3870641500000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24100000000000002s for a response
I20260709 13:06:34.095335 23551 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:34.241119 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.253568 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:34.097707 24009 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.177524 23932 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.004s	sys 0.005s
I20260709 13:06:34.094398 23677 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.190774 22021 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:34.148950 23958 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:34.160648 23574 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:34.120069 23902 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:34.249504 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.249708 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:34.122015 23993 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:34.253803 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.289893 22019 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:34.130674 23876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.005s	sys 0.018s
I20260709 13:06:34.221551 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1576) took 1320 ms. Trace:
W20260709 13:06:34.290042 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.283020 24009 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:34.287770 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:34.172300 24010 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:06:34.290539 23993 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:34.091630 23938 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.014s	sys 0.043s
I20260709 13:06:34.307279 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:34.304936 23620 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:34.325059 22608 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:34.325237 23620 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.287441 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:34.325773 23620 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.326182 22603 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:34.329408 24018 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:34.290607 23990 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:34.302201 23967 consensus_meta.cc:287] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.829s	user 0.011s	sys 0.000s
I20260709 13:06:34.332394 21946 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:34.323925 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:34.287621 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:34.300808 23987 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:34.332391 23750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.041s	sys 0.085s
W20260709 13:06:34.324813 23938 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.016s	sys 0.045s
I20260709 13:06:34.347012 21987 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:34.297240 23941 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:34.323089 23588 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:34.381415 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:34.383919 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:34.370345 23750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.042s	sys 0.086s
I20260709 13:06:34.298175 23902 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:34.415902 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.419226 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.397162 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:34.397086 23551 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:34.445317 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:34.446424 21869 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:34.420075 23883 consensus_meta.cc:287] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.191s	user 0.009s	sys 0.003s
I20260709 13:06:34.403860 23981 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:34.415421 23932 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:34.413765 23611 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:34.469765 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 189) took 1307 ms. Trace:
I20260709 13:06:34.472904 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:34.419205 23876 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:34.474679 21872 rpcz_store.cc:276] 0709 13:06:33.162365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.170086 (+  7721us) service_pool.cc:224] Handling call
0709 13:06:34.467978 (+1297892us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b540022bd54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:34.469704 (+  1726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973957504}
I20260709 13:06:34.486740 22608 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:34.297322 21941 rpcz_store.cc:276] 0709 13:06:32.875389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.875589 (+   200us) service_pool.cc:224] Handling call
0709 13:06:32.875941 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.876351 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.876380 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.876973 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.121859 (+244886us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:33.145608 (+ 23749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.161785 (+ 16177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.150556 (+988771us) raft_consensus.cc:1685] finished
0709 13:06:34.162329 (+ 11773us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.195321 (+ 32992us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3535,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":163181,"threads_started":1,"wal-append.queue_time_us":536972}
I20260709 13:06:34.476460 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:34.499737 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 399858us
W20260709 13:06:34.501313 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.467716 21944 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:34.508940 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:34.509196 21838 connection.cc:256] RPC call timeout handler was delayed by -1.3308204869999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 13:06:34.509756 21870 raft_consensus.cc:2368] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
W20260709 13:06:34.510763 21838 leader_election.cc:336] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.570s (SENT)
I20260709 13:06:34.511297 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:34.518972 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 269322us
W20260709 13:06:34.525127 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 226513us
I20260709 13:06:34.488013 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:34.501576 23932 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:34.483600 23551 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:34.503914 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:34.470651 23883 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:34.572896 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51466.1us
W20260709 13:06:34.574081 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.566592 23989 consensus_meta.cc:287] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.022s	user 0.013s	sys 0.000s
I20260709 13:06:34.527241 23611 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:34.583431 23551 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:34.578166 24022 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:06:34.530566 23574 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.505052 23876 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:34.573264 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:34.668569 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:34.670594 21869 raft_consensus.cc:2368] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
W20260709 13:06:34.628160 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 219628us
W20260709 13:06:34.651011 21841 leader_election.cc:336] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.805s (SENT)
W20260709 13:06:34.674469 21841 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.912s (SENT)
W20260709 13:06:34.675793 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.582327 22604 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:34.684192 21838 leader_election.cc:336] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.737s (SENT)
W20260709 13:06:34.646922 23780 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.279s	user 0.011s	sys 0.001s
I20260709 13:06:34.617699 23989 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:34.686115 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.773676 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:34.864179 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:34.779109 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:34.865520 21871 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:34.646157 22605 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:06:34.649689 24021 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
W20260709 13:06:34.639810 24019 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
W20260709 13:06:34.640239 24016 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:06:34.868235 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.868360 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:34.869493 21871 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:06:34.639357 24027 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:06:34.839462 24028 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
W20260709 13:06:34.638173 24020 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:06:34.864650 21869 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.776378 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:34.634832 23784 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.267s	user 0.011s	sys 0.007s
I20260709 13:06:34.649351 23902 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:34.868911 22021 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
W20260709 13:06:34.825358 24032 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:06:34.877774 23876 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:34.877727 23784 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:34.839610 23676 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:34.645759 24029 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:06:34.871073 21949 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:34.881706 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:34.766052 22574 leader_election.cc:400] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:34.638711 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:34.814670 21868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.006s
W20260709 13:06:34.825425 24033 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:06:34.872941 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.874519 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:34.637631 24034 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:34.768050 24037 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.869957 21841 leader_election.cc:336] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.992s (SENT)
I20260709 13:06:34.790715 23883 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:34.903616 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 219455us
W20260709 13:06:34.885236 21868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.008s
I20260709 13:06:34.883577 22574 leader_election.cc:403] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:06:34.915853 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 149925us
I20260709 13:06:34.759531 22601 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:34.884306 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:34.919189 21871 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.877866 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:34.893940 23620 consensus_meta.cc:287] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.001s
I20260709 13:06:34.895117 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:34.899014 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 158) took 1815 ms. Trace:
I20260709 13:06:34.925935 22023 rpcz_store.cc:276] 0709 13:06:33.083762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.320438 (+236676us) service_pool.cc:224] Handling call
0709 13:06:33.320796 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.321188 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.321216 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.321724 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.779601 (+457877us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:33.779639 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.779720 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.898768 (+1119048us) raft_consensus.cc:1685] finished
0709 13:06:34.898795 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.898950 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4714,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":457444,"threads_started":1,"wal-append.queue_time_us":963717}
I20260709 13:06:34.901264 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.903270 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:34.928655 22021 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.883167 21875 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:34.906628 21947 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:34.789737 23611 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:34.910907 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:34.912585 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 167) took 1519 ms. Trace:
W20260709 13:06:34.914589 21841 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.993s (SENT)
I20260709 13:06:34.916143 21950 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:34.952472 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2000) took 1619 ms. Trace:
I20260709 13:06:34.882176 23958 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:34.900794 21867 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:34.965481 21867 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:34.965562 23784 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:34.966747 21867 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:34.967093 21867 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:34.967841 21867 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:34.931905 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:34.933010 22020 raft_consensus.cc:2368] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:34.935243 21871 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:34.936784 21869 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:34.925923 23620 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:34.926019 23888 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:34.933269 24036 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:34.815209 23932 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:34.942701 22018 rpcz_store.cc:276] 0709 13:06:33.392844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.426759 (+ 33915us) service_pool.cc:224] Handling call
0709 13:06:33.427085 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.590561 (+163476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.912365 (+1321804us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001f13d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:34.912528 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256483712}
I20260709 13:06:34.983652 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:34.952081 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.915979 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 226957us
I20260709 13:06:34.953017 22016 rpcz_store.cc:276] 0709 13:06:33.332927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.370409 (+ 37482us) service_pool.cc:224] Handling call
0709 13:06:33.374089 (+  3680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.375318 (+  1229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.375391 (+    73us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.376536 (+  1145us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.750793 (+374257us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:33.750850 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.750943 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.952265 (+1201322us) raft_consensus.cc:1685] finished
0709 13:06:34.952284 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.952411 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":373540,"threads_started":1,"wal-append.queue_time_us":804720}
W20260709 13:06:34.961453 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 56966.3us
I20260709 13:06:34.961722 22603 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.963421 23881 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:34.963521 23993 consensus_meta.cc:287] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 13:06:34.969092 23989 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:34.968796 22604 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
W20260709 13:06:34.970418 22576 connection.cc:256] RPC call timeout handler was delayed by -1.9353253730000688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2554s for a response
I20260709 13:06:34.970544 21945 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:34.970611 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.998726 22024 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:34.758774 24039 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.208s
I20260709 13:06:34.976228 22574 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:34.981086 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:34.981437 22021 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
W20260709 13:06:34.984920 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.986974 22018 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:34.990670 21875 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:35.003203 21875 pending_rounds.cc:85] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 1
I20260709 13:06:34.917446 24037 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:34.971467 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 182) took 1959 ms. Trace:
I20260709 13:06:35.005353 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.005978 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.006498 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.006696 22018 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:35.007059 21866 raft_consensus.cc:2376] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5. Re-sending same reply.
I20260709 13:06:35.007565 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.008117 22018 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:35.008154 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.009034 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.009730 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:35.003522 21875 pending_rounds.cc:107] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:35.024328 21875 raft_consensus.cc:2889] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:35.025830 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.026767 21875 raft_consensus.cc:2368] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3.
I20260709 13:06:35.028676 22021 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:35.029544 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.034842 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.035434 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.035964 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:35.036476 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:34.982811 23888 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:34.993606 21867 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.037475 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:35.045094 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 48915.5us
I20260709 13:06:35.038296 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.045575 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.040827 21988 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:35.042150 21875 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:06:35.045625 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.043210 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.047541 22018 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:35.047541 22021 raft_consensus.cc:2376] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6. Re-sending same reply.
I20260709 13:06:35.048949 22021 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:34.996728 23677 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:35.063503 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.064222 21875 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:35.065173 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.067847 22020 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:35.045619 22576 connection.cc:256] RPC call timeout handler was delayed by -1.5088307720000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2758s for a response
W20260709 13:06:35.010145 24024 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.008s	sys 0.015s
I20260709 13:06:35.059996 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:35.060621 24045 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:35.061060 23888 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:34.997267 24036 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:35.062445 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.069717 22017 raft_consensus.cc:2376] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5. Re-sending same reply.
W20260709 13:06:35.070188 22576 connection.cc:256] RPC call timeout handler was delayed by -1.3917642769999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2836s for a response
I20260709 13:06:35.039067 24026 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:35.075325 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.079613 22024 raft_consensus.cc:2376] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5. Re-sending same reply.
I20260709 13:06:35.084535 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:35.086910 22020 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.114497 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.115430 21875 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.998903 23993 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:35.073174 24024 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.008s	sys 0.015s
W20260709 13:06:35.134393 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.147100 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.129925 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 58871.9us
I20260709 13:06:35.144132 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:35.149034 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:35.164462 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.149083 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.218876 22022 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:35.219281 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.219519 22020 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:35.219913 21871 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:35.219419 22022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1040) took 2202 ms (client timeout 1832 ms). Trace:
I20260709 13:06:35.062460 24037 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:35.221304 22022 rpcz_store.cc:269] 0709 13:06:33.017290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.025244 (+  7954us) service_pool.cc:224] Handling call
0709 13:06:35.148645 (+2123401us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b5800200498. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:35.219349 (+ 70704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20056448}
I20260709 13:06:35.111227 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2001) took 1778 ms. Trace:
I20260709 13:06:35.228330 21875 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
W20260709 13:06:35.235883 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 87267.5us
I20260709 13:06:35.301594 23955 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:35.307540 24041 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.474s	user 0.000s	sys 0.001s
I20260709 13:06:35.309006 21945 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:35.217680 23888 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.319032 21988 leader_election.cc:400] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
I20260709 13:06:35.319547 21988 leader_election.cc:403] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.144333 23883 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.150s
W20260709 13:06:35.325614 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 182184us
W20260709 13:06:35.334211 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 259417us
W20260709 13:06:35.375092 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.234903 23551 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:35.424942 24039 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:35.425997 24052 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.296105 24037 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:35.456765 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 219800us
I20260709 13:06:35.471045 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.023979 21868 rpcz_store.cc:276] 0709 13:06:33.011932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.015235 (+  3303us) service_pool.cc:224] Handling call
0709 13:06:33.111952 (+ 96717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.158679 (+ 46727us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:33.758192 (+599513us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.920120 (+1161928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.921737 (+  1617us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:34.926040 (+  4303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.933738 (+  7698us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.954911 (+ 21173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1046589,"raft.queue_time_us":105355,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5456,"spinlock_wait_cycles":41593728,"thread_start_us":1562221,"threads_started":3,"wal-append.queue_time_us":651852}
I20260709 13:06:35.433234 21945 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.149868 24030 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 13:06:35.144198 24010 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.151s
I20260709 13:06:35.475916 24031 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:35.455894 21871 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:35.494189 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:35.518419 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.518642 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.520444 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.525354 24026 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:35.525974 23551 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.526824 23551 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:35.527204 24026 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:35.530512 23551 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:35.480325 24039 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:35.539304 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.561069 21871 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:35.565284 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:35.566234 22016 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.566823 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.454056 23958 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:06:35.567924 21871 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:35.492264 23955 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.557718 23883 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:35.575850 24065 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:06:35.532219 23620 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:35.483667 22603 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:35.466120 24037 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:35.480679 23938 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 13:06:35.613200 21870 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.017s	sys 0.011s
I20260709 13:06:35.559382 24039 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:06:35.640182 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 119835us
I20260709 13:06:35.641811 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:35.598464 24068 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.625866 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 458) took 1188 ms. Trace:
I20260709 13:06:35.582538 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.659207 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.660060 21871 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.597087 23883 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:35.667820 22016 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:35.643960 23993 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:35.684016 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.691686 21870 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:06:35.692744 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 264452us
I20260709 13:06:35.649646 24068 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.645996 24073 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:35.701412 21838 leader_election.cc:336] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.589s (SENT)
W20260709 13:06:35.704752 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.705600 21841 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:35.682247 24031 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.682837 23551 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.683983 24081 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:35.714395 21871 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:35.628906 24039 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:35.715663 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:35.720547 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 78843.1us
I20260709 13:06:35.721259 21870 raft_consensus.cc:2410] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:35.682447 24084 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:35.702024 23910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.010s	sys 0.010s
I20260709 13:06:35.715302 21841 leader_election.cc:400] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:35.729530 21841 leader_election.cc:403] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.711838 24070 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.722954 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:35.704289 24068 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:35.717144 21867 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.668s	user 0.015s	sys 0.001s
I20260709 13:06:35.719400 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.770552 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.770938 21871 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.657518 22603 rpcz_store.cc:276] 0709 13:06:34.437832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.442552 (+  4720us) service_pool.cc:224] Handling call
0709 13:06:34.910741 (+468189us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:35.616375 (+705634us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4107520}
W20260709 13:06:35.729555 23910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.011s	sys 0.011s
I20260709 13:06:35.768185 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.773343 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.773522 22016 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:35.774063 22022 raft_consensus.cc:2368] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
W20260709 13:06:35.768383 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 45531.6us
I20260709 13:06:35.768913 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.713788 24053 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.718269 24081 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:35.771749 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.719872 24031 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:35.781242 22024 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:35.781454 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:35.783038 22610 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:35.783373 22016 raft_consensus.cc:2368] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:35.781616 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.782147 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.770076 24073 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.785283 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.788312 21870 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:35.231535 22015 rpcz_store.cc:276] 0709 13:06:33.333204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.372870 (+ 39666us) service_pool.cc:224] Handling call
0709 13:06:34.899264 (+1526394us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b5800200498. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:34.899474 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.899702 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:34.900030 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.023823 (+123793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:35.038584 (+ 14761us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:35.044985 (+  6401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.065379 (+ 20394us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.078874 (+ 13495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4653,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":9038,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10792,"spinlock_wait_cycles":20014336,"thread_start_us":82161,"threads_started":1,"wal-append.queue_time_us":132539}
I20260709 13:06:35.727903 23551 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:35.771682 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.777665 24039 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.785988 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.777549 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.795554 21871 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:35.778816 24070 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:35.800525 24070 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:35.801821 24070 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.802337 24070 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:35.802837 24070 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.807753 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.810765 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.811924 22601 raft_consensus.cc:2368] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5.
I20260709 13:06:35.812131 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:35.786127 23938 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:35.817802 21870 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:35.820436 21871 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.826670 22609 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:35.827762 23990 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:35.828037 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1990) took 1015 ms. Trace:
I20260709 13:06:35.828493 21875 rpcz_store.cc:276] 0709 13:06:34.812626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.292509 (+479883us) service_pool.cc:224] Handling call
0709 13:06:35.293000 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.296537 (+  3537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.296582 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.315381 (+ 18799us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.704588 (+389207us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:35.719001 (+ 14413us) log.cc:844] Serialized 14 byte log entry
0709 13:06:35.784562 (+ 65561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.784656 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.827829 (+ 43173us) raft_consensus.cc:1685] finished
0709 13:06:35.827849 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.827979 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3037,"prepare.queue_time_us":21518,"prepare.run_cpu_time_us":194,"prepare.run_wall_time_us":1363,"raft.queue_time_us":111568,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":14013,"thread_start_us":302347,"threads_started":2,"wal-append.queue_time_us":393519}
I20260709 13:06:35.830489 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.830734 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1588) took 1429 ms. Trace:
I20260709 13:06:35.831636 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:35.833258 24072 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:06:35.833514 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.827819 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:35.836037 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1989) took 1023 ms. Trace:
I20260709 13:06:35.845822 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1991) took 1032 ms. Trace:
I20260709 13:06:35.846316 21875 rpcz_store.cc:276] 0709 13:06:34.812958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.834408 (+1021450us) service_pool.cc:224] Handling call
0709 13:06:35.834666 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.844354 (+  9688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.844391 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:35.844453 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:35.844498 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.844562 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.845752 (+  1190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:35.836530 21866 rpcz_store.cc:276] 0709 13:06:34.812206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.065473 (+253267us) service_pool.cc:224] Handling call
0709 13:06:35.065809 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:35.066025 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.066054 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:35.109923 (+ 43869us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.446093 (+336170us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:35.447522 (+  1429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.447629 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.835808 (+388179us) raft_consensus.cc:1685] finished
0709 13:06:35.835825 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.835965 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":220692,"threads_started":1,"wal-append.queue_time_us":389223}
I20260709 13:06:35.851377 21875 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:35.828056 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.796064 24085 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.857221 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.853006 22607 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:35.854974 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.779984 24053 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:35.856194 23883 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:35.848645 24081 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:35.819268 23611 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
I20260709 13:06:35.856771 22602 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:35.874732 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.842661 24037 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:35.789285 24076 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:06:35.875656 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 105202us
W20260709 13:06:35.877094 21838 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.758s (SENT)
I20260709 13:06:35.880028 21838 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.881273 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:35.884155 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.885972 22576 leader_election.cc:400] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:35.886816 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:35.831193 21941 rpcz_store.cc:276] 0709 13:06:34.401530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.938112 (+536582us) service_pool.cc:224] Handling call
0709 13:06:35.830052 (+891940us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4deee 0000000000375939 00007f635afc11e0 00007f635b08a0c4 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:35.830201 (+   149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.830386 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:35.830414 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:35.830455 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:35.830494 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.830554 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.830678 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38190336}
I20260709 13:06:35.889387 22576 leader_election.cc:400] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 2 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3.
I20260709 13:06:35.890226 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.891057 21871 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:35.891237 24030 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.892342 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:35.860437 24085 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:35.892989 21838 leader_election.cc:336] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.772s (SENT)
I20260709 13:06:35.880851 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.897744 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:35.898839 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 189701us
I20260709 13:06:35.904181 21871 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.904400 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:35.908552 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:35.908737 23990 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.909611 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:35.904968 21838 leader_election.cc:336] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.789s (SENT)
I20260709 13:06:35.909816 23990 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.911244 23990 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.912176 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:35.913934 24100 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:35.915126 23908 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 13:06:35.915946 21838 leader_election.cc:336] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.805s (SENT)
I20260709 13:06:35.916549 21838 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.913934 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.923884 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1978) took 1152 ms. Trace:
I20260709 13:06:35.887739 24081 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.887679 24037 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:35.935827 21988 leader_election.cc:336] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.655s (SENT)
I20260709 13:06:35.896126 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:35.927546 24078 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:06:35.939678 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:35.928723 24088 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:06:35.899344 24085 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.929276 23910 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:35.964033 24100 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:06:35.964778 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50920.8us
I20260709 13:06:35.966522 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:35.967146 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:35.967903 21988 leader_election.cc:400] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5.
I20260709 13:06:35.968341 21988 leader_election.cc:403] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.970593 21871 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:35.971932 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.972958 21871 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:35.938400 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:35.881723 24031 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:35.982702 24087 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:35.982852 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.983263 24087 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.983716 24087 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.984272 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.973608 23910 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:35.986804 23910 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:35.987427 23910 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5.
I20260709 13:06:35.927541 21867 rpcz_store.cc:276] 0709 13:06:34.770958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.966355 (+195397us) service_pool.cc:224] Handling call
0709 13:06:34.966640 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.914681 (+948041us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:06:35.914725 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:35.914793 (+    68us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:35.914842 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.923531 (+  8689us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.923798 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3243,"raft.queue_time_us":48834,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6923,"thread_start_us":126769,"threads_started":1}
I20260709 13:06:35.989614 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:35.989878 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:35.991325 21867 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:35.991638 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1585) took 1613 ms. Trace:
I20260709 13:06:35.966588 24037 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:35.996459 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 80557.6us
I20260709 13:06:35.976226 24076 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.977319 23551 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:35.979621 24067 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:06:35.992115 21943 rpcz_store.cc:276] 0709 13:06:34.378426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.378601 (+   175us) service_pool.cc:224] Handling call
0709 13:06:34.378985 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.449688 (+ 70703us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:34.675819 (+226131us) log.cc:844] Serialized 14 byte log entry
0709 13:06:34.871698 (+195879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.871928 (+   230us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:34.872111 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.991350 (+1119239us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b5400279cd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:35.991412 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.991572 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5,"prepare.queue_time_us":407587,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":1038,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5614,"spinlock_wait_cycles":184490112,"thread_start_us":386430,"threads_started":2,"wal-append.queue_time_us":245782}
W20260709 13:06:36.016068 21838 leader_election.cc:336] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.846s (SENT)
I20260709 13:06:36.033569 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:36.035511 21838 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.912s (SENT)
I20260709 13:06:36.035601 22020 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:36.035913 21867 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:36.035929 21838 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:36.022076 24101 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.022353 24103 raft_consensus.cc:1064] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:06:36.022802 24093 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.024091 24097 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.053428 24097 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:36.022385 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 55284.6us
I20260709 13:06:36.054524 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:36.017699 24030 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:36.055476 24058 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.075s	user 0.000s	sys 0.002s
I20260709 13:06:36.055910 23955 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.057345 24097 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.018455 24076 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:36.050822 24093 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:36.082907 21870 raft_consensus.cc:2410] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:36.058513 24086 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:06:36.053778 21874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 174) took 5649 ms (client timeout 1759 ms). Trace:
I20260709 13:06:36.060423 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.050246 23988 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.056587 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1587) took 1668 ms. Trace:
I20260709 13:06:36.093775 21949 rpcz_store.cc:276] 0709 13:06:34.387872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.412633 (+ 24761us) service_pool.cc:224] Handling call
0709 13:06:34.440043 (+ 27410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.900475 (+460432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.056344 (+1155869us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400140ad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:36.056525 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990829440}
W20260709 13:06:36.084591 21874 rpcz_store.cc:269] 0709 13:06:30.404435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.474435 (+ 70000us) service_pool.cc:224] Handling call
0709 13:06:36.053529 (+5579094us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b540044eb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:36.053678 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5677541120}
I20260709 13:06:35.975806 24089 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:06:36.116659 24106 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:06:36.047596 24037 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.117377 24053 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:36.132472 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.133612 21874 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:36.082633 24076 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.157404 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:36.097874 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.165906 21875 raft_consensus.cc:2376] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6. Re-sending same reply.
W20260709 13:06:36.154431 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 118944us
I20260709 13:06:36.182940 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 1985) took 1372 ms. Trace:
W20260709 13:06:36.153775 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 99323.9us
I20260709 13:06:36.185009 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:36.180835 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.185864 21871 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:36.183494 21869 rpcz_store.cc:276] 0709 13:06:34.810822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.978839 (+168017us) service_pool.cc:224] Handling call
0709 13:06:34.979157 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.979478 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.979504 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.994619 (+ 15115us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.233916 (+239297us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:35.233971 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.234039 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.182714 (+948675us) raft_consensus.cc:1685] finished
0709 13:06:36.182735 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.182876 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":420,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10490,"thread_start_us":189399,"threads_started":1,"wal-append.queue_time_us":486165}
I20260709 13:06:36.188254 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:36.189188 21838 leader_election.cc:336] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.992s (SENT)
I20260709 13:06:36.189365 21869 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:36.189656 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:36.096918 24100 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:36.191458 21988 leader_election.cc:336] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.912s (SENT)
I20260709 13:06:36.196961 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:36.197098 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.197713 21869 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:36.198550 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.199542 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.200335 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.191887 23973 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.204735 21768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 250) took 9281 ms. Trace:
I20260709 13:06:36.191056 24102 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:36.207047 21838 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.993s (SENT)
I20260709 13:06:36.207273 21869 raft_consensus.cc:2410] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:36.207777 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:36.208662 22609 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:36.205891 24102 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:36.215022 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.223601 23783 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:36.205274 21768 rpcz_store.cc:276] 0709 13:06:26.910409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.927270 (+ 16861us) service_pool.cc:224] Handling call
0709 13:06:36.191259 (+9263989us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:30.300784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:30.301433 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:30.301486 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:06:30.301505 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:30.307576 (+  6071us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:30.307665 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:30.307701 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:06:30.308453 (+   752us) tablet.cc:701] Row locks acquired
0709 13:06:30.308511 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:06:30.308710 (+   199us) write_op.cc:270] Start()
0709 13:06:30.308905 (+   195us) write_op.cc:276] Timestamp: P: 1783602390308641 usec, L: 0
0709 13:06:30.308946 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.344033 (+ 35087us) log.cc:844] Serialized 2870 byte log entry
0709 13:06:31.123324 (+779291us) op_driver.cc:464] REPLICATION: finished
0709 13:06:31.820484 (+697160us) write_op.cc:301] APPLY: starting
0709 13:06:31.880534 (+ 60050us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:32.074099 (+193565us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:32.074322 (+   223us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:32.126259 (+ 51937us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:32.126674 (+   415us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:06:32.126745 (+    71us) write_op.cc:312] APPLY: finished
0709 13:06:32.127209 (+   464us) log.cc:844] Serialized 59 byte log entry
0709 13:06:32.366022 (+238813us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.366382 (+   360us) write_op.cc:454] Released schema lock
0709 13:06:32.366579 (+   197us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:32.367801 (+  1222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.367929 (+   128us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":241474,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":539782,"apply.run_cpu_time_us":29172,"apply.run_wall_time_us":590012,"num_ops":7,"prepare.queue_time_us":354841,"prepare.run_cpu_time_us":43734,"prepare.run_wall_time_us":417780,"raft.queue_time_us":49118,"raft.run_cpu_time_us":33648,"raft.run_wall_time_us":438039,"replication_time_us":790316,"thread_start_us":1126198,"threads_started":5,"wal-append.queue_time_us":990786,"wal-append.run_cpu_time_us":6364,"wal-append.run_wall_time_us":2396791}]]}
I20260709 13:06:36.224205 24073 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.225945 22607 raft_consensus.cc:2410] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:36.187875 24099 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.229182 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.187157 24053 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:36.231307 21869 raft_consensus.cc:2410] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:36.221669 24039 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.186661 23938 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:06:36.227860 23871 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:36.230952 24037 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.226486 24102 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.239564 21869 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:36.244289 21869 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:36.250176 22602 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:06:36.253914 24030 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.257118 23955 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:36.257778 23955 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.260831 24068 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.262212 21870 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:36.263434 24068 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:36.263725 21870 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:36.229436 24070 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.265153 22604 raft_consensus.cc:2368] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5.
I20260709 13:06:36.266189 24070 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:36.266806 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1583) took 1924 ms. Trace:
I20260709 13:06:36.267186 21948 rpcz_store.cc:276] 0709 13:06:34.342938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.343117 (+   179us) service_pool.cc:224] Handling call
0709 13:06:34.343545 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.567547 (+224002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.567577 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.678074 (+110497us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.850672 (+172598us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:34.850707 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.850782 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.265841 (+1415059us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b24000f4ef8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352e0b9c4 00007f6352e09acb 00007f6352fc4dc9 00007f6352fc4a55 00007f6352fc3fb0 00007f6355c3a488 00007f6355c3abe8 00007f6355c12398 00007f6355c0d76a 00007f6355c0cbb6
0709 13:06:36.266496 (+   655us) raft_consensus.cc:1685] finished
0709 13:06:36.266516 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.266744 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16870,"raft.queue_time_us":98278,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":45314,"spinlock_wait_cycles":40947584,"thread_start_us":277720,"threads_started":2,"wal-append.queue_time_us":121395}
I20260709 13:06:36.268151 24085 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:36.269301 22573 leader_election.cc:336] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.064s (SENT)
I20260709 13:06:36.233582 23551 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:36.286962 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100795us
W20260709 13:06:36.284039 23888 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.957s	user 0.008s	sys 0.009s
I20260709 13:06:36.275409 21869 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:36.291484 21869 pending_rounds.cc:85] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 2
I20260709 13:06:36.233781 23990 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.235105 24053 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:36.292032 21869 pending_rounds.cc:107] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 13:06:36.292261 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.292550 21866 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.293445 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:36.301252 21988 leader_election.cc:336] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.930s (SENT)
I20260709 13:06:36.276762 21870 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:36.301754 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:36.231552 24093 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:36.303306 21869 raft_consensus.cc:2889] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:36.304057 24093 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.310127 23750 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.318910 24053 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:36.312566 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:36.320701 23955 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:36.322583 23990 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:36.334242 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.338343 21838 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.672s (SENT)
I20260709 13:06:36.338585 24085 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:36.338212 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:36.339282 22605 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.342144 24087 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:36.343523 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.348641 22605 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
W20260709 13:06:36.348944 21950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1581) took 2008 ms (client timeout 1580 ms). Trace:
W20260709 13:06:36.349431 21950 rpcz_store.cc:269] 0709 13:06:34.340261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.340693 (+   432us) service_pool.cc:224] Handling call
0709 13:06:36.348704 (+2008011us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400247554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:36.348821 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083716864}
I20260709 13:06:36.337574 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:36.374426 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.375885 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:36.377390 21949 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:36.378341 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:36.418962 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 81470.6us
I20260709 13:06:36.379878 21941 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:36.380795 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.383049 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.424651 21950 raft_consensus.cc:2410] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:36.384310 24076 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:36.371847 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:36.390718 24009 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:36.391955 21838 leader_election.cc:336] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.210s (SENT)
I20260709 13:06:36.429641 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:36.393409 24062 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.099s	user 0.003s	sys 0.000s
I20260709 13:06:36.404189 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 202) took 1097 ms. Trace:
I20260709 13:06:36.433254 21866 rpcz_store.cc:276] 0709 13:06:35.306816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.858649 (+551833us) service_pool.cc:224] Handling call
0709 13:06:35.858869 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.300865 (+441996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.403927 (+103062us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400317ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:36.404121 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996957440}
I20260709 13:06:36.409161 21772 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 4, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 4 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:06:36.410696 24108 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:06:36.416913 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.437090 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.437441 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.438923 21946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 163) took 3104 ms (client timeout 2369 ms). Trace:
I20260709 13:06:36.435590 21772 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 4, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 4 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:06:36.439404 21946 rpcz_store.cc:269] 0709 13:06:33.327754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.327880 (+   126us) service_pool.cc:224] Handling call
0709 13:06:36.432396 (+3104516us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b540009bfd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:36.432501 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016340736}
I20260709 13:06:36.440492 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.440372 21772 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 3 to 4, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 4 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:06:36.418166 21948 raft_consensus.cc:2376] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5. Re-sending same reply.
W20260709 13:06:36.429168 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 57411.4us
I20260709 13:06:36.448704 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.430150 21838 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:36.429752 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.450390 21871 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:36.442718 24076 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:36.442524 23993 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:36.352541 24053 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:06:36.456915 23551 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:36.457811 24070 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.428834 24105 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.458981 24105 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:36.458904 24070 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.459790 23910 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.443377 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.460992 21870 raft_consensus.cc:2376] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4. Re-sending same reply.
I20260709 13:06:36.456957 21987 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:36.462293 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.464080 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.444209 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:36.444993 24115 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:36.420210 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:36.447734 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.451222 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.467669 21871 raft_consensus.cc:2376] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4. Re-sending same reply.
W20260709 13:06:36.451668 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.451336 21772 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 3, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 3 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.455945 23750 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:36.457343 23993 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.428557 24085 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.431631 24003 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.443647 24087 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:36.459465 24105 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.468704 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.489269 21870 raft_consensus.cc:2376] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4. Re-sending same reply.
I20260709 13:06:36.490748 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.491600 21870 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
W20260709 13:06:36.468999 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.470007 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 78112.3us
W20260709 13:06:36.472160 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 52011.1us
I20260709 13:06:36.449342 21866 raft_consensus.cc:2376] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3. Re-sending same reply.
I20260709 13:06:36.493942 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:36.494019 21838 leader_election.cc:336] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.238s (SENT)
I20260709 13:06:36.494153 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:36.494637 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:36.494977 21866 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:36.471177 21772 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 3 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 4 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.495774 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.496496 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:36.496838 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.497273 22018 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:36.496673 21772 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 2 to 5, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 5 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:36.497885 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.468564 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.498732 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:36.498936 21871 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:36.499547 22024 raft_consensus.cc:2410] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:36.499945 24076 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.500927 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:36.501554 22016 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:36.502663 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:36.483444 21987 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:36.468026 23551 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:36.500340 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:36.469631 23987 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:36.497965 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:36.507376 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.474956 24003 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.469803 24070 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:36.525482 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.529217 21866 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:36.498955 21772 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 3 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 4 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.482681 23871 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.482877 24109 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.537065 24109 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:36.538086 24109 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.539439 24109 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.503737 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:36.543401 21838 leader_election.cc:336] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.896s (SENT)
I20260709 13:06:36.543500 22020 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:36.505107 22024 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.514933 24089 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.551589 24089 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:36.472868 24053 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.552560 24089 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.513892 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:36.554229 22018 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.520072 22015 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:36.473124 23993 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:36.519304 21870 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:36.521814 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:36.522058 21988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 2.106s (SENT) [suppressed 65 similar messages]
I20260709 13:06:36.483186 24085 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:36.533385 21772 catalog_manager.cc:5697] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 3 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 4 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.509212 23750 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:06:36.534804 22602 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:36.580876 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 58835.5us
I20260709 13:06:36.535175 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:36.505955 23551 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:36.558655 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:36.590793 22020 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:36.528510 24003 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:36.567631 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 45882.2us
I20260709 13:06:36.594585 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:36.575158 21838 leader_election.cc:336] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.923s (SENT)
I20260709 13:06:36.528172 24070 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:36.569566 21772 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.588357 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.607838 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.608168 21870 raft_consensus.cc:2368] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:36.592485 23861 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.609004 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:36.609529 21946 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.609308 23861 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.611435 22604 raft_consensus.cc:2368] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5.
W20260709 13:06:36.619880 21838 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.509s (SENT)
I20260709 13:06:36.620386 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:36.621217 23990 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.621523 24076 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.621919 24076 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:36.622352 24076 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.589015 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.569139 23987 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:36.625892 23987 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:36.607218 21772 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 3, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 3 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.629021 23993 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.631207 24070 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:36.632328 24070 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.569391 24100 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.637217 21867 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:36.629292 21772 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 2, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 2 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:36.562863 23871 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:36.562965 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 198) took 1805 ms. Trace:
I20260709 13:06:36.647918 21872 rpcz_store.cc:276] 0709 13:06:34.757820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.759536 (+  1716us) service_pool.cc:224] Handling call
0709 13:06:36.313195 (+1553659us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:36.313384 (+   189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.313593 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.313617 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.322751 (+  9134us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.449713 (+126962us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.449750 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.449811 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.562677 (+112866us) raft_consensus.cc:1685] finished
0709 13:06:36.562698 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.562907 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804992,"thread_start_us":126631,"threads_started":1,"wal-append.queue_time_us":184293}
I20260709 13:06:36.579833 22018 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:36.649470 24102 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:36.651437 22018 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:36.651784 24102 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:36.603153 21839 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Timed out: RequestConsensusVote RPC to 127.20.69.4:41571 timed out after 1.611s (SENT)
W20260709 13:06:36.653326 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 50215us
I20260709 13:06:36.604979 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.654685 21866 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:36.655018 23993 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.657999 21946 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:36.663565 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.664856 22024 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:36.653142 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.671411 23871 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:36.673002 21839 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Timed out: RequestConsensusVote RPC to 127.20.69.4:41571 timed out after 1.700s (SENT)
I20260709 13:06:36.673465 23551 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:36.673789 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.674742 23551 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.675849 24085 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:36.671998 24036 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:36.679217 23987 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:36.691105 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:36.692617 24031 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.693172 24031 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:36.694125 24031 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.697537 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:36.701715 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.709009 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.709875 21946 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:36.719750 22018 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:36.731171 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.735446 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.736974 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.738528 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.739275 21944 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:36.740355 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.703171 23861 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:36.745327 21914 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54888 dropped due to backpressure: service queue is full with 50 items
I20260709 13:06:36.752992 22024 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:36.755403 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.757200 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.757565 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.758018 21950 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:36.758868 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:36.759456 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.752889 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.759470 21941 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.762458 21950 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:36.765866 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.767416 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:36.768826 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 55476.1us
I20260709 13:06:36.775410 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:36.776674 21946 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:36.775630 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.767544 23677 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.786468 21950 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:06:36.787201 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.783869 24105 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.785317 23677 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:36.799499 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.805968 22016 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:36.828917 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.854785 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:36.855531 22015 raft_consensus.cc:2376] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5. Re-sending same reply.
I20260709 13:06:36.745599 21914 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:54888 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1025)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1033)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1040)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1028)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1034)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1012)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1017)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1018)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1027)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1032)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1022)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1024)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1036)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 178)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1037)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1035)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 998)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1000)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1013)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1014)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 171)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 172)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 173)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1023)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 176)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 179)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 180)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 181)
I20260709 13:06:36.873258 21868 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.874632 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:36.875348 21866 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:36.877662 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:36.883335 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:36.884348 21873 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:06:36.885792 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.887471 21873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 1973) took 2119 ms (client timeout 2210 ms). Trace:
W20260709 13:06:36.887948 21873 rpcz_store.cc:269] 0709 13:06:34.767876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.768330 (+   454us) service_pool.cc:224] Handling call
0709 13:06:36.883172 (+2114842us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:36.887401 (+  4229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11932928}
I20260709 13:06:36.881019 24087 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.880718 24031 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:06:36.895310 24087 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.906466 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:36.908259 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:36.904410 22015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
W20260709 13:06:36.910542 24121 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.226s	user 0.002s	sys 0.002s
I20260709 13:06:36.911012 23861 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.914050 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:36.911245 24008 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:36.918022 24038 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:36.919306 23784 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:36.920248 23784 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:36.920640 23784 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:36.921679 24119 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.377s	user 0.000s	sys 0.003s
W20260709 13:06:36.922274 24074 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.273s	user 0.004s	sys 0.000s
I20260709 13:06:36.921533 23784 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.923342 23784 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.916853 22015 raft_consensus.cc:606] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:36.916518 23989 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:06:36.915624 23981 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:06:36.915305 24008 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:36.913928 23861 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:36.924047 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:36.939339 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.940039 21946 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:36.942662 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.943358 21950 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:36.944182 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.911633 24087 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.952230 24042 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.953119 24042 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:36.955631 24003 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:36.957335 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.957062 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:36.937299 21838 leader_election.cc:336] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.960s (SENT)
I20260709 13:06:36.926441 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1582) took 2585 ms. Trace:
I20260709 13:06:36.939414 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:36.959327 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.963227 21950 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:36.964556 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.959754 21942 rpcz_store.cc:276] 0709 13:06:34.342195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.371586 (+ 29391us) service_pool.cc:224] Handling call
0709 13:06:34.372022 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.572107 (+200085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.572155 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.413161 (+1841006us) spinlock_profiling.cc:243] Waited 96.4 ms on lock 0x7b2c00010da8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:06:36.414093 (+   932us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.506465 (+ 92372us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:36.506498 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.506574 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.580855 (+ 74281us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4800002dd8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:06:36.921159 (+340304us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:36.926181 (+  5022us) raft_consensus.cc:1685] finished
0709 13:06:36.926203 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.926357 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12979,"raft.queue_time_us":95677,"raft.run_cpu_time_us":4285,"raft.run_wall_time_us":2109923,"spinlock_wait_cycles":271003648,"thread_start_us":269699,"threads_started":2,"wal-append.queue_time_us":130506}
I20260709 13:06:36.965070 21943 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:36.967201 21950 raft_consensus.cc:2368] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:36.968739 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.971328 21943 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:36.971609 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:36.972702 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.974185 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:37.013000 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45239.9us
W20260709 13:06:37.017064 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.013186 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:36.935377 24130 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:06:36.912169 24031 consensus_queue.cc:1243] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:37.025552 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.928761 22015 raft_consensus.cc:614] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:37.024290 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:36.980662 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.025724 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.018379 21942 raft_consensus.cc:2410] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:37.031962 23784 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:37.032053 24087 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.033006 23784 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:37.034202 23784 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:37.035166 24087 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:37.039645 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:37.040270 21867 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.042212 21941 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
W20260709 13:06:37.046254 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 124696us
I20260709 13:06:37.029628 24105 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:37.051403 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:36.976532 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.052762 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.039160 24003 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:36.995609 21838 leader_election.cc:336] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.022s (SENT)
I20260709 13:06:37.055145 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:37.011700 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:37.054630 21867 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:37.055205 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:36.937040 23861 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:37.049044 24043 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.011s	sys 0.021s
I20260709 13:06:37.063901 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.065276 21942 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:37.009557 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.064838 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:37.070567 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75031.7us
W20260709 13:06:37.071296 21838 leader_election.cc:336] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.410s (SENT)
I20260709 13:06:37.063442 21943 raft_consensus.cc:2376] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3. Re-sending same reply.
I20260709 13:06:37.072677 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:37.071660 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:37.074338 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.073885 21943 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.075415 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.076443 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.050558 24042 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:36.934391 24008 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.078501 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.080842 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:37.083599 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:37.085245 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.084221 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.086206 21950 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:37.071506 24043 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.011s	sys 0.023s
I20260709 13:06:37.089206 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.083019 22607 raft_consensus.cc:2376] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6. Re-sending same reply.
W20260709 13:06:37.094203 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57224.1us
I20260709 13:06:37.094504 21942 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:37.092175 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.097074 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:37.096428 21947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 169) took 3005 ms (client timeout 2064 ms). Trace:
W20260709 13:06:37.098770 21947 rpcz_store.cc:269] 0709 13:06:34.091061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.092984 (+  1923us) service_pool.cc:224] Handling call
0709 13:06:37.096143 (+3003159us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54000fd054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:37.096331 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774483328}
I20260709 13:06:37.072525 24068 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.101146 21947 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:37.077642 23987 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:37.105522 21950 raft_consensus.cc:1217] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:06:37.081601 24052 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.107869 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:37.111078 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 59766.5us
I20260709 13:06:37.114651 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:37.115161 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:37.115662 21866 raft_consensus.cc:2368] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:37.115926 22608 raft_consensus.cc:2368] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:37.116869 21875 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:37.117100 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:37.119396 21872 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:37.120800 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:37.121441 21870 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:37.099882 22601 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:37.109522 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.123015 21869 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:37.123180 21870 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:37.120090 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:37.127893 21871 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.128017 22610 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:37.124027 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.126008 22609 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:37.106344 21950 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:37.129901 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:37.130555 21870 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.100878 24136 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:37.132652 21916 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:37.135447 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:37.136286 21869 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.138401 21950 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:06:37.161386 21947 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:37.180670 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.183245 21943 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:37.187620 21871 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:37.110421 24068 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.191066 21870 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:37.196823 21943 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:37.268579 24042 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:37.269119 24042 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.269258 24052 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.269589 24042 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.269836 24052 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:37.273976 21869 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:37.274904 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:37.273561 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:37.277204 21871 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:37.279337 21871 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:37.279919 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:37.280751 21943 raft_consensus.cc:1217] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:06:37.282015 21943 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:37.282622 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.281785 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:37.284154 21870 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:37.167273 23677 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:37.196862 24076 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 13:06:37.295356 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:37.295058 22607 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
W20260709 13:06:37.299732 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 166002us
I20260709 13:06:37.273479 22605 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:37.299872 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:37.303321 21870 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:37.307554 22609 raft_consensus.cc:2368] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:37.288005 23987 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:37.319973 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:37.329488 21950 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:37.333985 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.341605 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:37.343263 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:37.320259 24090 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:37.348968 21950 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.320523 23987 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:37.300745 24076 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.365798 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.348201 24143 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:37.374763 21950 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:37.377014 24090 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.323837 23981 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:37.362231 24087 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:37.378768 21873 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:37.352056 23973 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:37.382300 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.384469 22609 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:37.330871 24141 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:06:37.361822 23987 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:37.387367 24090 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.362785 22601 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:37.388815 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.402490 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:37.408886 24142 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:06:37.385082 24052 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:37.362954 23993 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:06:37.400200 24138 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:06:37.423282 22609 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
W20260709 13:06:37.449175 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.452800 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:37.424404 24044 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:37.481029 23861 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:37.470731 24068 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:37.483215 24076 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:37.485426 24076 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:37.485894 23993 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.486299 24076 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:37.486433 23993 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.487002 24076 consensus_queue.cc:1243] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:37.484151 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:37.601709 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 241283us
I20260709 13:06:37.492988 21946 raft_consensus.cc:2368] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
W20260709 13:06:37.568457 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.602226 21914 connection.cc:256] RPC call timeout handler was delayed by -1.4884713999999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 13:06:37.707314 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2112713999999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:06:37.707693 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0618713999999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 13:06:37.707963 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0015713999999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 13:06:37.708813 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:37.707882 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 412597us
I20260709 13:06:37.623924 24052 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:37.711927 24052 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:37.712620 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:37.712990 24052 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.714675 24052 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:37.519112 24134 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.366s	user 0.001s	sys 0.002s
I20260709 13:06:37.717334 23677 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:06:37.526821 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.718858 24031 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:37.719389 24031 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:37.720727 23993 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:37.720497 24031 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.721916 24031 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:37.722607 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:37.745936 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:37.745716 23677 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:37.713677 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:37.752812 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 371041us
W20260709 13:06:37.724852 24144 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:06:37.753693 21839 leader_election.cc:400] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:37.724249 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:37.757129 21839 leader_election.cc:403] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:37.490187 23861 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:37.758137 22017 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:37.747937 23780 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:37.761170 24087 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:37.790839 22020 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:37.778203 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:37.808574 23973 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:37.761791 24146 raft_consensus.cc:2764] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:37.815904 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:37.817093 23973 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.819540 23784 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:37.820964 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 43688.5us
I20260709 13:06:37.821686 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:37.822866 21914 leader_election.cc:400] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:37.823125 21914 leader_election.cc:403] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:37.823997 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:37.824923 24146 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:37.833688 24146 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
I20260709 13:06:37.834595 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1607) took 1323 ms. Trace:
I20260709 13:06:37.834864 24146 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:37.835039 21948 rpcz_store.cc:276] 0709 13:06:36.511156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.512130 (+   974us) service_pool.cc:224] Handling call
0709 13:06:36.512579 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.513105 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.513153 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.513806 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.287659 (+773853us) spinlock_profiling.cc:243] Waited 962 us on lock 0x7b180037f000. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:06:37.421761 (+134102us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:37.421820 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.423586 (+  1766us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.834232 (+410646us) raft_consensus.cc:1685] finished
0709 13:06:37.834254 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.834524 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1671,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":2608,"spinlock_wait_cycles":2211584,"thread_start_us":133868,"threads_started":1,"wal-append.queue_time_us":1237413}
I20260709 13:06:37.836969 21942 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:37.844046 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.753139 23987 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:37.778299 24090 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:37.879765 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.880183 21914 leader_election.cc:400] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 2 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 2. Current term is 3.
W20260709 13:06:37.838547 24008 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.000s
I20260709 13:06:37.823915 24162 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:37.802834 24143 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:37.949831 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.847426 23780 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:37.966290 22022 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:06:37.956272 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 53857.3us
I20260709 13:06:37.965215 24160 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.961251 24042 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.004s
I20260709 13:06:37.899565 24090 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:37.979406 22017 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:06:37.983372 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 229766us
I20260709 13:06:37.954124 24155 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.986545 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:37.991145 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:37.953539 24008 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:37.969169 23780 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:38.073980 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1032) took 1429 ms. Trace:
I20260709 13:06:38.074579 21946 rpcz_store.cc:276] 0709 13:06:36.644125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.028313 (+384188us) service_pool.cc:224] Handling call
0709 13:06:37.109378 (+ 81065us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:38.073680 (+964302us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540012fa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:38.073881 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861287168}
I20260709 13:06:38.076846 21950 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:38.078511 24157 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:06:38.078890 23981 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:38.012336 24155 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:38.079527 23981 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:38.081148 23987 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:38.081791 22602 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:38.061676 23677 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.082983 23677 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:38.085106 23677 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:38.088019 21841 leader_election.cc:336] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.896s (SENT)
I20260709 13:06:38.088586 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:38.089781 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:38.090395 21869 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.974735 24162 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:38.035580 24151 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.104067 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 390430us
I20260709 13:06:38.063380 24150 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:38.109297 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:37.991812 24090 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:38.118963 21869 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:38.030157 23861 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:06:37.989135 24160 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:38.051632 24154 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:06:38.100927 23987 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 3. Current term is 4.
I20260709 13:06:38.132081 21869 pending_rounds.cc:85] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 1
I20260709 13:06:38.096015 24149 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.139873 22601 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:38.146023 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.112799 24150 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:38.141165 21869 pending_rounds.cc:107] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:38.149181 21869 raft_consensus.cc:2889] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:37.998834 24087 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:38.000159 24042 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:38.132995 24158 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:06:38.173861 24172 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.180822 24171 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.182406 23981 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:38.183010 23987 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:38.175326 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 179) took 1493 ms. Trace:
I20260709 13:06:38.231479 21943 rpcz_store.cc:276] 0709 13:06:36.682348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.283615 (+601267us) service_pool.cc:224] Handling call
0709 13:06:37.283896 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.297942 (+ 14046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.297988 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.310133 (+ 12145us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.769427 (+459294us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:37.769488 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.769591 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.175038 (+405447us) raft_consensus.cc:1685] finished
0709 13:06:38.175065 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.175248 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4171,"raft.queue_time_us":5797,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":9180,"thread_start_us":427786,"threads_started":1,"wal-append.queue_time_us":797418}
I20260709 13:06:38.063567 24143 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:38.115461 24151 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:38.175431 24090 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:38.189282 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:38.190124 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 203651us
W20260709 13:06:38.190708 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 154100us
I20260709 13:06:38.253553 21839 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:38.230363 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 130757us
I20260709 13:06:38.251775 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:38.158069 24150 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.258925 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1046) took 1367 ms. Trace:
W20260709 13:06:38.257153 21841 leader_election.cc:336] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.960s (SENT)
I20260709 13:06:38.259680 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:38.558874 24172 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:38.560106 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 302976us
I20260709 13:06:38.259443 21941 rpcz_store.cc:276] 0709 13:06:36.891086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.043022 (+151936us) service_pool.cc:224] Handling call
0709 13:06:38.189122 (+1146100us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:38.258862 (+ 69740us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26062208}
I20260709 13:06:38.248633 24146 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:38.562391 24146 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:38.511096 24162 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:38.557367 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2012) took 1220 ms. Trace:
I20260709 13:06:38.385319 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 214) took 1451 ms. Trace:
I20260709 13:06:38.317730 22602 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
W20260709 13:06:38.554481 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 445240us
I20260709 13:06:38.569752 23588 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:38.569968 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 369726us
I20260709 13:06:38.570329 23588 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:38.570571 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:38.317421 24090 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.259867 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2037) took 1566 ms. Trace:
I20260709 13:06:38.571859 23588 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:38.557760 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 304256us
I20260709 13:06:38.565303 21869 rpcz_store.cc:276] 0709 13:06:37.336951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.131614 (+794663us) service_pool.cc:224] Handling call
0709 13:06:38.131905 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.179063 (+ 47158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.179094 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.179578 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.262060 (+ 82482us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:38.338316 (+ 76256us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.555507 (+217191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.555589 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.557181 (+  1592us) raft_consensus.cc:1685] finished
0709 13:06:38.557199 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.557312 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":296470,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":16352,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"thread_start_us":82147,"threads_started":1,"wal-append.queue_time_us":375687}
I20260709 13:06:38.613876 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:38.614627 21869 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:38.551793 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 1.97008e+06us
I20260709 13:06:38.260558 23987 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:38.630359 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:38.631183 22021 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.636781 22018 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:38.557472 21875 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:38.638954 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:38.639750 21875 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:38.569052 21873 rpcz_store.cc:276] 0709 13:06:36.934091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.935648 (+  1557us) service_pool.cc:224] Handling call
0709 13:06:36.935910 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.383931 (+448021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.385000 (+1001069us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540044dc54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:38.385234 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018010496}
I20260709 13:06:38.283279 23981 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.282s
I20260709 13:06:38.572144 22024 rpcz_store.cc:276] 0709 13:06:36.693050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.701510 (+  8460us) service_pool.cc:224] Handling call
0709 13:06:36.702527 (+  1017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.753867 (+ 51340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.259582 (+1505715us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b5400199e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:38.259797 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115331968}
W20260709 13:06:38.316747 24158 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:06:38.283736 24052 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.577280 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:38.555188 24151 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:38.579903 24172 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.582373 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:38.582491 24155 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:38.585863 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 469) took 1493 ms. Trace:
I20260709 13:06:38.646008 22607 rpcz_store.cc:276] 0709 13:06:37.092592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.092883 (+   291us) service_pool.cc:224] Handling call
0709 13:06:38.585656 (+1492773us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000519d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:38.585798 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422994304}
W20260709 13:06:38.646452 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.587953 24145 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.178s	user 0.004s	sys 0.011s
I20260709 13:06:38.588057 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2010) took 1276 ms. Trace:
I20260709 13:06:38.589828 22603 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.590157 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:38.590785 24132 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 1.681s	user 0.007s	sys 0.008s
I20260709 13:06:38.591882 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1000) took 2026 ms. Trace:
I20260709 13:06:38.649464 21945 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:38.649848 21947 rpcz_store.cc:276] 0709 13:06:36.565172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.102278 (+537106us) service_pool.cc:224] Handling call
0709 13:06:37.102684 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.166233 (+ 63549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.591646 (+1425413us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b540029a754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:38.591828 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134360320}
I20260709 13:06:38.597723 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:38.647454 21870 rpcz_store.cc:276] 0709 13:06:37.312106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.313043 (+   937us) service_pool.cc:224] Handling call
0709 13:06:37.323468 (+ 10425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:37.706441 (+382973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.706736 (+   295us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:37.707331 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 13:06:38.132888 (+425557us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:38.354802 (+221914us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.587662 (+232860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.587804 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.587848 (+    44us) raft_consensus.cc:1685] finished
0709 13:06:38.587863 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.588006 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232012,"prepare.queue_time_us":127758,"prepare.run_wall_time_us":52,"raft.queue_time_us":95477,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":23768,"spinlock_wait_cycles":26626944,"thread_start_us":893998,"threads_started":3,"wal-append.queue_time_us":585594}
W20260709 13:06:38.604830 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 50023.4us
I20260709 13:06:38.645239 22604 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 5: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:06:38.652675 22604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 404) took 1369 ms (client timeout 1683 ms). Trace:
W20260709 13:06:38.653189 22604 rpcz_store.cc:269] 0709 13:06:37.283484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.284937 (+  1453us) service_pool.cc:224] Handling call
0709 13:06:38.577162 (+1292225us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4deee 0000000000375939 00007f635afc11e0 00007f635b08a0c4 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:38.652575 (+ 75413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30830848}
I20260709 13:06:38.649425 21875 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:06:38.650355 21945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1025) took 2008 ms (client timeout 1948 ms). Trace:
W20260709 13:06:38.655426 21945 rpcz_store.cc:269] 0709 13:06:36.642210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.589873 (+1947663us) service_pool.cc:224] Handling call
0709 13:06:38.650280 (+ 60407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:38.651098 21867 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:38.598483 24146 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:38.601940 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.667943 22021 raft_consensus.cc:2410] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:38.664197 21869 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:38.678262 22023 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:38.680992 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:38.681953 22023 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.684516 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:38.686120 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:38.687686 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:38.693332 22020 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:38.685186 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:38.697031 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 78247.2us
I20260709 13:06:38.699332 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:38.706588 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:38.707707 22020 raft_consensus.cc:2410] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:06:38.708559 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 126286us
W20260709 13:06:38.711835 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.712364 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.686992 22018 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:38.715619 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:38.716671 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:38.718886 22022 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 3: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:38.722733 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:38.723824 22017 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:38.727438 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:38.729410 22607 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:38.721158 24178 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.733084 23871 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:38.734329 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76997.4us
I20260709 13:06:38.735057 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:38.720376 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:38.741326 21871 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.019s	sys 0.041s
W20260709 13:06:38.741786 21871 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.019s	sys 0.041s
I20260709 13:06:38.707069 23588 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.746759 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:38.717113 23750 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.760833 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2009) took 1454 ms. Trace:
I20260709 13:06:38.767549 22023 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:38.761278 21871 rpcz_store.cc:276] 0709 13:06:37.306171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.306352 (+   181us) service_pool.cc:224] Handling call
0709 13:06:37.306664 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.777368 (+470704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.777427 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.800475 (+ 23048us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.133087 (+332612us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:38.742182 (+609095us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.760431 (+ 18249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.760511 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.760555 (+    44us) raft_consensus.cc:1685] finished
0709 13:06:38.760572 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.760769 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26525,"prepare.queue_time_us":425073,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":69763,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":1318683,"threads_started":3,"wal-append.queue_time_us":440316}
W20260709 13:06:38.770582 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 71356.5us
I20260709 13:06:38.742949 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:38.742842 24043 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:06:38.707492 24160 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:38.717378 24052 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:06:38.758313 24151 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.758519 24076 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.758085 24166 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:38.758756 24172 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.771776 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56251.7us
I20260709 13:06:38.870973 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:38.766620 24178 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:38.964272 24150 consensus_meta.cc:287] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.002s
W20260709 13:06:38.960338 24195 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:06:38.766971 24155 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:38.768716 24149 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:38.915045 24183 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:38.771088 23981 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.817102 24042 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:38.931267 24090 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.027074 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 252481us
I20260709 13:06:38.775343 24184 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:38.959414 24103 raft_consensus.cc:1068] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Unable to promote non-voter bcc802f7bc374bed98e2ee0596a8ebda: Illegal state: Replica 95296a4420ed41b69191d3d4353cf2b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
W20260709 13:06:39.026234 24107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.436s	user 0.020s	sys 0.026s
W20260709 13:06:39.038641 24107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.512s	user 0.020s	sys 0.026s
I20260709 13:06:39.034832 24090 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.030378 24162 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:06:38.772042 23898 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.259s
I20260709 13:06:38.981002 24151 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.041738 24090 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:38.988492 24076 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.042589 24151 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.036168 23750 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:39.036384 24184 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.022527 24178 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.022468 24155 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:39.047865 24155 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.021853 24166 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:39.022763 24150 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.048659 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 473) took 1739 ms. Trace:
I20260709 13:06:38.821079 23987 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.031337 24149 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.021248 24172 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.060683 24172 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.052780 24076 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.053067 24150 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:39.054477 24184 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:39.064939 24178 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:39.066007 22609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 477) took 1695 ms (client timeout 1948 ms). Trace:
I20260709 13:06:39.056757 22601 rpcz_store.cc:276] 0709 13:06:37.309093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.897970 (+588877us) service_pool.cc:224] Handling call
0709 13:06:38.023987 (+126017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.179708 (+155721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.048223 (+868515us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b5400525654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:39.048516 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218494848}
W20260709 13:06:39.066504 22609 rpcz_store.cc:269] 0709 13:06:37.370688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.452494 (+ 81806us) service_pool.cc:224] Handling call
0709 13:06:39.065801 (+1613307us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000b1b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:39.065945 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642007936}
I20260709 13:06:39.058619 24149 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.069897 24136 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:39.070400 24136 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:39.070456 24166 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.077548 24155 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.078723 24008 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.080271 24155 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.081418 24087 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:39.081786 24087 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:39.082588 24087 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.083478 24087 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:39.098595 24139 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 1.811s	user 0.012s	sys 0.000s
I20260709 13:06:39.071273 24136 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.126632 24136 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.138695 23780 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.178738 21839 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:38.935500 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2014) took 1095 ms. Trace:
I20260709 13:06:39.189028 21874 rpcz_store.cc:276] 0709 13:06:37.839855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.174495 (+334640us) service_pool.cc:224] Handling call
0709 13:06:38.174818 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.183647 (+  8829us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:38.575190 (+391543us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.708408 (+133218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.708457 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:38.708499 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.935149 (+226650us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b54003188d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:38.935218 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.935407 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68767,"prepare.queue_time_us":374695,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":34131,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3638,"spinlock_wait_cycles":19753344,"thread_start_us":440050,"threads_started":2,"wal-append.queue_time_us":204092}
W20260709 13:06:39.192020 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.205437 21839 leader_election.cc:336] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Timed out: RequestConsensusVote RPC to 127.20.69.4:41571 timed out after 1.948s (SENT)
I20260709 13:06:39.206399 21839 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:39.207192 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.966044 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 219397us
I20260709 13:06:39.212028 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:39.215022 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:39.223168 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44155.1us
I20260709 13:06:39.230312 21772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 161) took 7797 ms. Trace:
I20260709 13:06:39.233139 21773 catalog_manager.cc:5697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:39.240036 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.240754 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.242538 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1003) took 2676 ms. Trace:
I20260709 13:06:39.243041 21942 rpcz_store.cc:276] 0709 13:06:36.565905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.103188 (+537283us) service_pool.cc:224] Handling call
0709 13:06:37.836715 (+733527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.837406 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.242042 (+1404636us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400278dd0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:39.242285 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684809600}
I20260709 13:06:39.230916 21772 rpcz_store.cc:276] 0709 13:06:31.433194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.433429 (+   235us) service_pool.cc:224] Handling call
0709 13:06:32.544825 (+1111396us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdc090 00007f635607af3a 00007f635be311cc 00007f635bf2f37e 00007f635a3f02a4 00007f635a3f0232 00007f635a3f0161 00007f635a3f00dc 00007f635a3ef392 00007f63543ad48c 00007f63543ac8c6
0709 13:06:39.230035 (+6685210us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:36.889423 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:36.904500 (+ 15077us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:36.904537 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:06:36.904550 (+    13us) tablet.cc:662] Decoding operations
0709 13:06:36.910777 (+  6227us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:36.910839 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:36.910871 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:36.917953 (+  7082us) tablet.cc:701] Row locks acquired
0709 13:06:36.917977 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:06:36.918122 (+   145us) write_op.cc:270] Start()
0709 13:06:36.918235 (+   113us) write_op.cc:276] Timestamp: P: 1783602396918071 usec, L: 0
0709 13:06:36.918254 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:06:36.918937 (+   683us) log.cc:844] Serialized 4362 byte log entry
0709 13:06:38.384266 (+1465329us) op_driver.cc:464] REPLICATION: finished
0709 13:06:38.969361 (+585095us) write_op.cc:301] APPLY: starting
0709 13:06:38.969451 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:38.969685 (+   234us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:38.969801 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:39.037988 (+ 68187us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:39.038226 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:06:39.038276 (+    50us) write_op.cc:312] APPLY: finished
0709 13:06:39.038591 (+   315us) log.cc:844] Serialized 83 byte log entry
0709 13:06:39.038758 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:39.038888 (+   130us) write_op.cc:454] Released schema lock
0709 13:06:39.038955 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:39.039266 (+   311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:39.039294 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":751370,"reported_tablets":18,"spinlock_wait_cycles":123716352,"child_traces":[["op",{"apply.queue_time_us":584788,"apply.run_cpu_time_us":3445,"apply.run_wall_time_us":69894,"num_ops":11,"prepare.queue_time_us":106147,"prepare.run_cpu_time_us":30136,"prepare.run_wall_time_us":162842,"raft.queue_time_us":513833,"raft.run_cpu_time_us":62611,"raft.run_wall_time_us":476399,"replication_time_us":1387119,"thread_start_us":927608,"threads_started":4,"wal-append.queue_time_us":188777}]]}
I20260709 13:06:38.910190 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:39.245756 21944 raft_consensus.cc:2368] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:06:39.245898 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 186) took 1253 ms. Trace:
I20260709 13:06:39.246320 21947 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:39.246557 21944 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1001) took 2681 ms (client timeout 1896 ms). Trace:
I20260709 13:06:39.247084 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:39.019994 21949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1021) took 2447 ms (client timeout 1772 ms). Trace:
I20260709 13:06:39.257155 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2041) took 1910 ms. Trace:
W20260709 13:06:39.257073 21949 rpcz_store.cc:269] 0709 13:06:36.572511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.732477 (+159966us) service_pool.cc:224] Handling call
0709 13:06:38.870741 (+2138264us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:39.019907 (+149166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37395712}
W20260709 13:06:39.259107 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 248785us
I20260709 13:06:39.257691 22015 rpcz_store.cc:276] 0709 13:06:37.346975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.349704 (+  2729us) service_pool.cc:224] Handling call
0709 13:06:37.401515 (+ 51811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.425039 (+ 23524us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:37.483077 (+ 58038us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.596054 (+1112977us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b180037bf40. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c1223a 00007f635607ca2a
0709 13:06:38.930583 (+334529us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.978810 (+ 48227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.980255 (+  1445us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:38.988847 (+  8592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.021044 (+ 32197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.256824 (+235780us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":270629,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":47919,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":8584,"spinlock_wait_cycles":4467456,"thread_start_us":279671,"threads_started":2,"wal-append.queue_time_us":1525780}
I20260709 13:06:39.260583 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:39.267488 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.274470 21869 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:39.275270 21868 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:39.276435 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.276520 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:39.247148 21944 rpcz_store.cc:269] 0709 13:06:36.565438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.742198 (+176760us) service_pool.cc:224] Handling call
0709 13:06:38.885532 (+2143334us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4de9c 00007f6352f4da5b 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:39.246412 (+360880us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43338112}
I20260709 13:06:39.277626 21874 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:39.280341 21872 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:39.281230 23640 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:39.282675 21948 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:39.283531 23640 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:39.246390 21946 rpcz_store.cc:276] 0709 13:06:37.991945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.105671 (+113726us) service_pool.cc:224] Handling call
0709 13:06:38.110263 (+  4592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.110802 (+   539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.110847 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.111454 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.284973 (+173519us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:38.558184 (+273211us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.693217 (+135033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.693305 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.245261 (+551956us) raft_consensus.cc:1685] finished
0709 13:06:39.245304 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.245660 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172192,"prepare.queue_time_us":283513,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":137170,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":25011,"thread_start_us":151935,"threads_started":1,"wal-append.queue_time_us":619610}
I20260709 13:06:39.286563 23640 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:39.287343 23640 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:39.294620 21948 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:06:39.289742 23861 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:39.290232 23780 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:06:39.300419 23861 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:39.288519 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.302294 23861 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.300505 21945 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:39.302961 23611 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.301789 23780 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:39.290968 23677 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.288841 23640 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.304764 23883 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:39.321830 23883 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.305855 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 406) took 2017 ms. Trace:
W20260709 13:06:39.324536 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.324793 22603 rpcz_store.cc:276] 0709 13:06:37.288233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.290567 (+  2334us) service_pool.cc:224] Handling call
0709 13:06:38.589465 (+1298898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.649062 (+ 59597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.305310 (+656248us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000519d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:39.305591 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933458304}
I20260709 13:06:39.326758 24053 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.327514 24210 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.327942 24105 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.307503 23588 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.333554 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 113066us
I20260709 13:06:39.333433 23588 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.334861 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:39.294180 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:39.294433 21942 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:39.308957 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.291553 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.313758 24149 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.296450 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1614) took 2363 ms. Trace:
I20260709 13:06:39.336782 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:39.342976 21950 rpcz_store.cc:276] 0709 13:06:36.932585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.406788 (+474203us) service_pool.cc:224] Handling call
0709 13:06:37.407161 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.077433 (+670272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.295854 (+1218421us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b540019cb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:39.296260 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539468544}
I20260709 13:06:39.328353 24210 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.313167 24031 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.342744 24038 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.334899 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:39.342669 24149 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.345326 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:39.352949 24038 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.355252 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:39.355527 23883 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.362895 24211 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.363811 24211 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.327529 24053 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.364792 24210 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:39.365974 24184 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:39.366384 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:39.366842 24053 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:39.367123 24178 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:39.367611 24178 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.367990 21872 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:39.367748 23677 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.368978 23993 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:39.370438 23677 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.336588 23588 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:39.371712 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49306.6us
I20260709 13:06:39.373674 22023 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:39.375027 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:39.376785 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:39.377373 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:39.377525 24031 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.379218 24044 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:39.380165 24031 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.383303 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:39.368036 24178 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.370973 23993 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.379419 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:39.377543 22021 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.361800 24105 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.364282 24171 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.361167 24149 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.392967 23993 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:39.400763 22608 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:39.367018 24184 consensus_queue.cc:1243] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:06:39.407186 22608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 403) took 2272 ms (client timeout 1537 ms). Trace:
I20260709 13:06:39.407904 24211 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:39.409562 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:39.410602 21948 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
W20260709 13:06:39.413302 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.414477 24137 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:39.415402 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:39.415288 24137 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.415799 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:39.416960 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 405) took 2130 ms (client timeout 2034 ms). Trace:
W20260709 13:06:39.398458 21987 connection.cc:256] RPC call timeout handler was delayed by -1.2601685890000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:06:39.417409 24038 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:39.405644 23611 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:39.407677 22608 rpcz_store.cc:269] 0709 13:06:37.133021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.133202 (+   181us) service_pool.cc:224] Handling call
0709 13:06:39.293683 (+2160481us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:39.405496 (+111813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52835200}
W20260709 13:06:39.418797 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 154382us
I20260709 13:06:39.419113 23611 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.420765 24146 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:39.421392 21944 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:39.420773 24169 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:06:39.423025 24169 consensus_queue.cc:1243] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:39.423542 24169 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:39.423885 24169 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:39.425423 23881 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.426352 24146 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:39.427742 24146 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.417338 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:39.402899 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:39.441064 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:39.441812 21871 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:39.442622 24031 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:39.443005 23883 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:39.405689 23993 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.435762 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:39.394627 24210 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:39.450114 24099 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:39.450563 23588 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:39.451433 23588 consensus_queue.cc:1243] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:39.453083 24197 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:39.453621 24197 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:39.454871 21942 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:39.454718 24197 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.456884 24169 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:39.417425 22606 rpcz_store.cc:269] 0709 13:06:37.286881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.287513 (+   632us) service_pool.cc:224] Handling call
0709 13:06:39.415473 (+2127960us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:39.416859 (+  1386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12632960}
I20260709 13:06:39.460131 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:39.462155 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:39.436281 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:39.473165 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:39.507120 22021 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:39.443773 24031 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:39.531922 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 96344.8us
I20260709 13:06:39.503393 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:39.501169 23993 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.536108 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:39.537746 23780 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.538265 23780 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:39.538391 23993 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.538815 23780 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:39.540863 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 93814.9us
I20260709 13:06:39.541610 24202 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:39.542021 24150 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:39.542579 24150 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:39.544076 23993 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:39.549592 23993 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.550194 23993 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.552985 24166 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:39.535265 24031 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.588678 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:39.589705 23861 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:39.590968 24153 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:39.589903 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:39.591421 24153 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:39.591872 24153 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.592748 23989 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:39.593396 23989 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:39.593587 24171 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.594317 24171 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.594564 23989 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.596832 24184 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.597550 24184 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.598348 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:39.599802 24184 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:39.602141 24153 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.603442 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:39.600410 24184 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.566473 23611 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:39.621096 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.573607 24202 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:39.576987 24169 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.577452 24197 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.620359 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:39.585237 24031 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:39.618994 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 203697us
I20260709 13:06:39.535109 24210 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:39.618229 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 50076.4us
I20260709 13:06:39.626562 21866 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:39.636579 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 50271.3us
W20260709 13:06:39.637868 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.621426 23588 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:39.638840 24166 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:39.639855 24166 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:39.640262 24166 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:39.641296 24166 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.642903 24166 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.646703 24107 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:39.647233 23611 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:39.647503 23677 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:39.648284 23611 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:39.648473 23871 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:39.648728 23611 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:39.648914 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:39.649238 23871 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:39.650012 21947 raft_consensus.cc:2410] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:39.650359 23871 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.650607 23611 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.651114 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:39.655560 23973 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:39.656183 21946 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:39.656457 23611 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.653298 24202 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.651487 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:39.654361 21947 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:39.661923 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.627614 23640 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:39.669494 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 153912us
I20260709 13:06:39.658777 21873 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:39.672909 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:39.652019 23871 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:39.681005 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.631006 24053 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:06:39.678325 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:39.659868 24137 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.675411 24171 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.689970 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:39.700631 24216 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:39.701119 21866 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.701727 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:39.679375 24070 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:39.709095 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.709651 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:39.675242 24184 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.729384 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:39.724575 21873 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.707624 24153 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:39.733410 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 55519.1us
W20260709 13:06:39.734290 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 52650.5us
I20260709 13:06:39.736243 21872 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:39.713798 24070 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:39.737859 21914 connection.cc:256] RPC call timeout handler was delayed by -1.029320384000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:06:39.704152 23993 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.713162 24211 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:06:39.744109 23750 raft_consensus.cc:2764] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:06:39.744570 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:39.672437 24150 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.692516 23640 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.741988 24070 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:39.766144 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.737706 24105 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:39.768901 24150 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.786615 21873 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:39.791401 24149 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.813767 21916 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:39.749524 22604 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:39.806835 24171 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.829042 24210 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:39.831126 24149 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:39.840304 24149 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:39.841888 24149 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.845504 24149 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.848395 24149 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:39.849256 24149 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.852147 24149 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:39.853880 24171 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:39.855844 21866 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:39.828281 24178 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:39.905419 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:39.934298 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.984475 21868 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:06:40.001691 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 139134us
I20260709 13:06:40.001705 21872 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:39.979422 24149 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:40.021816 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.022317 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.997840 23881 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.026584 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 335817us
W20260709 13:06:40.025555 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.031088 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.004732 24137 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.001804 21945 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:40.015197 24184 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:40.026623 24136 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:40.038743 23993 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:40.073067 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.072506 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 320386us
I20260709 13:06:40.037458 24197 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:40.038193 24149 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:40.080633 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:40.028549 23881 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:40.075546 24136 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:40.150053 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.071357 24137 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:40.140843 23987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.014s	sys 0.018s
W20260709 13:06:40.141906 24218 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:06:40.126235 23640 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:40.136039 23883 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:40.175917 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:40.146354 24226 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:40.123684 24087 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
W20260709 13:06:40.174348 23987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.016s	sys 0.018s
I20260709 13:06:40.183652 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:40.176496 23993 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.173161 24178 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:40.195185 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.199043 24107 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:40.265836 24153 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.275105 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:40.277766 22604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 482) took 1579 ms (client timeout 2101 ms). Trace:
I20260709 13:06:40.277781 21944 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:40.282872 21948 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:06:40.291968 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.292389 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:40.304267 24202 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:40.306110 22015 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:40.183099 24171 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:40.177016 24053 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:40.333250 24231 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:06:40.334185 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:40.337096 21867 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:40.346624 23993 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:40.337560 24235 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:40.339221 24232 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:06:40.339582 23881 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:40.187216 23640 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.340111 23883 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:40.340898 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 285138us
I20260709 13:06:40.343946 24149 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:40.321997 24226 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:40.345995 24137 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:40.362589 23871 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.000s
I20260709 13:06:40.327940 24107 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:40.363361 22601 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:40.393453 21870 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:40.379063 24178 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:40.419797 23881 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.421975 22576 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.754s (SENT)
W20260709 13:06:40.443073 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.452834 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.388957 24153 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:40.477931 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:40.466634 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:40.359083 22604 rpcz_store.cc:269] 0709 13:06:38.698796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.725255 (+ 26459us) service_pool.cc:224] Handling call
0709 13:06:39.334474 (+609219us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:40.277527 (+943053us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540067f2d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:40.277670 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245661440}
I20260709 13:06:40.510376 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:40.466357 23640 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:06:40.514145 24242 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:06:40.514425 23883 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:40.515709 23640 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:40.516428 24070 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.000s
I20260709 13:06:40.516481 24251 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.517267 24224 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:06:40.517186 24070 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:40.519116 24244 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.519307 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2073) took 1144 ms. Trace:
I20260709 13:06:40.519891 24070 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:40.403349 24136 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:40.506592 23881 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:40.519764 22019 rpcz_store.cc:276] 0709 13:06:39.375023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.402541 (+ 27518us) service_pool.cc:224] Handling call
0709 13:06:39.426474 (+ 23933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.452931 (+ 26457us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:39.453417 (+   486us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.599234 (+145817us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b18003b3bc0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:39.802344 (+203110us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18003b3bc0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:39.813381 (+ 11037us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.865713 (+ 52332us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.865854 (+   141us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:39.865887 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.865948 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.518936 (+652988us) raft_consensus.cc:1685] finished
0709 13:06:40.518962 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.519121 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53860,"prepare.queue_time_us":772,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":8086,"raft.queue_time_us":35868,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":8356,"spinlock_wait_cycles":31902848,"thread_start_us":251872,"threads_started":1,"wal-append.queue_time_us":536005}
I20260709 13:06:40.522830 23881 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:40.507002 21946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:48038
W20260709 13:06:40.525557 24227 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:06:40.517381 24251 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:40.530043 24053 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:40.530412 24107 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:40.531848 24107 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.534114 24153 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:40.535122 24031 consensus_meta.cc:287] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.901s	user 0.004s	sys 0.005s
W20260709 13:06:40.535553 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 113605us
I20260709 13:06:40.535784 24031 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:40.537112 24171 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:40.537714 24178 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:40.537809 24171 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:40.541610 24250 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:06:40.545220 22573 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:40.546465 23973 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:40.546909 23973 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.537554 24197 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:40.547412 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.547430 23973 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:40.549574 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:40.550252 21949 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:40.551627 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.540310 24178 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:40.585538 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 118726us
I20260709 13:06:40.540338 24171 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:40.590467 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.600621 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 50589.9us
I20260709 13:06:40.525629 21944 pending_rounds.cc:85] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 6
I20260709 13:06:40.426184 24202 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:40.604803 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 330706us
I20260709 13:06:40.534011 24251 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:40.530089 24226 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:40.575675 24070 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:40.572520 24184 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:40.635540 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:40.625746 24259 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.628986 23780 consensus_meta.cc:287] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.089s	user 0.010s	sys 0.006s
I20260709 13:06:40.606870 24053 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:40.626637 24150 consensus_meta.cc:287] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.006s
I20260709 13:06:40.609426 21944 pending_rounds.cc:107] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:40.661109 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:40.519799 24244 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:40.632375 24070 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:40.674927 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:40.675761 21870 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:40.660301 22602 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:40.693001 21871 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:40.679054 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:40.678208 24254 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:06:40.683633 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:40.685045 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:40.685544 24031 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:40.642714 24184 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:40.660527 24259 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:40.780372 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 151938us
W20260709 13:06:40.863148 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61535.3us
W20260709 13:06:40.961393 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 252382us
W20260709 13:06:40.864573 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 87673.4us
W20260709 13:06:40.973678 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.974227 21949 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:40.697873 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:40.988699 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 357339us
I20260709 13:06:40.671656 21944 raft_consensus.cc:2889] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:40.956341 24247 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
W20260709 13:06:40.989609 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 359506us
I20260709 13:06:40.992758 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:40.784013 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.994278 24263 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:06:40.908047 22015 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:41.006444 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 233) took 1026 ms. Trace:
W20260709 13:06:41.000962 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.991154 22016 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:06:41.034739 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43811.3us
I20260709 13:06:40.686560 23883 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:40.679127 24070 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:41.007007 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 373134us
I20260709 13:06:40.965307 23993 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:40.989121 22018 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:06:41.016232 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.660692 23780 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:41.033931 21873 rpcz_store.cc:276] 0709 13:06:39.979726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.979924 (+   198us) service_pool.cc:224] Handling call
0709 13:06:39.980297 (+   373us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:40.007050 (+ 26753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.007082 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:40.016338 (+  9256us) log.cc:844] Serialized 78 byte log entry
0709 13:06:40.124639 (+108301us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.452634 (+327995us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.453717 (+  1083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.453816 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.006156 (+552340us) raft_consensus.cc:1685] finished
0709 13:06:41.006184 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.006375 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12328,"prepare.queue_time_us":711107,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":57,"raft.queue_time_us":109849,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":66625,"thread_start_us":341524,"threads_started":2,"wal-append.queue_time_us":393633}
I20260709 13:06:41.039382 22574 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:40.776681 23871 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.073550 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:41.075232 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:41.075937 21949 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.076505 24053 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.047278 24171 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:41.006268 24166 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.081538 24166 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:41.057353 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 84777.8us
I20260709 13:06:41.083890 24166 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:41.084275 23640 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:41.085992 24150 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:41.086525 24150 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:41.088564 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:41.058343 24169 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:41.090001 24169 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.091358 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2080) took 1527 ms. Trace:
I20260709 13:06:41.092171 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1623) took 1445 ms. Trace:
W20260709 13:06:41.093567 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.058670 23973 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:41.060204 24256 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.075s	user 0.001s	sys 0.002s
I20260709 13:06:41.004755 24268 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:41.061671 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 197) took 1506 ms. Trace:
I20260709 13:06:41.062135 24137 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:41.063191 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:41.065284 24202 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:41.069330 23611 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.412s	user 0.004s	sys 0.013s
I20260709 13:06:41.072113 24259 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:41.126444 24137 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:41.003291 22049 heartbeater.cc:646] Failed to heartbeat to 127.20.69.62:45563 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.69.62:45563 timed out after 15.000s (SENT)
I20260709 13:06:41.091754 22017 rpcz_store.cc:276] 0709 13:06:39.564425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.579091 (+ 14666us) service_pool.cc:224] Handling call
0709 13:06:39.631367 (+ 52276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.721616 (+ 90249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.721658 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.755266 (+ 33608us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.029106 (+273840us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:40.029140 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.029218 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.091142 (+1061924us) raft_consensus.cc:1685] finished
0709 13:06:41.091163 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.091302 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20603,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5418,"thread_start_us":217148,"threads_started":1,"wal-append.queue_time_us":1236885}
I20260709 13:06:41.092551 21948 rpcz_store.cc:276] 0709 13:06:39.646845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.648193 (+  1348us) service_pool.cc:224] Handling call
0709 13:06:40.282435 (+634242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.359703 (+ 77268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.091979 (+732276us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54003d31d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:41.092115 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457762048}
I20260709 13:06:41.111276 21949 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:40.862556 23750 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.185s
I20260709 13:06:41.126619 21950 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.092437 24169 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:41.117069 21942 rpcz_store.cc:276] 0709 13:06:39.555260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.555405 (+   145us) service_pool.cc:224] Handling call
0709 13:06:39.581017 (+ 25612us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:39.614175 (+ 33158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.614212 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:39.660515 (+ 46303us) log.cc:844] Serialized 52 byte log entry
0709 13:06:40.034711 (+374196us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:40.051200 (+ 16489us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.051464 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.051566 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.061456 (+1009890us) raft_consensus.cc:1685] finished
0709 13:06:41.061477 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.061615 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16497,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":4932,"raft.queue_time_us":10832,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":15054,"spinlock_wait_cycles":8193280,"thread_start_us":346211,"threads_started":1,"wal-append.queue_time_us":830632}
I20260709 13:06:41.038424 23883 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:41.099960 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.117143 24166 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:41.057274 24244 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:41.112517 24226 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.126667 24031 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.116567 24149 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.112730 24171 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:41.144829 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:41.149015 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 85906.2us
I20260709 13:06:41.164131 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:41.205279 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:41.253736 21949 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:41.205634 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2025) took 1494 ms. Trace:
I20260709 13:06:41.141315 23640 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:41.264765 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 119660us
I20260709 13:06:41.255259 21869 rpcz_store.cc:276] 0709 13:06:39.658291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.658926 (+   635us) service_pool.cc:224] Handling call
0709 13:06:39.677176 (+ 18250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.035006 (+357830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.035055 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.072486 (+ 37431us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.418912 (+346426us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:40.419709 (+   797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.090870 (+671161us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b54003acd54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:41.090913 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.147104 (+ 56191us) raft_consensus.cc:1685] finished
0709 13:06:41.147123 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.153099 (+  5976us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3684,"raft.queue_time_us":100577,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":146707840,"thread_start_us":551904,"threads_started":2,"wal-append.queue_time_us":497441}
I20260709 13:06:41.142472 24137 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:41.243649 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 87544.6us
I20260709 13:06:41.164400 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:41.225723 24107 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.000s
I20260709 13:06:41.263095 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:41.266930 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 122188us
I20260709 13:06:41.307901 21987 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:41.308995 21949 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:41.224488 24251 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.147766 23883 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:41.204854 24252 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:06:41.146802 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:41.206105 24150 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:41.272527 22601 consensus_meta.cc:287] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.004s
I20260709 13:06:41.261294 23640 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:41.205751 24053 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.148s
W20260709 13:06:41.348474 22576 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.381s (SENT)
W20260709 13:06:41.365113 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 112487us
I20260709 13:06:41.274473 23750 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:41.371471 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 227376us
I20260709 13:06:41.256665 24226 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.148224 24268 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:41.384191 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:41.266666 24031 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.378302 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:41.364670 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:41.382963 24265 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:41.283978 24149 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.374784 24166 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:41.366585 24211 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.372166 23640 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.371801 24251 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:41.395901 21841 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.536s (SENT)
I20260709 13:06:41.366869 22601 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:41.385569 22604 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:41.424096 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:41.437461 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:41.396678 23750 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:41.403906 24211 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:41.476219 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.453068 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.484912 24240 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.485072 23973 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:41.485720 24240 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:41.495790 23973 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:41.495971 24163 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:41.431041 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 493) took 1161 ms. Trace:
W20260709 13:06:41.499650 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 150733us
I20260709 13:06:41.314733 24202 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:06:41.496291 23973 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.483004 24244 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:41.488435 24253 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:41.435977 23780 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:41.568920 24271 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:41.493037 24107 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.494803 24211 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.583597 23973 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:41.591734 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 198313us
W20260709 13:06:41.600307 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 227351us
W20260709 13:06:41.589275 24270 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:06:41.500511 22601 rpcz_store.cc:276] 0709 13:06:40.270173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.274703 (+  4530us) service_pool.cc:224] Handling call
0709 13:06:41.429186 (+1154483us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.613255 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 301908us
I20260709 13:06:41.568528 24163 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:41.614481 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.624s (SENT) [suppressed 44 similar messages]
I20260709 13:06:41.622705 24287 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:41.623234 24279 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:06:41.624217 24275 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:41.593526 24244 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.625877 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1630) took 1829 ms. Trace:
I20260709 13:06:41.626298 21947 rpcz_store.cc:276] 0709 13:06:39.796985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.797153 (+   168us) service_pool.cc:224] Handling call
0709 13:06:39.797621 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.798138 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.798173 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.798755 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.062975 (+264220us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:40.063022 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.063095 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.625601 (+1562506us) raft_consensus.cc:1685] finished
0709 13:06:41.625630 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.625803 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1402,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":161,"thread_start_us":263771,"threads_started":1,"wal-append.queue_time_us":1795545}
I20260709 13:06:41.597549 24269 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.605553 24240 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:41.623003 24255 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:41.624963 24274 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 13:06:41.592731 24271 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.493643 24171 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.636276 21988 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:41.659850 21841 leader_election.cc:336] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.691s (SENT)
I20260709 13:06:41.628284 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:41.630857 24150 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.660369 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:41.583446 24166 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:41.826216 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.615762 24253 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.829828 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:41.830493 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
W20260709 13:06:41.835232 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 77224.8us
I20260709 13:06:41.662078 24031 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:41.666738 24107 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.857055 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2031) took 1741 ms. Trace:
W20260709 13:06:41.859565 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 238375us
I20260709 13:06:41.827726 24149 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:41.827430 24240 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.862955 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:41.903395 21947 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:41.841473 24244 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:41.902076 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.857488 21872 rpcz_store.cc:276] 0709 13:06:40.115508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.115985 (+   477us) service_pool.cc:224] Handling call
0709 13:06:40.141194 (+ 25209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.185675 (+ 44481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.185706 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.323298 (+137592us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.569295 (+245997us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:40.569350 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.569440 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.274411 (+704971us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800408640. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f85522 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:41.849393 (+574982us) raft_consensus.cc:1685] finished
0709 13:06:41.849412 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.856993 (+  7581us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37390,"raft.queue_time_us":195355,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8287,"spinlock_wait_cycles":26142592,"thread_start_us":175583,"threads_started":1,"wal-append.queue_time_us":763193}
W20260709 13:06:41.936844 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 282304us
I20260709 13:06:41.941934 24226 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:41.854938 24251 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:41.840134 24150 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:41.954910 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2034) took 1832 ms. Trace:
I20260709 13:06:41.960778 21868 rpcz_store.cc:276] 0709 13:06:40.122444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.297963 (+175519us) service_pool.cc:224] Handling call
0709 13:06:40.298378 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.605517 (+307139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.605553 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.650853 (+ 45300us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.849396 (+198543us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:40.849453 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.849556 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.954723 (+1105167us) raft_consensus.cc:1685] finished
0709 13:06:41.954736 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.954862 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50425,"raft.queue_time_us":104159,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":18899,"thread_start_us":343969,"threads_started":2,"wal-append.queue_time_us":1279283}
I20260709 13:06:41.955643 24163 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:41.956681 24253 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:41.957144 24241 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.620s	user 0.006s	sys 0.000s
I20260709 13:06:41.958246 21946 raft_consensus.cc:606] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:41.632109 23750 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:41.963893 21946 raft_consensus.cc:614] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:41.964452 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48038 (request call id 15) took 1544 ms. Trace:
I20260709 13:06:41.965456 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1634) took 1905 ms. Trace:
I20260709 13:06:41.959457 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2036) took 1836 ms. Trace:
I20260709 13:06:41.965827 21950 rpcz_store.cc:276] 0709 13:06:40.060215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.068905 (+  8690us) service_pool.cc:224] Handling call
0709 13:06:40.089265 (+ 20360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.143333 (+1054068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.965206 (+821873us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400287dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:41.965395 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2380420864}
I20260709 13:06:41.976575 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:41.900197 24275 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:41.964794 21946 rpcz_store.cc:276] 0709 13:06:40.428280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.428581 (+   301us) service_pool.cc:224] Handling call
0709 13:06:41.958063 (+1529482us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04ec40 00007f635b03abb9 00007f635b03a47c 00007f63545c07d4
0709 13:06:41.964364 (+  6301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24314240}
I20260709 13:06:41.978747 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:41.979833 21841 leader_election.cc:336] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.747s (SENT)
I20260709 13:06:41.980011 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:41.981837 21950 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:41.984776 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:41.985394 21947 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.966281 21867 rpcz_store.cc:276] 0709 13:06:40.123112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.402522 (+279410us) service_pool.cc:224] Handling call
0709 13:06:40.428677 (+ 26155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.498516 (+ 69839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.498558 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.523758 (+ 25200us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.626404 (+102646us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:40.626453 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.626529 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.624189 (+997660us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:41.959136 (+334947us) raft_consensus.cc:1685] finished
0709 13:06:41.959162 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.959389 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69563,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":84707072,"thread_start_us":102100,"threads_started":1,"wal-append.queue_time_us":736432}
W20260709 13:06:41.990517 22576 leader_election.cc:336] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.632s (SENT)
I20260709 13:06:41.994272 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:41.995468 21946 raft_consensus.cc:2410] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:42.004751 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.009784 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2038) took 1886 ms. Trace:
I20260709 13:06:42.010247 21866 rpcz_store.cc:276] 0709 13:06:40.123797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.543815 (+420018us) service_pool.cc:224] Handling call
0709 13:06:40.544198 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.544620 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.544653 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.548990 (+  4337us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.973528 (+424538us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.054291 (+ 80763us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.113294 (+ 59003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.113383 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.009531 (+896148us) raft_consensus.cc:1685] finished
0709 13:06:42.009556 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.009707 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9639,"prepare.queue_time_us":107213,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":69049,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":20617,"spinlock_wait_cycles":33703808,"thread_start_us":149539,"threads_started":2,"wal-append.queue_time_us":864622}
I20260709 13:06:41.990022 24202 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:42.016587 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 43752.8us
I20260709 13:06:42.021430 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:42.022140 21946 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.018790 24202 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:42.027047 24291 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:06:42.041077 22602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 491) took 2133 ms (client timeout 2069 ms). Trace:
I20260709 13:06:42.041795 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 200) took 1624 ms. Trace:
W20260709 13:06:42.041594 22602 rpcz_store.cc:269] 0709 13:06:39.908161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.934577 (+ 26416us) service_pool.cc:224] Handling call
0709 13:06:40.292188 (+357611us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:42.040832 (+1748644us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54000519d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:42.040997 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565003264}
I20260709 13:06:42.042385 21944 rpcz_store.cc:276] 0709 13:06:40.417250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.428695 (+ 11445us) service_pool.cc:224] Handling call
0709 13:06:40.525267 (+ 96572us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:41.094071 (+568804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.094105 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:41.094756 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 13:06:41.571771 (+477015us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:41.578537 (+  6766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.583224 (+  4687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.041563 (+458339us) raft_consensus.cc:1685] finished
0709 13:06:42.041587 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.041736 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1510,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":31159,"thread_start_us":416503,"threads_started":1,"wal-append.queue_time_us":534090}
I20260709 13:06:42.044293 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.045679 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.046430 21944 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:42.047173 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.047847 21944 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
W20260709 13:06:42.034963 24277 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 13:06:42.039278 23973 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:42.040244 24271 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:42.044358 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.051332 21942 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
W20260709 13:06:42.036142 21841 leader_election.cc:336] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.000s (SENT)
I20260709 13:06:42.052484 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:42.053660 21950 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:42.054651 24271 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:42.055801 21841 leader_election.cc:336] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.016s (SENT)
I20260709 13:06:42.056499 23973 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:42.057174 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:42.058058 24271 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:42.058516 24257 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.649s	user 0.000s	sys 0.003s
W20260709 13:06:42.059721 21841 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.109s (SENT)
I20260709 13:06:42.064188 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.041100 24290 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:06:42.061618 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.076077 21947 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:42.065569 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2029) took 1995 ms. Trace:
I20260709 13:06:42.088414 21946 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:42.078223 21916 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:42.085155 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:42.089602 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 67097us
I20260709 13:06:42.090982 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.033035 24202 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.029481 24240 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:42.079262 23883 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.002s
I20260709 13:06:42.106895 21916 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:42.113943 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.116168 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1638) took 1248 ms. Trace:
I20260709 13:06:42.116617 21949 rpcz_store.cc:276] 0709 13:06:40.867833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.115279 (+1247446us) service_pool.cc:224] Handling call
0709 13:06:42.115566 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.115748 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.115799 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.115856 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.115899 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.115969 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.116098 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.121891 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 207) took 1582 ms. Trace:
I20260709 13:06:42.122337 21946 rpcz_store.cc:276] 0709 13:06:40.539059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.121118 (+1582059us) service_pool.cc:224] Handling call
0709 13:06:42.121414 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.121571 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.121596 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.121635 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.121666 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.121714 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.121819 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.088099 24107 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.098085 21875 rpcz_store.cc:276] 0709 13:06:40.070178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.070357 (+   179us) service_pool.cc:224] Handling call
0709 13:06:40.121628 (+ 51271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:40.122215 (+   587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.122262 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:40.122949 (+   687us) log.cc:844] Serialized 52 byte log entry
0709 13:06:40.165042 (+ 42093us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:40.459381 (+294339us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.542364 (+ 82983us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.544447 (+  2083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.545286 (+   839us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.057924 (+1512638us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:42.065258 (+  7334us) raft_consensus.cc:1685] finished
0709 13:06:42.065283 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.065411 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101080,"prepare.queue_time_us":1321111,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":86,"raft.queue_time_us":342578,"raft.run_cpu_time_us":495,"raft.run_wall_time_us":39769,"spinlock_wait_cycles":30625024,"thread_start_us":172579,"threads_started":2,"wal-append.queue_time_us":1237662}
I20260709 13:06:42.132895 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1640) took 1075 ms. Trace:
I20260709 13:06:42.091871 24281 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.136873 21949 rpcz_store.cc:276] 0709 13:06:41.057077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.131827 (+1074750us) service_pool.cc:224] Handling call
0709 13:06:42.132228 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.132453 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.132489 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.132548 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:42.132591 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.132682 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.132821 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.094099 24282 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.149098 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 89422.3us
I20260709 13:06:42.150195 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 237) took 1520 ms. Trace:
I20260709 13:06:42.139628 24271 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.131034 24255 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:42.172092 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.124544 24259 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:42.164275 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 208) took 1042 ms. Trace:
I20260709 13:06:42.173936 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.176575 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.179165 21946 rpcz_store.cc:276] 0709 13:06:41.121585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.134005 (+1012420us) service_pool.cc:224] Handling call
0709 13:06:42.163542 (+ 29537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.163820 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.163866 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.163925 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:42.163970 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.164043 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.164195 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.180792 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:42.185925 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.149153 21947 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:42.187368 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1639) took 1130 ms. Trace:
I20260709 13:06:42.188037 21947 rpcz_store.cc:276] 0709 13:06:41.056767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.130969 (+1074202us) service_pool.cc:224] Handling call
0709 13:06:42.148980 (+ 18011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.187135 (+ 38155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.187313 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:42.177771 24070 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.124s	user 0.013s	sys 0.000s
I20260709 13:06:42.191627 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:42.114305 23883 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:42.172706 21870 rpcz_store.cc:276] 0709 13:06:40.630216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.755909 (+125693us) service_pool.cc:224] Handling call
0709 13:06:40.990296 (+234387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.136374 (+146078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.136409 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.148756 (+ 12347us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.478900 (+330144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:41.478944 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.479023 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.149978 (+670955us) raft_consensus.cc:1685] finished
0709 13:06:42.149997 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.150134 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":525,"raft.queue_time_us":37522,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":3384,"thread_start_us":163466,"threads_started":1,"wal-append.queue_time_us":583351}
I20260709 13:06:42.177577 24255 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.182614 24259 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.142843 24163 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:06:42.141966 24107 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.153836 24240 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.181782 24282 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.197659 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.288352 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.217365 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:42.289506 22024 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:06:42.289513 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 146309us
I20260709 13:06:42.290870 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.291754 21946 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:42.292250 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.227227 22576 leader_election.cc:336] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.379s (SENT)
I20260709 13:06:42.297783 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.250986 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 125235us
W20260709 13:06:42.290167 24137 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.938s	user 0.010s	sys 0.001s
I20260709 13:06:42.298640 21949 raft_consensus.cc:2410] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:42.289402 24211 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.001s
I20260709 13:06:42.302038 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:42.267855 21841 leader_election.cc:336] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.167s (SENT)
I20260709 13:06:42.303282 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:42.305218 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.307168 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:42.309448 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.309820 21949 raft_consensus.cc:2376] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7. Re-sending same reply.
I20260709 13:06:42.184788 24281 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:42.311609 22021 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:42.294690 24235 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:42.299861 24299 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.187s	user 0.003s	sys 0.000s
I20260709 13:06:42.296954 24259 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.247473 24184 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:42.311575 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.312973 21838 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 3.040s (SENT)
I20260709 13:06:42.313369 23881 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:42.313616 24261 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.982s	user 0.004s	sys 0.000s
I20260709 13:06:42.299976 23883 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:42.197233 24070 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.321496 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.301128 24255 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.332720 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:42.333650 21949 raft_consensus.cc:2376] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5. Re-sending same reply.
W20260709 13:06:42.350309 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 48379.6us
I20260709 13:06:42.329609 23881 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.308864 24053 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:06:42.307209 24137 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:42.354272 24305 raft_consensus.cc:3055] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.354686 24305 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:42.355858 24137 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:42.355628 24305 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.307521 24211 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:42.329819 24238 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.358284 24211 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:42.353570 23881 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:42.400264 24300 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:06:42.406375 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.409205 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49618.7us
I20260709 13:06:42.540287 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.421372 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.572508 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 359392us
W20260709 13:06:42.433736 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 129789us
W20260709 13:06:42.568440 23640 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.117s	user 0.012s	sys 0.000s
I20260709 13:06:42.575248 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.602033 21946 raft_consensus.cc:2410] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:42.573429 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 229) took 3127 ms. Trace:
I20260709 13:06:42.447803 23611 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:42.602977 23611 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:42.603492 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.604117 23611 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.605227 23611 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.605142 23881 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.447551 24282 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:42.562536 24278 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.193s	user 0.000s	sys 0.009s
W20260709 13:06:42.539459 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 271632us
W20260709 13:06:42.597548 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.409430 24184 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:42.604323 21945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 202) took 2155 ms (client timeout 2141 ms). Trace:
W20260709 13:06:42.626319 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.566605 24273 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.966s	user 0.002s	sys 0.008s
W20260709 13:06:42.573732 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 269685us
W20260709 13:06:42.524894 24277 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:06:42.628430 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.538432 24107 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:42.628743 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.602445 21871 rpcz_store.cc:276] 0709 13:06:39.443147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.448097 (+  4950us) service_pool.cc:224] Handling call
0709 13:06:39.574165 (+126068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.693443 (+1119278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.569626 (+1876183us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540002b554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:42.569985 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572175616}
I20260709 13:06:42.644402 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.629572 21945 rpcz_store.cc:269] 0709 13:06:40.449001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.498999 (+ 49998us) service_pool.cc:224] Handling call
0709 13:06:42.053136 (+1554137us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:42.603318 (+550182us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4de9c 00007f6352f4da5b 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:42.604257 (+   939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53615232}
I20260709 13:06:42.438752 24305 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.445967 24303 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.209s
I20260709 13:06:42.633010 24184 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.600107 24268 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:42.634191 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.635427 24259 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:42.629331 24038 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 13:06:42.638178 24202 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 13:06:42.638054 23881 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:42.653976 21947 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:42.639648 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:42.643388 24255 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.411823 24281 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:42.626236 23640 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:42.650909 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:42.652055 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.651590 21949 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:42.654767 21950 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.572217 24169 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:42.650825 24070 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:42.660743 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:42.661666 24228 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 1.666s	user 0.023s	sys 0.057s
W20260709 13:06:42.662919 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.664086 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 486) took 3207 ms. Trace:
I20260709 13:06:42.664520 22603 rpcz_store.cc:276] 0709 13:06:39.456761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.458302 (+  1541us) service_pool.cc:224] Handling call
0709 13:06:39.458734 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.459246 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.459282 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.638131 (+178849us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.982573 (+344442us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:39.984818 (+  2245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.997410 (+ 12592us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.656187 (+2658777us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:42.662841 (+  6654us) raft_consensus.cc:1685] finished
0709 13:06:42.663770 (+   929us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.663997 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24076,"raft.queue_time_us":43293,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":28309,"spinlock_wait_cycles":29495040,"thread_start_us":325857,"threads_started":1,"wal-append.queue_time_us":1356774}
I20260709 13:06:42.666774 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.654873 24268 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.668547 24268 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.668887 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.670013 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.670253 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.669821 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.672545 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.683149 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 204) took 2202 ms. Trace:
I20260709 13:06:42.708546 21950 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:42.679606 24070 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:42.705847 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.705955 21946 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:42.707726 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 209) took 1571 ms. Trace:
I20260709 13:06:42.681615 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:42.711485 21942 rpcz_store.cc:276] 0709 13:06:41.137852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.670931 (+1533079us) service_pool.cc:224] Handling call
0709 13:06:42.707289 (+ 36358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.707445 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.707468 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.707502 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.707537 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.707581 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.707673 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.712422 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1642) took 1054 ms. Trace:
I20260709 13:06:42.713860 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:42.714648 24240 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:42.715953 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:42.717259 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:42.717512 24087 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:42.717960 24087 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.718302 24087 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.712797 21946 rpcz_store.cc:276] 0709 13:06:41.657925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.688137 (+1030212us) service_pool.cc:224] Handling call
0709 13:06:42.689770 (+  1633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.712169 (+ 22399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.712373 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.719089 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.719769 21949 raft_consensus.cc:2368] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:42.712417 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:42.659096 24169 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:42.738474 24169 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:42.709395 21943 rpcz_store.cc:276] 0709 13:06:40.480813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.540839 (+ 60026us) service_pool.cc:224] Handling call
0709 13:06:40.541367 (+   528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.541880 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.541922 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.542521 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.987390 (+444869us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:40.987679 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.987812 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.561878 (+1574066us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:42.681220 (+119342us) raft_consensus.cc:1685] finished
0709 13:06:42.681251 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.682976 (+  1725us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2675,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":93759360,"thread_start_us":349345,"threads_started":1,"wal-append.queue_time_us":676903}
I20260709 13:06:42.739876 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.711268 23640 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:42.740983 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:42.724318 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:42.657330 24202 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:42.720563 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.719643 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.734754 24268 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:42.709959 24259 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:42.740067 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.712669 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.750116 21942 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:42.750975 21988 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:42.752180 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:42.755487 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:42.757712 22576 leader_election.cc:336] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.550s (SENT)
I20260709 13:06:42.758338 21942 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.762197 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:42.762322 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:42.763931 21942 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:42.766255 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.720897 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:42.767210 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.767580 22023 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:42.769622 22017 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.773765 24150 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:42.771787 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:42.775695 22603 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:42.762250 24178 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:42.777427 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:42.778764 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:42.779332 22019 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.779779 24107 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:42.780191 24107 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:42.780844 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:42.780993 24107 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:42.782022 24107 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:42.753764 24240 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:42.786489 21946 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:42.759550 24281 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.776329 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:42.792573 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.795413 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:42.802037 21949 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:42.796520 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 84159.9us
W20260709 13:06:42.800107 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.804253 22573 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:42.754045 24070 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:42.809512 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47687.6us
I20260709 13:06:42.791445 24240 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:42.860978 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 134650us
W20260709 13:06:42.866367 22576 leader_election.cc:336] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.589s (SENT)
I20260709 13:06:42.867057 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:42.797200 24178 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:42.797806 24281 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:42.825484 22015 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.898614 24310 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:06:42.896478 24281 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.874379 24240 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:42.940682 24255 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:42.941259 24070 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:42.852401 24087 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:42.976526 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.060075 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.146690 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.140668 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 430048us
W20260709 13:06:43.110369 21773 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 283) took 18458 ms (client timeout 15000 ms). Trace:
W20260709 13:06:43.147207 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 280889us
W20260709 13:06:43.149191 22576 leader_election.cc:336] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 3.027s (SENT)
I20260709 13:06:43.149713 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:43.146945 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.145925 22019 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
W20260709 13:06:43.147904 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.078738 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 215) took 1225 ms. Trace:
I20260709 13:06:43.151420 21916 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:43.169768 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.172809 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.136224 24285 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.723s	user 0.005s	sys 0.006s
W20260709 13:06:43.175726 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 311713us
I20260709 13:06:43.172961 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:43.183760 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.183895 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 379702us
I20260709 13:06:43.057361 24137 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.193764 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:43.095528 24184 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:43.191643 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:43.187270 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:43.196049 22020 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.191936 21948 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:43.192268 21872 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:42.968116 24202 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:43.208369 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:43.186441 21943 rpcz_store.cc:276] 0709 13:06:41.853070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.740820 (+887750us) service_pool.cc:224] Handling call
0709 13:06:42.741111 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.741296 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:42.741542 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.078362 (+336820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:43.078418 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:43.078464 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.078540 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.078675 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":869,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":5535,"raft.queue_time_us":98,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":336475,"threads_started":1}
I20260709 13:06:43.206233 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:43.204691 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:43.180425 24255 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:43.172029 24259 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:06:43.190701 23611 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:43.187500 24312 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:06:43.128994 24178 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:43.403373 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.722741 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.238344 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:43.754961 22608 raft_consensus.cc:2368] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6.
I20260709 13:06:43.756270 24070 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:43.427989 24327 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:43.756712 24070 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:43.737247 24314 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:06:43.495195 24107 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.001s
I20260709 13:06:43.757447 24327 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:06:43.472126 24315 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:06:43.758253 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2104) took 1560 ms. Trace:
I20260709 13:06:43.757934 24070 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:43.238289 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:43.290598 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.759605 22609 raft_consensus.cc:2376] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5. Re-sending same reply.
I20260709 13:06:43.758677 22024 rpcz_store.cc:276] 0709 13:06:42.293309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.293762 (+   453us) service_pool.cc:224] Handling call
0709 13:06:42.301573 (+  7811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.630883 (+329310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.630912 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.650550 (+ 19638us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.796218 (+145668us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.796253 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.796316 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.758049 (+961733us) raft_consensus.cc:1685] finished
0709 13:06:43.758067 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.758192 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40803,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":439266,"threads_started":2,"wal-append.queue_time_us":872348}
I20260709 13:06:43.192934 24137 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:43.378628 24281 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:43.338095 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:43.472066 21768 catalog_manager.cc:5697] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:43.762243 22022 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:43.762322 21870 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:43.467671 22020 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:43.764111 24281 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:43.208894 21868 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:43.482487 22607 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:43.238533 21871 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.429939 21944 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:43.205862 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:43.148797 21773 rpcz_store.cc:269] 0709 13:06:24.654225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.801814 (+147589us) service_pool.cc:224] Handling call
0709 13:06:43.110230 (+18308416us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:39.629495 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:39.854829 (+225334us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:39.861835 (+  7006us) write_op.cc:435] Acquired schema lock
0709 13:06:39.864762 (+  2927us) tablet.cc:662] Decoding operations
0709 13:06:40.005038 (+140276us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:40.015462 (+ 10424us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:40.021174 (+  5712us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:40.124521 (+103347us) tablet.cc:701] Row locks acquired
0709 13:06:40.136744 (+ 12223us) write_op.cc:260] PREPARE: finished
0709 13:06:40.176111 (+ 39367us) write_op.cc:270] Start()
0709 13:06:40.190666 (+ 14555us) write_op.cc:276] Timestamp: P: 1783602400167141 usec, L: 0
0709 13:06:40.262999 (+ 72333us) op_driver.cc:348] REPLICATION: starting
0709 13:06:40.498773 (+235774us) log.cc:844] Serialized 535 byte log entry
0709 13:06:41.978540 (+1479767us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:42.274673 (+296133us) op_driver.cc:464] REPLICATION: finished
0709 13:06:42.307036 (+ 32363us) write_op.cc:301] APPLY: starting
0709 13:06:42.312544 (+  5508us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:42.334538 (+ 21994us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:42.350531 (+ 15993us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:42.404923 (+ 54392us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:42.410985 (+  6062us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:42.411039 (+    54us) write_op.cc:312] APPLY: finished
0709 13:06:42.411357 (+   318us) log.cc:844] Serialized 23 byte log entry
0709 13:06:42.411554 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.411636 (+    82us) write_op.cc:454] Released schema lock
0709 13:06:42.411698 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:42.412108 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.412138 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11815,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":31981,"apply.run_cpu_time_us":2505,"apply.run_wall_time_us":105104,"num_ops":1,"prepare.queue_time_us":338997,"prepare.run_cpu_time_us":36517,"prepare.run_wall_time_us":1350541,"raft.queue_time_us":224726,"raft.run_cpu_time_us":17116,"raft.run_wall_time_us":32377,"replication_time_us":1952843,"spinlock_wait_cycles":13060480,"thread_start_us":517279,"threads_started":4,"wal-append.queue_time_us":1092798}]]}
W20260709 13:06:43.758571 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 609368us
I20260709 13:06:43.761328 24137 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:43.458253 22015 consensus_meta.cc:287] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.000s
W20260709 13:06:43.584131 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 405472us
W20260709 13:06:43.768857 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 620054us
I20260709 13:06:43.829936 22015 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
W20260709 13:06:43.785993 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.830790 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2121) took 1058 ms. Trace:
W20260709 13:06:43.830054 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.573025 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 388005us
W20260709 13:06:43.831331 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.471863 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 203) took 2962 ms. Trace:
I20260709 13:06:43.344547 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:43.379686 22604 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:06:43.831923 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.835446 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.633816 24240 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.692s	user 0.006s	sys 0.005s
I20260709 13:06:43.687534 24310 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:43.844180 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.831292 22015 rpcz_store.cc:276] 0709 13:06:42.772084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.776100 (+  4016us) service_pool.cc:224] Handling call
0709 13:06:43.830720 (+1054620us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:43.378475 24305 consensus_meta.cc:287] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.001s
W20260709 13:06:43.836064 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.840222 21867 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:43.842789 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.870919 21874 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:43.828995 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2122) took 1056 ms. Trace:
I20260709 13:06:43.871824 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2049) took 1050 ms. Trace:
I20260709 13:06:43.872316 21874 rpcz_store.cc:276] 0709 13:06:42.821576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.853123 (+ 31547us) service_pool.cc:224] Handling call
0709 13:06:43.843743 (+990620us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:43.843945 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.871471 (+ 27526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.871752 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5198720}
I20260709 13:06:43.781936 21869 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:43.847935 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:43.440557 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:43.782401 24318 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.864023 21871 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:43.279284 22601 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:43.376580 24087 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:43.758527 24327 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:43.860265 24240 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:43.840333 24070 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.440294 24317 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.436s
I20260709 13:06:43.854486 23611 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:43.840083 24321 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.279660 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:43.835729 24281 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:43.832546 21941 rpcz_store.cc:276] 0709 13:06:40.467841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.467987 (+   146us) service_pool.cc:224] Handling call
0709 13:06:41.089593 (+621606us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:41.089800 (+   207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.090114 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.090139 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.090656 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.146537 (+ 55881us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.147967 (+  1430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.148115 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.135516 (+1987401us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:43.429396 (+293880us) raft_consensus.cc:1685] finished
0709 13:06:43.429425 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.429597 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16281,"raft.queue_time_us":5213,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":12066,"spinlock_wait_cycles":45902080,"thread_start_us":46175,"threads_started":1,"wal-append.queue_time_us":294140}
I20260709 13:06:43.900746 22021 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:43.878852 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.896826 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:43.894855 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1052) took 2300 ms. Trace:
I20260709 13:06:43.953003 21944 rpcz_store.cc:276] 0709 13:06:41.594762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.679553 (+1084791us) service_pool.cc:224] Handling call
0709 13:06:43.429719 (+750166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.830829 (+401110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.894664 (+ 63835us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b540009c9d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:43.894801 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722133888}
I20260709 13:06:43.880620 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:43.883384 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2040) took 1079 ms. Trace:
I20260709 13:06:43.954892 21871 rpcz_store.cc:276] 0709 13:06:42.799394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.799521 (+   127us) service_pool.cc:224] Handling call
0709 13:06:43.172817 (+373296us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:43.878550 (+705733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6950784}
I20260709 13:06:43.956152 22606 raft_consensus.cc:2368] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:06:43.956389 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:43.957121 21871 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:43.958033 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:43.958757 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 245) took 1044 ms. Trace:
I20260709 13:06:43.959055 21871 rpcz_store.cc:276] 0709 13:06:42.913967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.957771 (+1043804us) service_pool.cc:224] Handling call
0709 13:06:43.958680 (+   909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:43.959898 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:43.843158 24312 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:43.960916 24312 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:43.868279 24310 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:43.961469 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:43.962400 22601 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.963196 24310 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:43.885476 22015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:06:43.872155 22018 rpcz_store.cc:276] 0709 13:06:42.772418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.781486 (+  9068us) service_pool.cc:224] Handling call
0709 13:06:42.781796 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.782158 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.782184 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.782664 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.861908 (+ 79244us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:42.861960 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.862055 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.441816 (+579761us) raft_consensus.cc:1685] finished
0709 13:06:43.441835 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.828857 (+387022us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":140,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"thread_start_us":78760,"threads_started":1,"wal-append.queue_time_us":657487}
I20260709 13:06:43.256489 24308 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.621s
I20260709 13:06:43.876544 21768 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 5, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 5 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:43.887244 22576 leader_election.cc:336] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.565s (SENT)
I20260709 13:06:43.887686 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:43.978175 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:43.960395 21871 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.996747 22015 raft_consensus.cc:606] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:43.997290 22015 raft_consensus.cc:614] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:43.887847 24339 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.892299 24305 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.994961 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:44.029814 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 142572us
W20260709 13:06:44.030743 22576 leader_election.cc:336] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.639s (SENT)
I20260709 13:06:44.026708 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:44.013765 21869 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:44.032524 21873 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:44.032692 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2052) took 1135 ms. Trace:
I20260709 13:06:44.033193 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2048) took 1211 ms. Trace:
I20260709 13:06:44.033260 21869 rpcz_store.cc:276] 0709 13:06:42.896906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.879403 (+982497us) service_pool.cc:224] Handling call
0709 13:06:44.032564 (+153161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.033766 21873 rpcz_store.cc:276] 0709 13:06:42.821287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.822491 (+  1204us) service_pool.cc:224] Handling call
0709 13:06:44.026505 (+1204014us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:44.033125 (+  6620us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5504896}
I20260709 13:06:43.890506 24324 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.951088 24281 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:44.038959 22576 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.534s (SENT)
I20260709 13:06:43.886487 24329 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.963196 24312 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.042733 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:44.044466 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 196619us
W20260709 13:06:44.048043 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 1.21483e+06us
I20260709 13:06:44.036700 21768 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 4 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:43.884554 24318 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.049415 21874 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:06:44.059911 21838 connection.cc:256] RPC call timeout handler was delayed by -1.1964969029999111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:06:44.061197 21838 connection.cc:256] RPC call timeout handler was delayed by -1.1479819059999272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 13:06:44.065141 24312 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.065801 24312 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.050395 24329 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.068185 24312 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:44.036705 24339 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.069380 24329 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:44.031646 24308 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.051676 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:44.072942 21869 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:44.073964 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:44.038673 24087 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.075765 21871 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:06:43.995587 23611 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.077020 21870 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:44.079312 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 241) took 1166 ms. Trace:
I20260709 13:06:44.079635 21870 rpcz_store.cc:276] 0709 13:06:42.913002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.039779 (+1126777us) service_pool.cc:224] Handling call
0709 13:06:44.079245 (+ 39466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.073793 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2051) took 1191 ms. Trace:
I20260709 13:06:44.080466 21869 rpcz_store.cc:276] 0709 13:06:42.882260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.038726 (+1156466us) service_pool.cc:224] Handling call
0709 13:06:44.052908 (+ 14182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.073473 (+ 20565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.073730 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.082213 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 240) took 1169 ms. Trace:
I20260709 13:06:44.082801 21874 rpcz_store.cc:276] 0709 13:06:42.912727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.059207 (+1146480us) service_pool.cc:224] Handling call
0709 13:06:44.081605 (+ 22398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.081813 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.081849 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.081902 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.081944 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.082014 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.082145 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.081465 24268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.016s
W20260709 13:06:44.089044 24268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.016s
W20260709 13:06:44.096931 22576 leader_election.cc:336] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.141s (SENT)
I20260709 13:06:43.969825 24321 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.101315 21868 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.102707 24321 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.106272 24281 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.107754 24281 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.111570 24240 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.046802 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:44.114827 22603 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:44.121476 24137 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.124945 22605 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:44.126528 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 244) took 1212 ms. Trace:
I20260709 13:06:44.127031 21869 rpcz_store.cc:276] 0709 13:06:42.913711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.081183 (+1167472us) service_pool.cc:224] Handling call
0709 13:06:44.126027 (+ 44844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.126207 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.126235 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.126279 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.126320 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.126373 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.126469 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.124866 24339 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:44.138031 21914 connection.cc:256] RPC call timeout handler was delayed by -1.5319034780001175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 13:06:44.138688 21867 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
W20260709 13:06:44.138693 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2835034780000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260709 13:06:44.139475 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2223034780000717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 13:06:44.139575 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 249) took 1224 ms. Trace:
W20260709 13:06:44.139894 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2079034780000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 13:06:44.140072 21867 rpcz_store.cc:276] 0709 13:06:42.915006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.278805 (+363799us) service_pool.cc:224] Handling call
0709 13:06:44.139512 (+860707us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.076411 24305 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.141600 21768 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 6, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 6 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:44.147027 22576 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.645s (SENT)
I20260709 13:06:44.147511 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:44.146376 21838 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.624s (SENT)
I20260709 13:06:44.148403 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 246) took 1234 ms. Trace:
W20260709 13:06:44.148559 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 68578.9us
W20260709 13:06:44.149085 21838 connection.cc:256] RPC call timeout handler was delayed by -1.0669819060000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:06:44.149415 21838 connection.cc:256] RPC call timeout handler was delayed by -1.0322124720000829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 13:06:44.148975 21874 rpcz_store.cc:276] 0709 13:06:42.914217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.084084 (+1169867us) service_pool.cc:224] Handling call
0709 13:06:44.147886 (+ 63802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.148051 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.148076 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.148128 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.148161 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.148215 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.148345 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.146579 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 243) took 1233 ms. Trace:
I20260709 13:06:44.150270 21867 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:06:44.148448 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 316429us
W20260709 13:06:44.151520 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 102690us
I20260709 13:06:44.151926 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:44.152308 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:44.150542 21870 rpcz_store.cc:276] 0709 13:06:42.913465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.080234 (+1166769us) service_pool.cc:224] Handling call
0709 13:06:44.146071 (+ 65837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.146236 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.146259 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.146320 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:44.146352 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.146407 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.146522 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:44.138414 24137 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:44.156193 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:44.157568 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:44.162600 21768 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 5, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 5 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:44.178921 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:44.157795 24312 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:44.241674 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 62801.7us
I20260709 13:06:44.078799 24308 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:44.244971 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 87458.2us
I20260709 13:06:44.246222 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:44.266412 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.265946 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 118943us
W20260709 13:06:44.266271 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 78327.8us
I20260709 13:06:44.267992 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 242) took 1354 ms. Trace:
I20260709 13:06:44.244683 21768 catalog_manager.cc:5697] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:44.231345 24238 raft_consensus.cc:2764] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:06:44.268723 21871 rpcz_store.cc:276] 0709 13:06:42.913232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.077857 (+1164625us) service_pool.cc:224] Handling call
0709 13:06:44.130523 (+ 52666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.130704 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:44.153730 (+ 23026us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.267512 (+113782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.267575 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:44.267636 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.267729 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.267913 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22825,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":2178,"thread_start_us":113292,"threads_started":1}
I20260709 13:06:44.231259 24339 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:44.280130 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 170638us
I20260709 13:06:44.212708 24255 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:44.212304 24316 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.241233 24312 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:44.268126 22576 leader_election.cc:336] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 3.143s (SENT)
W20260709 13:06:44.287352 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.246464 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 503) took 1106 ms. Trace:
I20260709 13:06:44.247709 24240 raft_consensus.cc:2764] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:06:44.284533 21768 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:44.162600 24341 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260709 13:06:44.289268 22020 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:44.311646 22016 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:44.289710 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45801.9us
I20260709 13:06:44.265935 23881 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.269758 24087 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:44.296903 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.296038 22576 leader_election.cc:336] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.035s (SENT)
I20260709 13:06:44.293905 24312 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.305424 24308 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.304956 21768 catalog_manager.cc:5697] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 4, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:44.307444 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2125) took 1159 ms. Trace:
I20260709 13:06:44.346231 22017 rpcz_store.cc:276] 0709 13:06:43.148118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.148242 (+   124us) service_pool.cc:224] Handling call
0709 13:06:43.186662 (+ 38420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.768997 (+582335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.769031 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.829639 (+ 60608us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.141349 (+311710us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:44.141410 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.141524 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.307226 (+165702us) raft_consensus.cc:1685] finished
0709 13:06:44.307248 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.307383 (+   135us) inbound_call.cc:177] Queueing success response
0709 13:06:44.327313 (+ 19930us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b18003b3a40. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f85522 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
Metrics: {"raft.queue_time_us":56438,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":63708,"spinlock_wait_cycles":76740352,"thread_start_us":419629,"threads_started":2,"wal-append.queue_time_us":434979}
W20260709 13:06:44.308077 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.347340 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:44.347980 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.348337 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.295902 24345 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.300504 24339 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:06:44.321239 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.289081 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:44.319067 23881 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:44.356454 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:44.331480 23611 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.336826 21988 leader_election.cc:400] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:44.357937 21988 leader_election.cc:403] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:44.337715 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.338238 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 419) took 1058 ms. Trace:
I20260709 13:06:44.337694 24255 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:44.317354 24347 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:06:44.344851 22601 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:44.351052 21868 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
W20260709 13:06:44.354683 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.355640 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66625.3us
W20260709 13:06:44.357113 22576 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 3.111s (SENT)
I20260709 13:06:44.345808 24346 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.362896 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:44.357589 23881 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.385403 21838 leader_election.cc:400] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:44.385864 21838 leader_election.cc:403] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:44.387065 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:44.387673 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.388360 21871 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:44.360100 22605 rpcz_store.cc:276] 0709 13:06:43.280399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.421902 (+141503us) service_pool.cc:224] Handling call
0709 13:06:44.337989 (+916087us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000b54d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:44.338160 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563553024}
I20260709 13:06:44.360461 24329 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.394647 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:44.398351 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:44.399838 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.360543 24240 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.364423 24087 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:44.405069 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2119) took 1642 ms. Trace:
I20260709 13:06:44.407959 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:44.408053 22022 rpcz_store.cc:276] 0709 13:06:42.762689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.763169 (+   480us) service_pool.cc:224] Handling call
0709 13:06:42.782086 (+ 18917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.762736 (+980650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.401645 (+638909us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54004196d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:44.404984 (+  3339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253511936}
I20260709 13:06:44.397161 23611 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:44.395749 24335 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:44.403014 24238 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:44.424763 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.415467 21768 catalog_manager.cc:5697] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:44.403667 24350 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:06:44.426384 21838 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.553s (SENT)
W20260709 13:06:44.434691 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 69355.8us
I20260709 13:06:44.412104 24321 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:44.455880 21838 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.751s (SENT)
I20260709 13:06:44.414644 24087 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:06:44.431879 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 135265us
W20260709 13:06:44.460438 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 141482us
I20260709 13:06:44.459896 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:44.465939 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:44.466643 21871 raft_consensus.cc:2376] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8. Re-sending same reply.
I20260709 13:06:44.465863 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:44.430683 24345 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:44.473650 21874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:36954
I20260709 13:06:44.475548 21874 raft_consensus.cc:606] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:44.475549 21841 connection.cc:256] RPC call timeout handler was delayed by -1.0770742979999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 13:06:44.396001 24346 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.476013 21874 raft_consensus.cc:614] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:44.476205 21841 connection.cc:256] RPC call timeout handler was delayed by -1.0626742980000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 13:06:44.476660 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.468031 21870 raft_consensus.cc:2376] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6. Re-sending same reply.
I20260709 13:06:44.478086 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:44.478652 21871 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.462651 24356 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:44.479308 24352 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.080s	user 0.001s	sys 0.001s
I20260709 13:06:44.479063 24341 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:44.479506 23611 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:44.500064 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:44.498813 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:44.426070 24339 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:44.488698 24365 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:06:44.501943 21870 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.501382 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:44.508318 23611 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.518123 24087 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.525454 21874 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:44.538151 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 74755.8us
I20260709 13:06:44.539184 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:44.529309 21870 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
W20260709 13:06:44.530179 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51875.4us
I20260709 13:06:44.485951 24358 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:44.507457 24178 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.553750 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:44.557323 21871 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:44.560341 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.543998 24364 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.501288 24361 consensus_queue.cc:1059] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:06:44.569850 21870 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:44.569099 24308 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.572849 24308 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:44.573297 24308 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.544169 24281 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:44.574390 23611 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:44.575350 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 239) took 1663 ms. Trace:
I20260709 13:06:44.575774 21873 rpcz_store.cc:276] 0709 13:06:42.912414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.038726 (+1126312us) service_pool.cc:224] Handling call
0709 13:06:44.050992 (+ 12266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.288777 (+237785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.288807 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.289285 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.505369 (+216084us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:44.505408 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.505491 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.575116 (+ 69625us) raft_consensus.cc:1685] finished
0709 13:06:44.575134 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.575272 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26336,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":34739,"thread_start_us":389281,"threads_started":2,"wal-append.queue_time_us":241905}
I20260709 13:06:44.562263 24364 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:44.577289 24364 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:44.579559 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.299077 22602 rpcz_store.cc:276] 0709 13:06:43.140376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.145308 (+  4932us) service_pool.cc:224] Handling call
0709 13:06:43.231663 (+ 86355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.278067 (+ 46404us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:43.611994 (+333927us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.155847 (+543853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.157994 (+  2147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:44.159883 (+  1889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.211811 (+ 51928us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.241859 (+ 30048us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8375,"prepare.queue_time_us":505774,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":13681,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":666798,"threads_started":3,"wal-append.queue_time_us":264763}
I20260709 13:06:44.580962 24308 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.488407 24341 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:44.589010 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 43562.3us
I20260709 13:06:44.593093 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:44.594341 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 50292.2us
I20260709 13:06:44.489622 24356 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.597719 23881 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.598327 24238 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:44.586501 24137 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:44.605266 24136 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.607460 24136 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:44.607774 21838 leader_election.cc:336] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.642s (SENT)
I20260709 13:06:44.609622 24136 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.487959 24345 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.611017 24366 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:44.611379 24310 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:44.611788 24310 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:44.612591 24310 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.613752 24310 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.613692 24238 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.615168 24318 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:44.616017 24238 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:44.609653 21868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 250) took 1694 ms (client timeout 1997 ms). Trace:
W20260709 13:06:44.620221 21868 rpcz_store.cc:269] 0709 13:06:42.915317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.854116 (+938799us) service_pool.cc:224] Handling call
0709 13:06:44.609504 (+755388us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540034cbd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:44.609600 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336749312}
I20260709 13:06:44.625638 22574 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:44.628818 21841 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.532s (SENT)
I20260709 13:06:44.631100 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:44.627317 22601 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:44.625200 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:44.661114 22602 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.663280 21873 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:44.641372 24341 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.641430 24316 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.685392 24316 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:44.686681 24316 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.627465 24369 raft_consensus.cc:3055] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:44.689492 24369 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:44.690760 24369 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.692086 24369 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.644204 24308 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:44.644738 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.645612 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:44.645669 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:44.646129 23881 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:44.646565 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:44.647346 21841 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.613s (SENT)
I20260709 13:06:44.648137 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:44.695961 24178 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.648257 24328 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:44.696521 24178 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.696906 24328 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:44.697772 24328 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:44.651435 22021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2112) took 1917 ms (client timeout 2015 ms). Trace:
I20260709 13:06:44.651757 24350 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:44.698755 24178 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:44.658246 24356 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.632560 24346 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:44.698922 22021 rpcz_store.cc:269] 0709 13:06:42.733699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.742225 (+  8526us) service_pool.cc:224] Handling call
0709 13:06:44.651256 (+1909031us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540005da54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:44.651373 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2568251520}
I20260709 13:06:44.675872 21874 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:44.700181 24308 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:44.700913 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:44.700753 24308 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:44.701869 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.701874 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54540.4us
W20260709 13:06:44.703138 21841 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.624s (SENT)
I20260709 13:06:44.703495 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:44.704689 21841 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.751s (SENT)
I20260709 13:06:44.705165 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:44.706156 24367 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:44.707170 24367 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:44.707356 24238 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.707969 24367 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:44.698755 24328 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.709245 24367 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:44.709761 24367 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:44.710765 24367 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.712319 24367 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.703562 24308 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:44.726924 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 184373us
W20260709 13:06:44.728204 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 58565.2us
I20260709 13:06:44.626118 24137 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.732698 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:44.733469 21948 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:44.734512 21841 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.805s (SENT)
W20260709 13:06:44.738497 24359 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:06:44.741086 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:44.741845 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 248) took 1827 ms. Trace:
I20260709 13:06:44.743638 22607 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.745133 21942 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:44.746364 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:44.735044 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:44.748106 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:44.743747 21869 rpcz_store.cc:276] 0709 13:06:42.914734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.128352 (+1213618us) service_pool.cc:224] Handling call
0709 13:06:44.128696 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.128907 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:44.129451 (+   544us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.740895 (+611444us) log.cc:844] Serialized 14 byte log entry
0709 13:06:44.741300 (+   405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.741371 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:44.741438 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.741553 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.741712 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15952,"prepare.queue_time_us":191521,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":15327,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":25789,"thread_start_us":610491,"threads_started":3,"wal-append.queue_time_us":305326}
I20260709 13:06:44.748814 21943 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
W20260709 13:06:44.753322 21841 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.843s (SENT)
I20260709 13:06:44.753530 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:44.753818 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:44.756986 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:44.758863 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:44.762751 21841 leader_election.cc:336] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.858s (SENT)
W20260709 13:06:44.764247 21841 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.973s (SENT)
I20260709 13:06:44.759963 24238 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.764698 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:44.779804 22607 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
W20260709 13:06:44.780478 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.786232 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.791137 24238 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.776682 24286 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:44.758864 24350 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.759502 23611 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:44.743595 24312 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:44.804661 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61277.8us
W20260709 13:06:44.807186 21841 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.063s (SENT)
W20260709 13:06:44.811883 21841 leader_election.cc:336] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.101s (SENT)
W20260709 13:06:44.812678 21841 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.172s (SENT)
I20260709 13:06:44.813004 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:44.797212 22601 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:44.816974 24238 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.821130 22015 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:44.869189 24377 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:44.809787 23611 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:44.876933 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.882069 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73317.6us
W20260709 13:06:44.883430 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 68487.8us
I20260709 13:06:44.885063 21916 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:44.806655 24364 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.897282 24364 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:44.898126 21941 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.886217 23611 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:44.905130 24379 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:06:44.906543 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:44.907335 21872 raft_consensus.cc:2368] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 7.
I20260709 13:06:44.915454 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:44.915778 23881 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:44.916327 23881 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:44.917251 23881 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.918074 24356 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:44.918587 24356 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:44.919422 24356 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:44.922899 24341 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:44.923902 24346 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:44.933276 24137 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:44.945501 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2042) took 2143 ms. Trace:
I20260709 13:06:44.946676 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:44.949234 21869 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:44.949020 21875 rpcz_store.cc:276] 0709 13:06:42.802522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.802879 (+   357us) service_pool.cc:224] Handling call
0709 13:06:44.944801 (+2141922us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:44.944996 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.945170 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.945194 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:44.945236 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:44.945266 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.945319 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.945443 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6197504}
I20260709 13:06:44.945288 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:44.950841 21866 raft_consensus.cc:2368] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
W20260709 13:06:44.951308 21866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2043) took 2148 ms (client timeout 2109 ms). Trace:
W20260709 13:06:44.951771 21866 rpcz_store.cc:269] 0709 13:06:42.802820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.803482 (+   662us) service_pool.cc:224] Handling call
0709 13:06:44.945129 (+2141647us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:44.951199 (+  6070us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5548800}
I20260709 13:06:44.946309 24312 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:44.956905 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.958317 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:44.924485 22602 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:44.960441 24362 raft_consensus.cc:2764] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:06:44.944391 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 131777us
W20260709 13:06:44.962668 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.963342 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.963439 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.965440 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:44.966650 21871 raft_consensus.cc:2368] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
W20260709 13:06:44.974407 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 89957.3us
I20260709 13:06:44.976101 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:44.962713 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:44.980304 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:44.981930 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:44.988358 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:44.986284 24238 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:44.991474 24238 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:44.992769 24238 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.993124 23611 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:44.996443 23611 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:44.997468 24364 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.998062 24364 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:44.998555 24364 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.000950 24384 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:06:45.003192 24384 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:45.003702 24384 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:45.004551 24255 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:45.004889 24384 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.005365 24255 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:44.986615 24361 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:45.006628 24255 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:45.007623 24361 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:45.019332 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 101659us
W20260709 13:06:45.020941 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.021695 21916 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:45.028095 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.029111 22020 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:45.011471 24369 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.037545 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:45.036531 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:45.037256 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:45.037516 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:45.039582 21949 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.037926 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.035936 24383 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:45.042053 23640 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:45.042806 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:45.043658 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:45.044226 21947 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.053568 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:45.038177 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:45.056097 22022 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.042709 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.057235 22017 raft_consensus.cc:2410] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:45.057662 22018 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:45.059988 21949 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:45.062583 21949 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:45.008587 24255 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.080188 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.081010 21871 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:45.072415 21914 leader_election.cc:400] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:06:45.085543 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:45.084913 21914 leader_election.cc:403] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.088909 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:06:45.096737 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:45.101856 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.057626 24369 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:45.110054 22018 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:45.065884 24383 raft_consensus.cc:697] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:45.028710 24340 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 13:06:45.122303 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.068222 24358 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:06:45.140053 21945 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.143626 21871 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:45.145529 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.010969 24361 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:45.068041 24374 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:06:45.114449 24369 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.135754 24327 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:45.155267 21871 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:45.158311 24346 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:06:45.100219 24312 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:06:45.189092 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.197036 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.197984 21866 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:45.215871 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.219323 21872 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:06:45.215672 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 122764us
I20260709 13:06:45.223193 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.223958 21866 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:45.224556 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.224834 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.225239 21873 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:45.225448 21866 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:45.226086 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:45.226352 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.226758 21873 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.227526 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.228129 21866 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:45.226001 24358 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:45.228704 21874 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:45.229439 24358 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:45.229691 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:45.230325 21874 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.231496 24384 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:45.232782 21950 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:45.233244 21868 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:45.234493 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:45.235169 21868 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.189818 24178 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:45.236887 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.237072 24178 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:45.238401 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.239849 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:45.240746 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.229826 24358 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:45.250614 24346 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:45.162557 22601 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:06:45.257143 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 198499us
I20260709 13:06:45.188103 24328 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.271253 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 185414us
I20260709 13:06:45.258095 21874 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:45.255890 21873 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:45.259231 21868 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:45.260377 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:45.305507 21870 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:45.259853 24327 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:06:45.313324 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.340734 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.332077 24388 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.347s	user 0.000s	sys 0.002s
W20260709 13:06:45.345356 21988 connection.cc:256] RPC call timeout handler was delayed by -6.3771172159999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 13:06:45.349797 21988 connection.cc:256] RPC call timeout handler was delayed by -6.0754189310000584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2862s for a response
I20260709 13:06:45.268157 24328 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:45.380084 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.381014 22018 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:45.384768 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:45.385555 22020 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.388142 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.307076 24383 consensus_queue.cc:237] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:45.348560 24367 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:06:45.411240 22019 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:45.411216 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:45.413625 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.427963 22024 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:45.324678 24358 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:45.435547 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.436965 22024 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:45.446302 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.448314 22020 raft_consensus.cc:2410] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:45.457016 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:45.459686 22024 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.461474 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.474589 22020 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:45.474910 24369 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:45.475752 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.435962 24384 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:45.409576 24327 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:45.491093 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:45.465484 22603 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:45.467878 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.493865 22021 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:45.468737 24358 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.469715 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 254) took 1115 ms. Trace:
I20260709 13:06:45.469805 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:45.529969 22018 raft_consensus.cc:2410] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:45.469776 22024 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:45.531289 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.532390 22024 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:45.472137 24364 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:45.473390 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.533638 21874 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:45.533854 22019 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:45.473649 24370 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:45.462563 24392 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:06:45.493213 22017 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.468356 21875 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:45.529244 21867 rpcz_store.cc:276] 0709 13:06:44.354442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.354677 (+   235us) service_pool.cc:224] Handling call
0709 13:06:44.361010 (+  6333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.428620 (+ 67610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:44.428664 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:44.435886 (+  7222us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.748579 (+312693us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.748691 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.469336 (+720645us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b540002b554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:45.469383 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.469425 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:45.469439 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.469653 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4959,"raft.queue_time_us":11494,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":20067,"spinlock_wait_cycles":142914304,"thread_start_us":263312,"threads_started":1,"wal-append.queue_time_us":269501}
W20260709 13:06:45.491263 24394 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:06:45.556314 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.497668 24409 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:45.781531 22573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.041s	sys 0.065s
W20260709 13:06:45.781948 22573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.041s	sys 0.065s
W20260709 13:06:45.589309 24408 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:06:45.590345 24364 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:45.590888 21948 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.597174 22017 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
W20260709 13:06:45.649752 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.668385 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.782218 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 693874us
I20260709 13:06:45.825206 24329 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:45.537503 24370 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:45.827703 24370 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:45.835129 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.837891 24369 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:45.815106 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 509) took 1226 ms. Trace:
I20260709 13:06:45.849298 22603 rpcz_store.cc:276] 0709 13:06:44.588290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.590430 (+  2140us) service_pool.cc:224] Handling call
0709 13:06:45.465087 (+874657us) spinlock_profiling.cc:243] Waited 945 us on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:45.465300 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.536711 (+ 71411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.786571 (+249860us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174208}
I20260709 13:06:45.828670 24409 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:45.780822 24308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.017s	sys 0.048s
W20260709 13:06:45.852881 24308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.017s	sys 0.048s
I20260709 13:06:45.853689 22020 raft_consensus.cc:2410] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:45.892493 22605 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:45.893220 22602 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:45.894009 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:45.894488 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:45.895395 22607 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:45.896431 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:45.897226 22606 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.898723 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:45.899662 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.899803 22603 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:45.878477 24339 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:45.901171 24339 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:45.901680 24339 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:45.902721 24339 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:45.903975 24339 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.904426 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:45.906994 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:45.908622 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:45.909091 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:45.909965 21838 leader_election.cc:336] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.858s (SENT)
I20260709 13:06:45.910542 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:45.901032 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:45.911895 24238 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:45.855476 24370 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.913327 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:45.924698 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.935916 24327 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.936839 24327 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:45.940263 24327 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:45.945902 24238 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.946476 24238 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:45.949090 24238 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:45.964121 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.965575 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.966706 22024 raft_consensus.cc:2410] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:45.970750 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:45.971758 22015 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:46.019091 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.019019 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:46.019932 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.020258 22015 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
W20260709 13:06:46.020735 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.021286 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.022480 22015 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:46.026368 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.026898 22024 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
I20260709 13:06:46.027544 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.028048 22024 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:46.030664 21838 leader_election.cc:336] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.605s (SENT)
I20260709 13:06:46.015503 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:46.037730 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.040401 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:46.041055 22024 raft_consensus.cc:2376] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4. Re-sending same reply.
I20260709 13:06:46.025166 24416 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.042335 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.049417 22024 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:46.050489 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.051218 22024 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:46.052349 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0854709039999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 13:06:46.053864 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.055313 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.055563 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.056176 21949 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:46.056854 21838 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.004s (SENT)
I20260709 13:06:46.057412 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:46.058055 21949 raft_consensus.cc:2410] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:46.062131 21914 leader_election.cc:400] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6.
I20260709 13:06:46.062611 21914 leader_election.cc:403] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.063971 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:46.043524 24345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.012s	sys 0.021s
W20260709 13:06:46.066205 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.066959 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.067528 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.071008 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.082006 21945 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:06:46.083285 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.072229 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.066931 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.075017 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.075374 21944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:46.077809 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.084553 21949 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:46.087833 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.089401 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.090796 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.091861 21949 raft_consensus.cc:2410] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:46.085346 22024 raft_consensus.cc:2410] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:46.085157 21944 raft_consensus.cc:606] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:46.093251 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.095417 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.096235 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.072893 24358 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6.
I20260709 13:06:46.103650 21941 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.101418 21946 raft_consensus.cc:2410] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:46.100142 24364 raft_consensus.cc:2764] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:06:46.103982 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.108635 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.109465 22024 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:46.110558 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:46.111855 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47981.3us
I20260709 13:06:46.098100 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.105650 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.080236 24308 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:46.079706 24345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.013s	sys 0.022s
I20260709 13:06:46.121517 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.122385 22020 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:46.122277 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:46.123354 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.123977 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:46.113229 21838 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.063s (SENT)
I20260709 13:06:46.115317 22024 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:46.132426 21838 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:46.133011 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.133800 22024 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:46.133939 21838 leader_election.cc:336] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.069s (SENT)
I20260709 13:06:46.134722 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.134936 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.135541 22024 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:46.136096 24367 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.117625 24402 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:46.124518 24238 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:46.136755 24334 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:46.137017 24238 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:46.138931 24334 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:46.139499 24334 consensus_queue.cc:1243] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:46.136355 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.140636 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.136770 24402 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:46.141316 22024 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:46.142030 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.125351 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:46.143033 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.143669 22024 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:46.141625 24402 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:46.049371 24416 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:46.145081 24402 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.146503 24416 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:46.139087 24238 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:46.124069 22020 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:46.144681 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:46.148949 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.150010 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.151005 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.130051 21914 leader_election.cc:400] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:06:46.152197 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.152983 22601 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:46.144335 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:46.158731 22024 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.159307 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:46.148507 24391 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.760s	user 0.010s	sys 0.005s
I20260709 13:06:46.165802 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.167627 21867 pending_rounds.cc:85] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 4
I20260709 13:06:46.168051 21867 pending_rounds.cc:107] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:46.168375 21867 raft_consensus.cc:2889] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:46.196949 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:46.207628 22024 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:46.209110 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.210608 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.211208 22024 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:46.212023 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:46.212527 22024 raft_consensus.cc:2376] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4. Re-sending same reply.
I20260709 13:06:46.213323 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.214499 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.131349 24308 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:46.161586 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:46.219120 22024 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:46.220175 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.221518 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.155745 24364 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:46.249222 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:46.252183 22020 raft_consensus.cc:2410] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:46.178216 24345 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.255049 22018 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:46.236025 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.237898 24358 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.238379 22606 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:46.239822 24308 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:46.240872 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:46.263310 22607 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:46.240255 24259 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:46.257828 22024 raft_consensus.cc:2368] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:46.267546 22018 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:46.267700 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:46.275180 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 216686us
W20260709 13:06:46.283221 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 164580us
I20260709 13:06:46.287709 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:46.290670 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:46.275266 24310 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.352s	user 0.022s	sys 0.019s
I20260709 13:06:46.313140 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:46.319648 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 185737us
W20260709 13:06:46.320581 21838 leader_election.cc:336] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.078s (SENT)
W20260709 13:06:46.321249 21841 leader_election.cc:336] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.516s (SENT)
I20260709 13:06:46.321805 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:46.307981 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:46.276160 24259 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:46.323509 21841 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.553s (SENT)
I20260709 13:06:46.325081 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:46.325300 21870 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:46.321928 21838 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.204s (SENT)
I20260709 13:06:46.325400 21874 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
W20260709 13:06:46.321462 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64567.4us
I20260709 13:06:46.304749 21987 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:46.326689 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:46.281917 24416 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.342350 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.364249 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 59633.3us
I20260709 13:06:46.365011 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:46.367547 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44055.9us
W20260709 13:06:46.308717 24310 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.385s	user 0.022s	sys 0.019s
W20260709 13:06:46.369025 21841 leader_election.cc:336] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.642s (SENT)
I20260709 13:06:46.369652 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:46.314193 22602 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:06:46.380388 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 183501us
I20260709 13:06:46.381814 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.386497 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:46.387137 21870 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.332271 24286 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:06:46.401600 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.390702 21945 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.371122 24367 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:46.415408 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.416163 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.417801 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:46.418171 23881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.498s	user 0.010s	sys 0.011s
I20260709 13:06:46.381906 24238 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.377077 24308 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:46.419065 21945 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:46.391860 24370 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.420837 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.398924 24416 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:46.377532 24425 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:06:46.425673 24430 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.426626 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 228) took 1382 ms. Trace:
I20260709 13:06:46.429339 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:46.432535 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:46.430142 23881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.011s	sys 0.011s
I20260709 13:06:46.433669 24308 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.441393 24433 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.429384 24358 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:46.472707 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.527905 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.529035 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.478261 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:46.496628 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 127620us
I20260709 13:06:46.503567 21870 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
W20260709 13:06:46.514786 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.519075 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 75800.6us
W20260709 13:06:46.519564 21871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1545) took 1306 ms (client timeout 1615 ms). Trace:
I20260709 13:06:46.503913 21948 rpcz_store.cc:276] 0709 13:06:45.044419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.049018 (+  4599us) service_pool.cc:224] Handling call
0709 13:06:45.049342 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.815146 (+765804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.426383 (+611237us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b540009bfd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:46.426565 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244970368}
I20260709 13:06:46.522025 21942 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:46.523005 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 102228us
W20260709 13:06:46.525985 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 90777.9us
W20260709 13:06:46.533052 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.533097 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.530001 22020 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:46.536495 21988 leader_election.cc:400] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5.
W20260709 13:06:46.531544 21841 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.747s (SENT)
I20260709 13:06:46.536827 21988 leader_election.cc:403] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:46.537652 21841 leader_election.cc:336] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.605s (SENT)
I20260709 13:06:46.538209 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:46.539940 21841 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.004s (SENT)
I20260709 13:06:46.533854 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:46.540472 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:46.542019 21871 rpcz_store.cc:269] 0709 13:06:45.213480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.213645 (+   165us) service_pool.cc:224] Handling call
0709 13:06:46.429191 (+1215546us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:46.519461 (+ 90270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4386048}
I20260709 13:06:46.544838 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:46.545533 22017 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.503784 24407 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.546793 24238 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:46.523803 24308 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:46.559500 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.560959 24358 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:46.561868 24358 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.564472 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.565402 22020 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 1.
W20260709 13:06:46.572582 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.575208 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:46.532059 24431 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.546952 24367 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.591922 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.551721 24439 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:06:46.517175 24370 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:46.593291 22020 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:46.598495 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 62137.2us
I20260709 13:06:46.599018 22017 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:46.600821 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.605288 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:46.606818 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 277491us
I20260709 13:06:46.610276 22017 raft_consensus.cc:2376] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7. Re-sending same reply.
I20260709 13:06:46.586158 24433 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.530624 24430 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:46.632103 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.633046 22020 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:46.566439 24407 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:46.537158 24259 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:46.635624 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.637022 24441 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.640193 24450 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:46.641707 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:46.642069 24286 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.648658 22017 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:46.627477 24433 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:46.652290 21867 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.655427 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.657900 22020 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:46.666549 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.667289 22017 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:46.668916 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.670704 22020 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:46.661818 24286 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:46.686430 24286 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:46.672323 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:46.687428 22605 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:06:46.688349 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.689415 24416 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:46.675753 24178 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:46.653625 24433 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.689706 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:46.694043 24430 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:46.676540 24370 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:46.663457 24450 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5.
I20260709 13:06:46.676587 24407 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:46.693260 22020 raft_consensus.cc:2376] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7. Re-sending same reply.
I20260709 13:06:46.681248 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.668105 24425 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.682540 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.682969 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.679131 24328 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:46.699213 21867 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:46.703298 22021 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:46.703379 22017 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:46.723987 22576 leader_election.cc:336] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.326s (SENT)
I20260709 13:06:46.704543 24425 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.734440 24425 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:46.751701 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.759239 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.759799 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1091) took 1290 ms. Trace:
I20260709 13:06:46.760416 22022 rpcz_store.cc:276] 0709 13:06:45.468880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.680979 (+1212099us) service_pool.cc:224] Handling call
0709 13:06:46.759704 (+ 78725us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:46.760685 21841 leader_election.cc:336] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.908s (SENT)
I20260709 13:06:46.777518 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.779452 22017 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:46.786182 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.787528 22022 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:46.797108 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.797995 22020 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:46.809422 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.810086 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.810317 22021 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:46.810933 22017 raft_consensus.cc:2410] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:46.764068 24440 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:06:46.813354 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.820570 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.820832 22022 raft_consensus.cc:2410] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:46.766417 24370 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.835451 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.836798 22017 raft_consensus.cc:2410] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:46.838852 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.839744 22021 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:46.761454 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.841818 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:46.842994 22022 raft_consensus.cc:2410] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:46.844542 24430 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:46.845894 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 85612.8us
I20260709 13:06:46.846630 22022 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:46.846626 21841 leader_election.cc:336] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.078s (SENT)
I20260709 13:06:46.853902 21841 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:46.856920 22020 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:06:46.857882 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.861138 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:46.862001 21947 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:46.863049 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:46.864928 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.865401 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:46.868522 21841 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.187s (SENT)
W20260709 13:06:46.870602 21841 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.204s (SENT)
I20260709 13:06:46.871337 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:46.871532 22017 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.876718 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:46.879156 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 4.629s (SENT) [suppressed 59 similar messages]
W20260709 13:06:46.880416 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.881567 21841 leader_election.cc:336] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.246s (SENT)
I20260709 13:06:46.882411 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:46.885376 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 351613us
W20260709 13:06:46.890785 21841 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.026s (SENT)
I20260709 13:06:46.893893 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:46.898578 21841 leader_election.cc:336] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.384s (SENT)
I20260709 13:06:46.899194 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:46.876016 24369 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:46.870056 24430 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.834901 24370 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:46.884497 24286 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:46.902175 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 301429us
I20260709 13:06:46.913921 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.892777 24450 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.897383 24441 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:46.902987 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 258894us
I20260709 13:06:46.897145 24178 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.889763 24459 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.905573 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:46.919664 21868 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:46.921729 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 306676us
I20260709 13:06:46.902205 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:46.932444 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.950035 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:46.950970 21871 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:46.968256 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:46.918836 24358 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.906929 24439 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:06:46.922637 24430 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:46.993232 24423 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.618s	user 0.003s	sys 0.000s
W20260709 13:06:46.995473 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 119039us
I20260709 13:06:46.971673 22605 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:47.003754 24433 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:47.013154 24448 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:06:47.015846 24431 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:47.016927 24451 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:06:47.017561 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 98741.8us
I20260709 13:06:47.020339 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:47.022221 24433 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:47.022634 24370 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:46.997092 24441 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:47.023473 22576 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.997s (SENT)
I20260709 13:06:46.997241 24471 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:47.026229 24471 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:46.997241 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:47.049048 21866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.446s	user 0.022s	sys 0.031s
W20260709 13:06:47.049458 21866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.446s	user 0.022s	sys 0.031s
I20260709 13:06:47.050676 24268 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.056433 24439 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.057377 24439 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:47.057691 24439 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:47.058553 24439 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:47.059700 24439 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.067203 24409 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:46.970325 24358 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.048951 24398 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:47.082314 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 85148.7us
W20260709 13:06:47.084860 21841 leader_election.cc:336] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.052s (SENT)
I20260709 13:06:47.089888 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:47.091056 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.091444 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:47.089761 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:47.093266 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 73102.2us
I20260709 13:06:47.094645 21873 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:46.920647 24450 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:47.095701 21874 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:47.097798 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 157328us
I20260709 13:06:47.097252 21873 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:06:47.101261 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 187414us
I20260709 13:06:47.101505 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.102279 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:47.105270 21874 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:47.028551 24471 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:47.095752 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 507) took 1188 ms. Trace:
I20260709 13:06:47.095002 24178 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.095417 24402 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.113245 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:47.105437 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:47.100224 24467 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:47.110265 22602 rpcz_store.cc:276] 0709 13:06:45.906869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.908082 (+  1213us) service_pool.cc:224] Handling call
0709 13:06:46.263185 (+355103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.376869 (+113684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.036480 (+659611us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54006504d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:47.093529 (+ 57049us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801957632}
I20260709 13:06:47.125577 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.127266 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.128003 22022 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:47.125671 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.122153 24475 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.128880 22016 raft_consensus.cc:2368] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
I20260709 13:06:47.117218 24465 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:47.110847 24409 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.096215 24459 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:06:47.132303 24433 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.132524 24467 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:47.132915 24433 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.133692 24467 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.135181 24433 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:47.110713 24463 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:47.125005 24369 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:47.137439 24308 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.001s
I20260709 13:06:47.151818 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.153513 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.154804 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.147791 24463 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:47.167073 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.168303 24463 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:47.140453 24450 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:47.170822 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.171458 22015 raft_consensus.cc:2376] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4. Re-sending same reply.
W20260709 13:06:47.160336 24444 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.426s	user 0.004s	sys 0.000s
I20260709 13:06:47.170122 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:47.174008 22602 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:47.175240 21839 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:47.176129 24268 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.176544 24268 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.176910 24268 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.177284 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1560) took 1950 ms. Trace:
I20260709 13:06:47.177793 21866 rpcz_store.cc:276] 0709 13:06:45.226948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.270386 (+ 43438us) service_pool.cc:224] Handling call
0709 13:06:45.537956 (+267570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.602117 (+ 64161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.602163 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.602787 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.992657 (+1389870us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:47.049807 (+ 57150us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:47.050189 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.050437 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.050538 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.050580 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:47.050677 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.177067 (+126390us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400218750. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:47.177215 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":215940,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":40119,"spinlock_wait_cycles":537021184,"thread_start_us":1446588,"threads_started":1,"wal-append.queue_time_us":670985}
I20260709 13:06:47.181667 21947 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:47.185243 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:06:47.190448 21841 leader_election.cc:336] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.720s (SENT)
I20260709 13:06:47.191190 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:47.208298 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.209185 22015 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:47.144136 24425 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.185248 24481 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:06:47.211716 24369 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.220721 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:47.223129 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:47.226531 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:47.226956 22604 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:06:47.227145 21947 raft_consensus.cc:606] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Received request to transfer leadership to TS bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:47.152987 24308 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.231019 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:47.231194 24268 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.232577 21866 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.233393 24402 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:47.234591 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.235926 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.237282 21948 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:47.275061 21948 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.238050 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.276310 21941 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:47.239837 21946 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:47.277139 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.241333 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.242316 22015 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:47.243386 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:47.278401 21943 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.249313 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.210480 24358 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:47.246685 21869 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:47.256325 22602 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEARNER]: Advancing to term 6
I20260709 13:06:47.257513 22021 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:06:47.210007 24443 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.257764 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:47.261101 24367 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:47.262581 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2157) took 1008 ms. Trace:
I20260709 13:06:47.263245 22022 raft_consensus.cc:2368] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5.
I20260709 13:06:47.263780 24474 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:47.264207 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.245779 24398 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.266515 24425 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:47.269315 24308 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:47.270078 22016 raft_consensus.cc:2368] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7.
I20260709 13:06:47.279451 22019 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:47.311524 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.307135 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.306830 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.322746 21947 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:47.318233 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.307156 23611 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:47.321460 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.310922 22024 rpcz_store.cc:276] 0709 13:06:46.254123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.273115 (+ 18992us) service_pool.cc:224] Handling call
0709 13:06:46.273562 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.273987 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.274029 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.309042 (+ 35013us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.606267 (+297225us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:46.606326 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.606437 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.159698 (+553261us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:47.262196 (+102498us) raft_consensus.cc:1685] finished
0709 13:06:47.262225 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.262503 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14064,"raft.queue_time_us":1712,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":28281,"spinlock_wait_cycles":16134912,"thread_start_us":198658,"threads_started":1,"wal-append.queue_time_us":351439}
I20260709 13:06:47.315591 24358 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:47.315196 24367 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.323105 22015 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:47.306828 24471 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:47.332281 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 77487.6us
I20260709 13:06:47.321214 24398 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.309231 24476 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.362494 22576 leader_election.cc:336] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.964s (SENT)
I20260709 13:06:47.342388 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.307328 24402 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.342828 21946 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.373356 22021 raft_consensus.cc:2368] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
I20260709 13:06:47.349663 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.342854 24358 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:47.374171 24476 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:47.329131 23611 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:47.375730 23611 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:47.370581 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:47.309062 24481 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:06:47.384908 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.379029 23611 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.380923 24402 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:47.345628 24367 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:47.371973 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:47.370558 24398 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.374243 22015 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
W20260709 13:06:47.392849 21841 leader_election.cc:336] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.228s (SENT)
I20260709 13:06:47.328534 21943 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:06:47.402223 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:47.402498 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.402887 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:47.403252 22015 raft_consensus.cc:2368] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
I20260709 13:06:47.404062 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.405062 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.405572 22015 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:47.406279 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.405907 24494 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:47.331677 24490 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:06:47.408711 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:47.409032 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.410315 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.409584 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:47.359520 24431 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:47.388177 24476 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:47.358472 24370 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:47.395051 24475 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.417451 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.418113 22021 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.418387 22602 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:47.418809 22602 pending_rounds.cc:85] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 3
I20260709 13:06:47.419277 22602 pending_rounds.cc:107] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:47.419642 22602 raft_consensus.cc:2889] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.409579 24367 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.419309 24490 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:06:47.422025 24490 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.422417 24490 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.422783 24490 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.422658 24462 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:47.424110 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:47.425977 24475 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:47.428181 24475 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:47.411510 24471 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:47.429105 24471 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:47.430119 24471 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.438431 22015 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:47.441915 22021 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:47.442385 21867 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:47.465545 21867 pending_rounds.cc:85] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 3
I20260709 13:06:47.465809 21867 pending_rounds.cc:107] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:47.466048 21867 raft_consensus.cc:2889] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:47.449684 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:47.441411 24418 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.453081 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.454121 21772 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 4 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 7 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.455145 24268 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:47.455753 24489 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:47.466163 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.475241 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:47.476166 22017 raft_consensus.cc:2368] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
I20260709 13:06:47.463042 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.483259 22015 raft_consensus.cc:2376] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5. Re-sending same reply.
I20260709 13:06:47.484170 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.484828 22015 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:47.485653 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.486384 22015 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:47.487174 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.488340 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.460106 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:47.444423 24436 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.019s	user 0.003s	sys 0.008s
I20260709 13:06:47.478754 24329 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.489006 22015 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:47.500347 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.501845 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:47.409068 24470 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:06:47.507745 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:47.516438 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.517273 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.517660 22021 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:47.522006 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:47.487512 24446 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.010s	sys 0.003s
I20260709 13:06:47.487699 22605 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.528375 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:47.532259 22015 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:47.548388 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.549446 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.550383 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.552665 22015 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:06:47.533910 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.535075 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.553408 22021 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
W20260709 13:06:47.543474 22023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1087) took 2075 ms (client timeout 2000 ms). Trace:
I20260709 13:06:47.554876 22017 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:47.498207 24329 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:47.489998 24367 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:06:47.528857 24490 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.573840 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.575138 24490 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:47.575613 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.573858 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:47.577685 24434 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 1.162s	user 0.001s	sys 0.009s
I20260709 13:06:47.577975 24367 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:47.578131 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49849.2us
I20260709 13:06:47.579170 22015 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.580842 22018 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:47.581105 24329 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.582231 24329 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.583389 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 275) took 1426 ms. Trace:
I20260709 13:06:47.583781 21875 rpcz_store.cc:276] 0709 13:06:46.156745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.156896 (+   151us) service_pool.cc:224] Handling call
0709 13:06:46.163312 (+  6416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.163737 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.163776 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.178890 (+ 15114us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.317967 (+139077us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:46.318022 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.318113 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.577137 (+1259024us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:47.583110 (+  5973us) raft_consensus.cc:1685] finished
0709 13:06:47.583131 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.583320 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":322,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":26241,"spinlock_wait_cycles":23426816,"thread_start_us":79436,"threads_started":1,"wal-append.queue_time_us":174854}
I20260709 13:06:47.584884 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.585558 22017 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:47.586719 22017 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:47.551424 24446 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.010s	sys 0.003s
I20260709 13:06:47.506633 24463 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:06:47.554252 22023 rpcz_store.cc:269] 0709 13:06:45.467825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.543249 (+2075424us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:47.543403 (+   154us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:47.556524 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.591334 22021 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:06:47.563233 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:47.566596 24457 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.589365 22015 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:47.593394 21988 connection.cc:256] RPC call timeout handler was delayed by -1.4573210669999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 13:06:47.598649 21988 connection.cc:256] RPC call timeout handler was delayed by -1.4159210669999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260709 13:06:47.599761 21988 connection.cc:256] RPC call timeout handler was delayed by -1.4069210669999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:06:47.600165 21988 connection.cc:256] RPC call timeout handler was delayed by -1.366421067000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
I20260709 13:06:47.592015 22022 raft_consensus.cc:2376] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4. Re-sending same reply.
W20260709 13:06:47.600558 21988 connection.cc:256] RPC call timeout handler was delayed by -1.2863210670000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:06:47.601442 21988 connection.cc:256] RPC call timeout handler was delayed by -1.2179210670000202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 13:06:47.630367 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.631685 21988 connection.cc:256] RPC call timeout handler was delayed by -1.1333210669999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:06:47.633102 21988 connection.cc:256] RPC call timeout handler was delayed by -1.0514210669999784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 13:06:47.663264 22022 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:47.667979 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 256567us
I20260709 13:06:47.669577 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:47.676514 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 97690.9us
I20260709 13:06:47.677525 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:47.689922 22021 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:47.602504 24308 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.714664 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:47.598058 24457 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:47.718425 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.730249 21946 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.715605 21942 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:47.755549 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 78116.3us
I20260709 13:06:47.755602 21944 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:47.756402 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:47.760800 21839 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:47.768697 21943 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:47.670934 23611 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
W20260709 13:06:47.820742 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 60067.1us
W20260709 13:06:47.835731 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:47.857527 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.859157 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1671) took 1789 ms. Trace:
I20260709 13:06:47.859735 21949 rpcz_store.cc:276] 0709 13:06:46.069397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.099660 (+ 30263us) service_pool.cc:224] Handling call
0709 13:06:46.100360 (+   700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.216838 (+116478us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:46.272254 (+ 55416us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.328482 (+ 56228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.328562 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:46.328646 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.431038 (+1102392us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b18002d19c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:47.443794 (+ 12756us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:47.858828 (+415034us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b540009bad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:47.858894 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.859079 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7108,"prepare.queue_time_us":195986,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":80774,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":3849,"spinlock_wait_cycles":185073536,"thread_start_us":51588,"threads_started":1,"wal-append.queue_time_us":152313}
I20260709 13:06:47.757462 24370 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.867774 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.605755 24398 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:47.778930 24367 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.914105 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:47.820518 24467 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.755298 24358 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:47.823603 24268 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:47.823746 24484 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:47.930126 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 267329us
I20260709 13:06:47.764904 24308 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:47.939954 24502 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:06:47.945823 22605 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
W20260709 13:06:47.961524 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 139721us
W20260709 13:06:47.963171 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49199.7us
I20260709 13:06:47.973675 21916 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:47.969697 21946 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:47.999029 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:48.002583 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:48.003252 21868 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.009729 21988 leader_election.cc:400] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 7.
I20260709 13:06:48.013446 21868 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:48.015527 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:47.932749 24463 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:06:48.017158 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.922359 24443 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:06:48.015758 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:47.960938 24268 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:48.023123 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49530.9us
I20260709 13:06:47.970654 24462 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:47.965656 24367 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.028249 21868 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:48.031203 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:48.032358 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:47.928086 24370 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.035722 21870 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:48.039820 21916 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:48.036578 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:48.040704 21875 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
W20260709 13:06:48.036854 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 43805us
I20260709 13:06:48.042886 24416 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:48.043303 24416 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:48.043661 24481 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.044094 24481 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.044415 24481 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.040575 24367 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.052703 24367 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:48.052960 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.032845 24462 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.053556 24462 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.966674 24358 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.064298 21916 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:48.067276 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:48.068419 24286 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.071633 24286 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:48.072005 24286 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.074810 24308 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:48.076138 24310 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.076642 24310 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.077037 24310 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.076906 24324 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:48.033465 24268 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.082458 21988 leader_election.cc:400] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
I20260709 13:06:48.082832 21988 leader_election.cc:403] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.034089 24431 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.091352 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:48.092257 21875 raft_consensus.cc:2410] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:06:48.093688 22019 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.021s
W20260709 13:06:48.094208 22019 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.009s	sys 0.021s
I20260709 13:06:48.096304 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:48.097288 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:48.099388 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 277458us
I20260709 13:06:48.102089 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.103756 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.110442 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.099021 21839 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:48.087615 24308 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
I20260709 13:06:48.089221 24431 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.113231 24450 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:48.106495 23611 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.112134 24324 consensus_queue.cc:1243] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:48.115945 24425 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.117919 24467 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:48.106854 24364 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:06:48.128154 24431 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.122978 24514 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.126803 24476 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:06:48.164096 24308 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.161974 24450 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.212997 21872 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:48.161381 24425 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.195173 21875 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:48.193416 21868 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:48.207487 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 97175.3us
I20260709 13:06:48.168824 24367 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:48.211998 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 97471.8us
I20260709 13:06:48.190775 24398 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:48.226073 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:48.226827 21868 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:48.220796 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:48.228058 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:48.228624 22609 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:48.229290 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 123357us
I20260709 13:06:48.230103 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:48.224300 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:48.211561 24521 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.215601 24450 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:48.242393 21946 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:06:48.243886 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.230937 21875 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.233319 22019 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:06:48.213188 24308 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.219396 24425 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.213780 24515 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.213044 24514 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:48.163743 24467 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.228729 24470 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:48.253826 24329 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.001s
I20260709 13:06:48.257236 24358 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:48.256173 24462 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.263533 22609 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:48.266958 21875 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:48.234210 23611 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:48.272991 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.269675 24308 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.307765 21943 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:48.309043 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:48.309782 21946 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:48.311080 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:48.312192 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:48.317560 24491 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:48.317974 24491 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:48.318749 24491 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.322597 24481 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.281311 24286 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.247761 24479 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.325824 24479 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.327025 24286 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:48.284384 24515 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.327913 24479 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.270550 24370 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.227645 24367 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.331967 24515 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.332093 24367 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.290191 23611 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:48.292083 24492 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.757s	user 0.004s	sys 0.000s
I20260709 13:06:48.298696 24462 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.299381 24514 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:48.301946 24517 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:06:48.302714 24523 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:06:48.303154 24511 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:06:48.238970 24521 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.285331 24470 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:48.352154 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73586.9us
W20260709 13:06:48.283664 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53640.8us
W20260709 13:06:48.347296 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 97394.3us
I20260709 13:06:48.355031 22016 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:48.355108 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:48.355847 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 220) took 1100 ms. Trace:
I20260709 13:06:48.356490 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:48.356207 22016 rpcz_store.cc:276] 0709 13:06:47.255817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.576573 (+320756us) service_pool.cc:224] Handling call
0709 13:06:48.354513 (+777940us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800200498. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:48.354710 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.355601 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.355790 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897792}
I20260709 13:06:48.359459 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:48.359745 21841 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.587s (SENT)
I20260709 13:06:48.287010 24467 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:48.361533 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:48.316035 24416 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.361905 24452 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.361011 23611 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.360805 24532 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.357043 24358 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:06:48.397727 24268 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.414755 24521 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.416153 24268 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.399966 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2178) took 1084 ms. Trace:
W20260709 13:06:48.417420 24520 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:06:48.402750 24431 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.419488 24431 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.416827 22018 rpcz_store.cc:276] 0709 13:06:47.315193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.582515 (+267322us) service_pool.cc:224] Handling call
0709 13:06:47.582813 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:47.592695 (+  9882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.592724 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:47.710656 (+117932us) log.cc:844] Serialized 52 byte log entry
0709 13:06:48.009762 (+299106us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:48.186853 (+177091us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.188034 (+  1181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.188104 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.399737 (+211633us) raft_consensus.cc:1685] finished
0709 13:06:48.399756 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.399894 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9442,"prepare.queue_time_us":181223,"prepare.run_wall_time_us":3315,"raft.queue_time_us":10499,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":35321,"spinlock_wait_cycles":8190848,"thread_start_us":402788,"threads_started":2,"wal-append.queue_time_us":482603}
I20260709 13:06:48.403756 24529 raft_consensus.cc:1064] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
W20260709 13:06:48.422900 24529 raft_consensus.cc:1068] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Unable to promote non-voter bcc802f7bc374bed98e2ee0596a8ebda: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:06:48.424450 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.426083 24308 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.403672 24416 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.366753 24481 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.445343 24462 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:48.446009 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 75928.5us
I20260709 13:06:48.371794 24286 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:48.449234 24439 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.362516 24515 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:48.367641 24452 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.369846 24310 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:48.462008 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100575us
W20260709 13:06:48.473145 24518 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.219s	user 0.000s	sys 0.002s
I20260709 13:06:48.473453 24341 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:48.473965 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.461568 24238 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.476429 24268 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:48.483248 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.486162 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:48.459870 24463 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.496658 21988 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:48.542311 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45759.3us
I20260709 13:06:48.543107 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:48.524241 22576 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.988s (SENT)
I20260709 13:06:48.497694 22608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 430) took 1926 ms. Trace:
I20260709 13:06:48.508226 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:48.544258 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.544502 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:48.557060 21949 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:48.461433 24452 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.571175 24535 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.572077 24535 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:48.572829 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 85613us
I20260709 13:06:48.573048 24530 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.574133 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:48.544799 22608 rpcz_store.cc:276] 0709 13:06:46.571514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.571756 (+   242us) service_pool.cc:224] Handling call
0709 13:06:46.588861 (+ 17105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.653852 (+ 64991us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:46.671202 (+ 17350us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.869906 (+198704us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.870379 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.870506 (+   127us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:46.870728 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.030207 (+159479us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800085f00. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:47.560925 (+530718us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800085f00. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:06:47.856319 (+295394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.497308 (+640989us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b540057dfd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:48.497384 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.497446 (+    62us) raft_consensus.cc:1685] finished
0709 13:06:48.497464 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.497630 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6257,"prepare.queue_time_us":14296,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":34389,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":12256,"spinlock_wait_cycles":217427712,"thread_start_us":458419,"threads_started":2,"wal-append.queue_time_us":300019,"wal-append.run_cpu_time_us":2392,"wal-append.run_wall_time_us":1044397}
I20260709 13:06:48.457109 24450 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.461431 24431 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.107s
W20260709 13:06:48.595745 21841 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.916s (SENT)
I20260709 13:06:48.563875 24439 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:48.613389 24329 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:48.575975 24407 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.565481 24268 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.617048 24268 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:48.589562 24530 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.618304 24530 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.596282 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:48.606199 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:48.462924 24515 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.610778 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:48.591387 24087 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:06:48.588557 24467 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.612790 24429 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:06:48.575073 24463 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.580225 23611 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.644964 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:48.549456 24238 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.652621 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:48.593954 24521 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.629083 24268 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.651309 24407 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:48.666090 24407 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:48.666919 24407 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.667905 24407 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.651095 24490 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.668913 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2186) took 1107 ms. Trace:
I20260709 13:06:48.669195 24432 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.669837 24531 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.670351 24531 raft_consensus.cc:697] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:48.654536 24383 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:48.671459 24467 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:48.671175 24531 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.672199 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:48.669318 22022 rpcz_store.cc:276] 0709 13:06:47.561047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.668985 (+107938us) service_pool.cc:224] Handling call
0709 13:06:47.731053 (+ 62068us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:47.778151 (+ 47098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.778192 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:47.820214 (+ 42022us) log.cc:844] Serialized 52 byte log entry
0709 13:06:48.087599 (+267385us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:48.087642 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.087705 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.472506 (+384801us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:48.663942 (+191436us) raft_consensus.cc:1685] finished
0709 13:06:48.663969 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.668844 (+  4875us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25838,"raft.queue_time_us":26071,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":52879,"spinlock_wait_cycles":58030336,"thread_start_us":161403,"threads_started":1,"wal-append.queue_time_us":376933}
I20260709 13:06:48.628727 24529 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:06:48.643630 24358 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:06:48.758163 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 81728.2us
I20260709 13:06:48.749410 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:48.804757 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 119249us
I20260709 13:06:48.659798 24462 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:48.912724 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 338657us
I20260709 13:06:48.914573 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:48.915850 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.660727 24308 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:48.918269 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:48.917673 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 265158us
I20260709 13:06:48.851323 24345 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.845574 24450 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:48.714006 24534 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.930413 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:48.930681 24534 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.749207 24310 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.931094 22603 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:48.927373 24345 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:48.674098 24521 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.925655 24503 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:06:48.932447 24526 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.681s	user 0.002s	sys 0.005s
I20260709 13:06:48.932247 24345 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.933036 24503 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:48.933429 24503 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:48.933530 24345 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.934108 24521 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:48.928158 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.755357 24490 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:48.934366 24503 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.935695 24503 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.936635 24452 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.918957 24467 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.938980 24515 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:48.939268 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 435) took 1517 ms. Trace:
I20260709 13:06:48.939724 22602 rpcz_store.cc:276] 0709 13:06:47.422137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.422279 (+   142us) service_pool.cc:224] Handling call
0709 13:06:48.477639 (+1055360us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:48.477838 (+   199us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:48.478285 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.478321 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:48.478940 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 13:06:48.643302 (+164362us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:48.650715 (+  7413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.662366 (+ 11651us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.938930 (+276564us) raft_consensus.cc:1685] finished
0709 13:06:48.938956 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.939204 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2595,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14799,"spinlock_wait_cycles":3643776,"thread_start_us":145521,"threads_started":1,"wal-append.queue_time_us":327868}
I20260709 13:06:48.938958 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:48.943182 24467 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:48.912526 24268 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:48.777141 24286 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:48.867846 24530 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.669834 24432 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.935345 24490 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.958847 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:48.960098 24238 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.961455 21949 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.900130 24463 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:48.929068 24425 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.002s
I20260709 13:06:48.944311 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.918345 24462 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.945046 21772 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 4 to 5, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 5 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.573380 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:48.947454 21841 leader_election.cc:336] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.230s (SENT)
I20260709 13:06:48.949622 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:48.688498 24514 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.955018 24530 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:48.955119 24286 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.929497 24308 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.957757 24432 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:48.953315 24549 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.975654 24549 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:48.977785 24549 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:48.963867 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.979882 24463 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:48.981024 21768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 273) took 12195 ms (client timeout 15000 ms). Trace:
I20260709 13:06:48.981976 24463 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.982467 24530 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.982549 24463 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:48.981449 21768 rpcz_store.cc:269] 0709 13:06:36.785240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.785416 (+   176us) service_pool.cc:224] Handling call
0709 13:06:48.980939 (+12195523us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:44.736385 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:44.883241 (+146856us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:44.885214 (+  1973us) write_op.cc:435] Acquired schema lock
0709 13:06:44.887429 (+  2215us) tablet.cc:662] Decoding operations
0709 13:06:44.945681 (+ 58252us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:44.945773 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:44.945802 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:06:44.946523 (+   721us) tablet.cc:701] Row locks acquired
0709 13:06:44.946540 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:44.946685 (+   145us) write_op.cc:270] Start()
0709 13:06:44.946799 (+   114us) write_op.cc:276] Timestamp: P: 1783602404946633 usec, L: 0
0709 13:06:44.946824 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.951373 (+  4549us) log.cc:844] Serialized 3572 byte log entry
0709 13:06:46.104791 (+1153418us) op_driver.cc:464] REPLICATION: finished
0709 13:06:46.410098 (+305307us) write_op.cc:301] APPLY: starting
0709 13:06:46.410207 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:46.410481 (+   274us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:46.412448 (+  1967us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:46.677363 (+264915us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:46.677631 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:06:46.677690 (+    59us) write_op.cc:312] APPLY: finished
0709 13:06:46.677975 (+   285us) log.cc:844] Serialized 71 byte log entry
0709 13:06:46.678154 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.678270 (+   116us) write_op.cc:454] Released schema lock
0709 13:06:46.678322 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:46.678721 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.678755 (+    34us) write_op.cc:454] Released schema lock
0709 13:06:47.162318 (+483563us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635606f32a 00007f6355ff4f14 00007f6355ff4ec3 00007f6355ff4e38 00007f6355ff4df3 00007f6355ff40dc 00007f635601de16 00007f6356005cbb 00007f6355ff039d 00007f6355ff3d75
Metrics: {"mutex_wait_us":14659,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":297161,"apply.run_cpu_time_us":4745,"apply.run_wall_time_us":268596,"num_ops":9,"prepare.queue_time_us":98316,"prepare.run_cpu_time_us":13213,"prepare.run_wall_time_us":300753,"raft.queue_time_us":637381,"raft.run_cpu_time_us":23892,"raft.run_wall_time_us":1088088,"replication_time_us":1136519,"spinlock_wait_cycles":5482240,"thread_start_us":689985,"threads_started":4,"wal-append.queue_time_us":32774,"wal-append.run_cpu_time_us":28064,"wal-append.run_wall_time_us":2726406}]]}
I20260709 13:06:48.800037 24535 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.964047 21772 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 3 to 6, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 6 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.972082 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:48.983453 24530 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:48.990304 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:48.993489 21875 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:48.991285 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:48.994518 21872 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.967585 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:48.991518 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:48.992074 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:48.990918 21772 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 4 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.996929 21870 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.997819 24450 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:48.970045 24514 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:48.998190 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:48.998528 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:48.998852 21873 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.999122 22022 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:48.999969 24514 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:49.000094 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:48.998272 24450 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.017464 21772 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 4 to 5, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 5 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.007066 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.010268 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:48.965548 24358 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.021656 21772 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 3, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 3 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.025496 21875 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:49.000900 24530 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.951658 24268 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.039880 21873 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:49.040040 24268 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:48.967448 24462 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.001044 24534 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.041224 24463 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:49.041414 21772 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:49.043290 21772 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 4 to 5, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 5 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:49.043668 24530 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.044955 22603 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:49.046633 24549 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:49.047070 24549 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:49.047425 24549 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:49.048280 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.049247 24452 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:48.968720 24425 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:49.050801 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 83726.2us
I20260709 13:06:49.051522 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.052320 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:49.053884 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:49.055052 22023 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:49.056416 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:49.050165 24457 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.059091 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.000572 24286 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.070427 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:49.073861 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:49.117398 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 43655.8us
I20260709 13:06:49.119053 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.085143 22022 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:49.083495 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:49.119818 22017 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:49.118165 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:49.120751 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 487251us
I20260709 13:06:49.111697 22019 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
W20260709 13:06:49.121583 22576 leader_election.cc:336] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.094s (SENT)
I20260709 13:06:49.097239 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:49.077790 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.124318 22021 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:49.125317 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.076949 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:49.119526 21873 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.122479 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.078207 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.128502 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.128050 22019 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:49.129365 22608 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:49.127385 22018 raft_consensus.cc:2376] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7. Re-sending same reply.
I20260709 13:06:49.131140 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:49.132164 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.132319 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:49.130622 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.094707 21870 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:49.056967 24450 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.112931 24467 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:06:49.136157 22023 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:48.998281 24308 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:49.138881 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.077178 24425 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:49.118669 24416 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.663s	user 0.004s	sys 0.005s
I20260709 13:06:49.097471 24439 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:49.123303 24534 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.189342 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:49.189939 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.078989 24358 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.193481 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:49.195886 22017 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.140126 23611 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:49.196820 22022 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:49.179644 24137 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.123281 24452 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:06:49.179847 24268 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.200645 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:49.185349 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.210165 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:49.213869 21870 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.191191 24310 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.219133 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:49.221033 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.236579 22022 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:49.222116 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.226136 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:49.238134 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:49.227852 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:49.240478 22017 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
W20260709 13:06:49.240707 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 51447.4us
I20260709 13:06:49.241570 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.197257 24541 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:49.349403 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 130370us
I20260709 13:06:49.349061 22607 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:49.352531 22607 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:49.352913 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:49.244154 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.355276 22022 raft_consensus.cc:2410] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:06:49.355083 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 111363us
I20260709 13:06:49.356248 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:49.245852 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.239216 22024 raft_consensus.cc:2410] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:49.268904 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:49.358532 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 89771.8us
I20260709 13:06:49.359457 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:49.259984 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.360544 24398 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:49.353658 22607 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.363827 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:49.365912 22607 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:49.265507 24537 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.624s	user 0.003s	sys 0.000s
I20260709 13:06:49.275157 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.384778 22021 raft_consensus.cc:2410] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:49.261093 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:49.389475 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.347443 21870 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:49.244637 24548 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.246730 24515 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.246884 24367 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.415051 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:49.394456 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:49.265555 24358 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:49.263468 24470 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:49.358027 24531 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.232494 22603 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:49.218614 24268 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.229514 24431 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.156s
I20260709 13:06:49.245664 24519 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:49.378548 22607 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:49.360864 24344 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:49.417096 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:49.491274 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:49.491961 21870 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:49.363895 24475 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:49.391338 24514 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:49.393039 24503 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:49.472995 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 52550us
I20260709 13:06:49.217687 24137 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.242827 24310 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.274691 24462 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.362836 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:49.396127 24398 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:49.520253 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:49.516255 24475 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:49.520380 24398 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.490949 24519 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.521462 24547 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:49.521773 24519 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.521938 24547 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:49.522433 24547 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.362574 24521 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:06:49.523680 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:49.401407 23881 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:49.525300 24555 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:49.525017 23881 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.525501 24476 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:49.525983 24476 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.420482 24369 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:49.526340 24476 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.526548 24369 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:49.527168 23881 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.527518 24369 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.521494 24475 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.271400 24439 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.508119 24515 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:49.511085 24496 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:06:49.514123 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.490409 24344 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:49.548657 24344 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.549170 24137 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:49.246111 24308 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:49.535554 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 172781us
I20260709 13:06:49.483809 24535 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:49.483424 24534 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:49.552506 24549 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.002s
I20260709 13:06:49.556186 24535 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.555266 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.558089 24310 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.556422 24549 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.546298 24503 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.560225 24450 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:49.561576 22016 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:49.562274 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:49.563097 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.558633 24535 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.511989 24514 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:49.479055 24531 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.574326 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 513) took 1087 ms. Trace:
I20260709 13:06:49.421972 23611 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.582600 22604 rpcz_store.cc:276] 0709 13:06:48.486550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.486822 (+   272us) service_pool.cc:224] Handling call
0709 13:06:49.513968 (+1027146us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:49.574263 (+ 60295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6659328}
I20260709 13:06:49.415650 24548 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.587167 22608 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:49.573611 24514 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.574673 24549 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.594354 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:49.596711 22604 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.564549 24515 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.572150 24503 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:49.592361 24490 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:06:49.591965 24329 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:49.621063 24462 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:49.613894 24503 consensus_queue.cc:1243] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:06:49.628626 24552 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:06:49.629037 24548 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:49.631709 24563 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:06:49.571460 24534 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.637360 24531 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:49.638332 24557 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:49.638887 24457 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.639075 24514 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.642573 24514 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.643281 24534 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.644317 24519 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.515172 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:49.683363 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:49.543782 21872 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.000s
I20260709 13:06:49.685132 21872 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:49.687472 21872 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.696173 21872 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:49.701689 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:49.705365 21947 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:49.839614 24367 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:49.840957 24367 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.848673 24548 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.849831 24548 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:49.852792 24479 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:49.854024 24514 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:49.853978 24479 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.855381 24514 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.704640 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:49.861227 24521 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:49.799993 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:49.862287 24521 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.758064 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.867499 21872 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:49.873292 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:49.769610 24329 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:49.881487 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.882630 24503 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:49.882726 24534 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:49.883831 24534 consensus_queue.cc:1243] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:49.883678 24503 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.884578 24532 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:49.835592 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 132519us
I20260709 13:06:49.885049 24532 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:49.888571 24532 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.889495 24515 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.890488 24532 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.898810 24503 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:49.900352 22017 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:49.901878 24519 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.902066 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.902598 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:49.905753 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 534) took 1430 ms. Trace:
I20260709 13:06:49.906328 22605 rpcz_store.cc:276] 0709 13:06:48.474933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.480919 (+  5986us) service_pool.cc:224] Handling call
0709 13:06:48.582186 (+101267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.620859 (+ 38673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:48.620913 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:48.620970 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:48.621024 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.905133 (+1284109us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b54002f80d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:49.905254 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.905517 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88342272}
I20260709 13:06:49.902750 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:49.905712 22017 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:49.910861 22609 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:49.912801 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:49.914132 22610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 514) took 1421 ms (client timeout 1705 ms). Trace:
W20260709 13:06:49.914642 22610 rpcz_store.cc:269] 0709 13:06:48.492692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.492821 (+   129us) service_pool.cc:224] Handling call
0709 13:06:49.912353 (+1419532us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:49.914043 (+  1690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9706880}
I20260709 13:06:49.851779 24548 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:49.916925 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.918664 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:49.869576 24367 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.878684 21869 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:49.922937 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 536) took 1419 ms. Trace:
I20260709 13:06:49.921444 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:49.923866 21947 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:49.765165 24268 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.927161 24514 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.927510 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:49.927747 21872 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.928375 22021 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.932987 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:49.933414 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:49.923395 22607 rpcz_store.cc:276] 0709 13:06:48.489082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.489834 (+   752us) service_pool.cc:224] Handling call
0709 13:06:48.490280 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:49.348937 (+858657us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54006d1620. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fe9dc0 00007f63560741c0 00007f6356075231 00007f6356071d8f 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c
0709 13:06:49.484101 (+135164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.908147 (+424046us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54006d1354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:49.908469 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375528960}
I20260709 13:06:49.934991 21869 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:49.764953 24450 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:49.926369 24521 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.943903 24431 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:49.944919 21950 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:49.946106 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.947156 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.949818 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:49.955675 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.960143 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:49.960237 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.963646 24514 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:49.964365 24514 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:49.972189 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51525us
I20260709 13:06:49.973932 24514 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:49.975930 24429 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:49.977226 21869 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:06:49.976987 24268 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:49.979557 24547 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:49.981294 22607 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:49.953318 24563 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.077s	user 0.001s	sys 0.004s
I20260709 13:06:49.984908 22021 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:49.969305 22017 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.966663 22604 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:49.996723 21872 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:50.006647 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:50.011376 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:50.011584 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:49.994961 24329 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.027498 24344 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.028800 22021 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.030810 22015 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:50.031884 24551 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.483s	user 0.001s	sys 0.001s
I20260709 13:06:50.032779 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:50.037386 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:50.038053 24558 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.519s	user 0.002s	sys 0.000s
W20260709 13:06:50.051486 24560 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.499s	user 0.001s	sys 0.001s
I20260709 13:06:50.059478 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2120) took 1066 ms. Trace:
I20260709 13:06:50.061236 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2119) took 1068 ms. Trace:
I20260709 13:06:50.061517 24479 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:50.061689 21867 rpcz_store.cc:276] 0709 13:06:48.992888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.993009 (+   121us) service_pool.cc:224] Handling call
0709 13:06:49.113483 (+120474us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:49.144439 (+ 30956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.144487 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:49.182234 (+ 37747us) log.cc:844] Serialized 78 byte log entry
0709 13:06:49.489070 (+306836us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:49.679020 (+189950us) log.cc:844] Serialized 14 byte log entry
0709 13:06:49.679726 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.679963 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.050185 (+370222us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:50.060773 (+ 10588us) raft_consensus.cc:1685] finished
0709 13:06:50.060874 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.061061 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19722,"prepare.queue_time_us":376077,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":182962,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":42584,"spinlock_wait_cycles":11878784,"thread_start_us":430286,"threads_started":2,"wal-append.queue_time_us":357523}
I20260709 13:06:50.059916 21871 rpcz_store.cc:276] 0709 13:06:48.993311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.993416 (+   105us) service_pool.cc:224] Handling call
0709 13:06:49.114255 (+120839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.133805 (+ 19550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.133848 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.134436 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.415687 (+281251us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:49.415727 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.415805 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:49.981362 (+565557us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b48000801d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:06:50.037097 (+ 55735us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:50.059009 (+ 21912us) raft_consensus.cc:1685] finished
0709 13:06:50.059036 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.059244 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19068,"raft.queue_time_us":22998,"raft.run_cpu_time_us":4085,"raft.run_wall_time_us":840122,"spinlock_wait_cycles":117885568,"thread_start_us":213154,"threads_started":1,"wal-append.queue_time_us":332541}
I20260709 13:06:50.067521 21868 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:50.061296 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:50.069841 22020 raft_consensus.cc:2410] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:50.054008 22610 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:50.072263 24535 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:50.072456 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:50.073046 24535 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.075421 24535 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:50.075778 21874 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:50.076157 22602 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:06:50.077248 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:50.078624 24548 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:50.079952 24548 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:50.081192 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.081759 24439 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:50.082607 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1162) took 1073 ms. Trace:
I20260709 13:06:50.082506 24439 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:50.083027 22016 rpcz_store.cc:276] 0709 13:06:49.009071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.009195 (+   124us) service_pool.cc:224] Handling call
0709 13:06:50.082135 (+1072940us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400332f54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:50.082371 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996878720}
I20260709 13:06:50.083904 22018 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:50.084460 24450 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.084867 24308 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.085163 24450 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.085667 24308 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.087833 24450 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:50.089911 24467 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:50.090122 24439 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:50.093609 24439 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.056039 24344 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:50.070156 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:50.080991 24534 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:50.090651 24467 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:50.071727 22020 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.041256 24547 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:50.052964 24550 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:50.055553 24476 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.529s	user 0.020s	sys 0.000s
I20260709 13:06:50.088325 21871 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.064465 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:50.088277 24308 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:50.118791 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:50.103636 22021 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:50.108144 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:50.108947 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 70389.9us
I20260709 13:06:50.118168 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:50.117947 24534 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:50.078115 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 439) took 1127 ms. Trace:
W20260709 13:06:50.052990 24562 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.533s	user 0.002s	sys 0.000s
I20260709 13:06:50.123667 22017 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:50.125186 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:50.129144 22016 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:50.122828 22602 rpcz_store.cc:276] 0709 13:06:48.950309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.966635 (+ 16326us) service_pool.cc:224] Handling call
0709 13:06:49.902163 (+935528us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:50.078036 (+175873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9116416}
I20260709 13:06:50.131906 21874 raft_consensus.cc:1217] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Deduplicated request from leader. Original: 6.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 13:06:50.095387 24439 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:50.132881 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:50.131960 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:50.135505 21874 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:50.175571 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.133419 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:50.232370 22022 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.240736 22016 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:50.175659 22610 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.182611 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:50.247749 24514 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:50.247993 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 65687.6us
I20260709 13:06:50.253140 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.254541 21947 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:50.256170 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.251967 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:50.257215 24238 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:06:50.260140 24548 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.179879 24580 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.267228 24512 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:50.263532 24580 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:50.269265 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:50.270174 24530 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:50.271652 24580 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:50.272871 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.273440 24467 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:50.274273 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 252) took 2819 ms. Trace:
I20260709 13:06:50.274683 22015 rpcz_store.cc:276] 0709 13:06:47.455092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.604448 (+149356us) service_pool.cc:224] Handling call
0709 13:06:47.604838 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.048647 (+2443809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.273949 (+225302us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b540017acd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:50.274182 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5577751296}
I20260709 13:06:50.118016 24476 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.277498 24476 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:50.278425 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.280550 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 132294us
I20260709 13:06:50.281342 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.281987 22021 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:50.283347 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:50.284736 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.285478 22016 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:50.183828 24515 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:06:50.285290 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:50.290596 24495 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:50.291115 24495 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:50.233795 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.295924 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.296240 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.298039 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.297372 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.298710 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:50.299103 21942 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:50.299425 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:50.301925 24586 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:06:50.299471 21875 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:06:50.292073 24495 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:50.304860 24496 consensus_queue.cc:1175] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
I20260709 13:06:50.306358 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:50.307050 22019 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:50.307641 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.308408 21950 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:50.309495 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.309967 21947 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:50.313052 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:50.309559 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.316484 22020 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:50.271689 24329 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:50.317790 24566 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.798s	user 0.001s	sys 0.000s
I20260709 13:06:50.268026 24512 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.319718 22023 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:50.320123 24512 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:50.320271 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1169) took 1307 ms. Trace:
I20260709 13:06:50.320701 22024 rpcz_store.cc:276] 0709 13:06:49.012362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.364134 (+351772us) service_pool.cc:224] Handling call
0709 13:06:49.364506 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.364954 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.364995 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.391515 (+ 26520us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.496974 (+105459us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:49.954164 (+457190us) log.cc:844] Serialized 14 byte log entry
0709 13:06:50.036948 (+ 82784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.037077 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.316961 (+279884us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:50.319772 (+  2811us) raft_consensus.cc:1685] finished
0709 13:06:50.319925 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.320095 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149663,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":31713,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":17228,"spinlock_wait_cycles":63417088,"thread_start_us":444691,"threads_started":2,"wal-append.queue_time_us":101324}
I20260709 13:06:50.285362 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:50.326212 21947 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.304493 24495 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.328306 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.331589 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.332219 24463 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:50.332392 24559 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.813s	user 0.003s	sys 0.000s
I20260709 13:06:50.338968 24467 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:06:50.349092 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2130) took 1215 ms. Trace:
I20260709 13:06:50.350564 22021 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:50.352103 24581 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
I20260709 13:06:50.349525 21873 rpcz_store.cc:276] 0709 13:06:49.133988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.135073 (+  1085us) service_pool.cc:224] Handling call
0709 13:06:49.135298 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.164223 (+ 28925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.164285 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.164780 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.393752 (+228972us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:49.393792 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.393860 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.331439 (+937579us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:50.348536 (+ 17097us) raft_consensus.cc:1685] finished
0709 13:06:50.348560 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.348915 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28530,"raft.queue_time_us":28662,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5591,"spinlock_wait_cycles":43937024,"thread_start_us":190608,"threads_started":1,"wal-append.queue_time_us":329749}
I20260709 13:06:50.355525 24491 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.352131 24450 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:50.356489 24450 consensus_queue.cc:1243] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:50.241703 24534 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:50.126925 24550 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.183604 24521 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.230s
W20260709 13:06:50.418517 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 78917.2us
I20260709 13:06:50.415256 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:50.419268 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 133964us
I20260709 13:06:50.418311 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.356956 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:50.423623 22023 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:06:50.380756 24578 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.441s	user 0.003s	sys 0.000s
I20260709 13:06:50.412953 24463 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.357183 24450 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:50.352524 24439 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:50.431948 21947 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:50.434487 24450 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:50.438200 24450 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:50.439903 24450 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.448832 24580 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:50.449391 24580 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:50.450450 24580 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.434906 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:50.480891 24580 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.481465 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:50.482156 22015 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.486382 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:50.489800 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:50.490501 22019 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.492460 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:50.492868 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:50.493268 22023 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:50.492471 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:50.499015 22022 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
W20260709 13:06:50.502876 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 218602us
I20260709 13:06:50.507036 22610 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:50.495415 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:50.508893 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:06:50.510581 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.511530 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.513777 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:50.517622 22022 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:50.515158 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 89449.3us
I20260709 13:06:50.507820 21987 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:50.511309 24575 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.014s
I20260709 13:06:50.502832 24463 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:50.544045 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.541047 22020 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
W20260709 13:06:50.544515 24575 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.005s	sys 0.014s
I20260709 13:06:50.557714 22610 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:06:50.544824 24439 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:50.581430 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 149348us
I20260709 13:06:50.583885 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:50.570417 24439 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:50.592319 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.601063 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:50.592958 22576 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.637s (SENT)
I20260709 13:06:50.608489 22015 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:06:50.610882 22024 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:50.603410 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:50.596060 24439 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.597740 24515 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.590489 24479 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:50.638226 24364 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:50.619472 24450 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.642414 24364 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.642937 24364 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.642655 24450 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.644738 21946 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:50.647311 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:50.648361 21947 raft_consensus.cc:2410] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:50.639410 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:50.649693 24467 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:06:50.658903 24467 consensus_queue.cc:1243] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:06:50.671303 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 353448us
I20260709 13:06:50.673606 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:50.644467 24550 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:50.659024 24475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.012s	sys 0.009s
W20260709 13:06:50.683338 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.692205 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 75095.8us
W20260709 13:06:50.693614 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.638178 24548 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:50.688575 24475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.013s	sys 0.009s
I20260709 13:06:50.745522 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:50.747373 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 58615.8us
W20260709 13:06:50.747200 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 74103.1us
I20260709 13:06:50.656114 24515 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.705926 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:50.717212 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 128474us
I20260709 13:06:50.767087 22019 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:50.677166 24479 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:50.707741 24548 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.778061 24531 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:50.783877 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 129932us
W20260709 13:06:50.785024 24594 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:06:50.791124 24490 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:06:50.807365 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 99130.5us
I20260709 13:06:50.703040 24545 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:06:50.832216 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:50.832050 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 70412.2us
I20260709 13:06:50.703510 24450 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:50.807998 24548 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:50.848522 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 47562.4us
I20260709 13:06:50.817203 24531 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:50.837459 24521 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:50.888207 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 182412us
W20260709 13:06:50.904881 24591 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:06:50.905180 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:50.905759 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2136) took 1700 ms. Trace:
I20260709 13:06:50.906672 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:50.907582 24598 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:06:50.908063 24238 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.867697 24550 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:50.910828 24545 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:50.911304 24550 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.912701 24370 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:50.913117 24515 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:50.913316 24370 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:50.913765 24515 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:50.915517 24370 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:50.899923 24490 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:50.921205 24490 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:50.906224 21869 rpcz_store.cc:276] 0709 13:06:49.205007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.006574 (+801567us) service_pool.cc:224] Handling call
0709 13:06:50.011680 (+  5106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.119575 (+107895us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:50.119613 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.140622 (+ 21009us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.528441 (+387819us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:50.528500 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.528670 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.905527 (+376857us) raft_consensus.cc:1685] finished
0709 13:06:50.905549 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.905698 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23505,"raft.queue_time_us":40016,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":20980,"thread_start_us":259346,"threads_started":1,"wal-append.queue_time_us":391033}
I20260709 13:06:50.928073 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:50.945425 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 167610us
W20260709 13:06:50.946278 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.875417 24531 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.907616 21916 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:50.951292 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 104729us
I20260709 13:06:50.951224 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2135) took 1753 ms. Trace:
I20260709 13:06:50.952848 21872 rpcz_store.cc:276] 0709 13:06:49.198137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.999997 (+801860us) service_pool.cc:224] Handling call
0709 13:06:50.020085 (+ 20088us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:50.109434 (+ 89349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.109474 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:50.110233 (+   759us) log.cc:844] Serialized 52 byte log entry
0709 13:06:50.323600 (+213367us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:50.385032 (+ 61432us) log.cc:844] Serialized 14 byte log entry
0709 13:06:50.385345 (+   313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.385510 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.414529 (+ 29019us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b18002f0860. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:50.922769 (+508240us) raft_consensus.cc:1685] finished
0709 13:06:50.950967 (+ 28198us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.951155 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8297,"prepare.queue_time_us":61188,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":76669,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":9376,"spinlock_wait_cycles":17543552,"thread_start_us":212869,"threads_started":1,"wal-append.queue_time_us":340971}
I20260709 13:06:50.894320 24475 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:50.980383 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 72911.4us
W20260709 13:06:50.980609 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 84397.3us
I20260709 13:06:50.944586 24450 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:50.986462 22601 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.991771 24521 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:51.007612 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:50.922557 24490 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.017656 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:51.020803 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 114234us
I20260709 13:06:51.025115 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:51.010711 24534 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:51.029946 22610 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:06:51.030777 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.034672 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:51.035462 22610 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:06:51.037256 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.039057 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 198468us
I20260709 13:06:51.044689 24549 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:51.022861 24580 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
I20260709 13:06:51.026703 23611 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.010186 24450 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.030504 24418 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.013602 24495 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:51.028831 24534 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:51.054400 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:51.059549 24491 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.001s
W20260709 13:06:51.062561 24601 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.153s	user 0.003s	sys 0.000s
I20260709 13:06:51.053692 24549 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:51.074048 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 241930us
I20260709 13:06:51.068727 24490 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.080029 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:51.065048 24550 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:51.057615 24479 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.072773 24583 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.083652 22606 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:51.111914 24137 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.112324 24622 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:51.112500 24137 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:51.113456 24602 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.077s	user 0.003s	sys 0.001s
I20260709 13:06:51.115334 24344 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.116068 24344 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.065469 23611 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.069911 24418 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.110706 24238 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.139444 23611 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:51.141471 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.142807 21943 raft_consensus.cc:2410] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:06:51.139828 24610 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:06:51.150825 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 81391.8us
I20260709 13:06:51.099120 24521 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:51.155508 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 114214us
I20260709 13:06:51.108907 24364 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.156206 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:51.166659 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:51.130146 24620 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:06:51.179971 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:51.181253 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:51.182825 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:51.183205 24402 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:51.184278 24402 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:51.184644 24402 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.185693 24402 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:51.186520 24463 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.640s	user 0.005s	sys 0.006s
I20260709 13:06:51.174881 24238 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.186935 24463 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.191886 24600 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.185705 24364 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:51.193820 24600 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.195173 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:51.202545 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:51.207852 24137 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:51.209930 24369 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:51.212800 24622 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.216689 24545 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:51.220743 24619 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.170s	user 0.003s	sys 0.000s
I20260709 13:06:51.222381 24531 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.224743 24531 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:51.155009 24534 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.230124 24370 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:51.230727 24600 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.247855 24418 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.247457 23611 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:51.234001 24624 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.249125 24475 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:51.249013 24624 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.249557 24475 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.250452 24475 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.251372 24624 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:51.196476 24450 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:51.236874 24286 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:51.251965 24475 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.255493 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:51.258281 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.252007 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.240003 24476 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:51.240813 24446 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:51.262250 24625 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.262440 24476 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.246989 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:51.263144 24625 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.245296 24370 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.264053 24623 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.264575 24623 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.264695 24370 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.266136 24370 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.266911 24623 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.247416 24364 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:51.269743 24364 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:51.270045 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 448) took 1701 ms (client timeout 1886 ms). Trace:
I20260709 13:06:51.270135 24364 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.270417 24286 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:51.270619 22606 rpcz_store.cc:269] 0709 13:06:49.569334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.572707 (+  3373us) service_pool.cc:224] Handling call
0709 13:06:49.916560 (+343853us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:51.269878 (+1353318us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000b1b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:51.269987 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2670592128}
I20260709 13:06:51.271373 24286 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:51.257016 24610 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:51.271219 24364 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:51.292469 24545 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:51.316025 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 79900.2us
I20260709 13:06:51.286278 24548 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:51.317369 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 76047.2us
I20260709 13:06:51.189030 24549 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:51.320986 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 138229us
I20260709 13:06:51.186950 24402 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.315739 24545 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.327983 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:51.333093 24364 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.326150 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:51.339808 24439 consensus_meta.cc:287] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
I20260709 13:06:51.346215 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.347839 22021 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:51.351363 24344 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.358495 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.344439 24450 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.366106 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.374554 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.377763 24545 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.379235 24545 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.352221 24439 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.381608 24476 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.382663 24439 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:51.383234 24476 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:51.385236 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.385900 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.389974 22024 raft_consensus.cc:2368] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:51.393469 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:51.394574 21943 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:51.402989 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:51.421449 21841 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.990s (SENT)
I20260709 13:06:51.422201 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:51.352684 24467 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:51.441308 22021 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:51.443953 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:51.445192 24439 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.450868 24439 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:51.466692 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.468709 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 86965.1us
I20260709 13:06:51.431568 24521 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:51.472652 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 106169us
I20260709 13:06:51.402875 24621 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:51.475719 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.452004 24439 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:51.478607 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54783.3us
I20260709 13:06:51.487046 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:51.492112 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.492864 22024 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:51.481886 24548 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.495052 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.495774 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.497309 24439 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.483682 24479 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.501044 22021 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
W20260709 13:06:51.496522 21841 leader_election.cc:336] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.174s (SENT)
I20260709 13:06:51.513974 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:51.515074 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.523916 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.526207 22023 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:51.529305 24548 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.529863 24548 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.530259 24548 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.521368 24479 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.538923 24479 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:51.548403 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61428us
I20260709 13:06:51.557286 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:51.559286 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.556701 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.555941 24479 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:51.575975 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.579420 24625 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.579978 24625 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.583043 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.582631 24625 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:51.570801 24514 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.571192 24621 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:06:51.585062 24514 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.570941 24632 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:51.586470 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.587577 24629 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:51.588986 22021 raft_consensus.cc:2410] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:06:51.588599 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 100107us
I20260709 13:06:51.595753 24514 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.601462 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:51.609325 24534 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.611001 24621 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:51.614539 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:51.613615 24632 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.620584 24632 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.624037 21772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 162) took 8957 ms. Trace:
I20260709 13:06:51.627278 24446 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:51.624454 21772 rpcz_store.cc:276] 0709 13:06:42.666908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.667084 (+   176us) service_pool.cc:224] Handling call
0709 13:06:51.623824 (+8956740us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:49.493997 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:49.634454 (+140457us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:49.635213 (+   759us) write_op.cc:435] Acquired schema lock
0709 13:06:49.635994 (+   781us) tablet.cc:662] Decoding operations
0709 13:06:49.641621 (+  5627us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:49.641677 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:49.641705 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:49.642373 (+   668us) tablet.cc:701] Row locks acquired
0709 13:06:49.642395 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:06:49.642553 (+   158us) write_op.cc:270] Start()
0709 13:06:49.642668 (+   115us) write_op.cc:276] Timestamp: P: 1783602409642495 usec, L: 0
0709 13:06:49.642691 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:49.643390 (+   699us) log.cc:844] Serialized 3170 byte log entry
0709 13:06:49.900545 (+257155us) op_driver.cc:464] REPLICATION: finished
0709 13:06:50.289424 (+388879us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6352f680ac 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6359aa8ef0
0709 13:06:51.026168 (+736744us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18003e95c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:51.053850 (+ 27682us) write_op.cc:301] APPLY: starting
0709 13:06:51.069112 (+ 15262us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:51.131651 (+ 62539us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:51.136418 (+  4767us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:51.232512 (+ 96094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:51.232860 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:06:51.232919 (+    59us) write_op.cc:312] APPLY: finished
0709 13:06:51.233358 (+   439us) log.cc:844] Serialized 65 byte log entry
0709 13:06:51.321040 (+ 87682us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.354286 (+ 33246us) write_op.cc:454] Released schema lock
0709 13:06:51.365018 (+ 10732us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.379426 (+ 14408us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.379456 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1860992,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":670559,"apply.run_cpu_time_us":10646,"apply.run_wall_time_us":343028,"num_ops":8,"prepare.queue_time_us":422707,"prepare.run_cpu_time_us":6424,"prepare.run_wall_time_us":172044,"raft.queue_time_us":250545,"raft.run_cpu_time_us":20407,"raft.run_wall_time_us":670215,"replication_time_us":257552,"spinlock_wait_cycles":54434048,"thread_start_us":1047965,"threads_started":5,"wal-append.queue_time_us":138631,"wal-append.run_cpu_time_us":2288,"wal-append.run_wall_time_us":1010618}]]}
I20260709 13:06:51.627780 24446 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:51.629382 24640 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.129s	user 0.003s	sys 0.000s
I20260709 13:06:51.628937 24446 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.615272 24514 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.639510 24514 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.642565 24514 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.648639 24548 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:51.650267 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 58005.1us
I20260709 13:06:51.615181 24621 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.678821 24621 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.680192 24621 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.677075 24644 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:51.653144 24467 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.683073 24450 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.682952 24467 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.683601 24450 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:51.685781 24450 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:51.685901 24467 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:51.686096 24548 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.636300 24625 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:51.693943 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 105520us
I20260709 13:06:51.695955 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.697817 24644 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:51.698904 24644 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.702446 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.703154 21943 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:51.705394 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:51.709883 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:51.710826 22018 raft_consensus.cc:2410] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:51.711650 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:51.712522 22023 raft_consensus.cc:2410] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:51.693090 24446 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:51.720436 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 127436us
I20260709 13:06:51.724681 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:51.725404 22015 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:51.729485 22016 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:06:51.732043 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:51.736431 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:51.740453 21874 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:51.744694 21869 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:51.728947 24534 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.740414 24600 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.750111 24534 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.750600 24534 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.750355 24600 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.750864 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:51.752769 24600 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:51.753752 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:51.754413 22606 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:51.740351 24463 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.768273 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:51.748494 21838 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:51.772478 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:51.794116 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:51.795706 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:51.796550 21874 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:51.761951 21773 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.801707 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:51.803033 22017 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:51.803440 22017 pending_rounds.cc:85] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 5
I20260709 13:06:51.804765 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:51.805347 22610 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.807655 22604 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:06:51.810105 24635 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.207s	user 0.001s	sys 0.003s
I20260709 13:06:51.804376 24479 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.812561 21773 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.767714 24514 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.820827 24514 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:51.822093 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 78156.9us
I20260709 13:06:51.822634 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:51.822885 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:51.823365 22022 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:51.815434 21773 catalog_manager.cc:5697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.817056 24637 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:51.817520 24629 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:51.818828 24364 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.803673 22017 pending_rounds.cc:107] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:51.828832 22017 raft_consensus.cc:2889] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.801702 24625 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:51.805505 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:51.834035 21943 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 3. Current term is 5. Ops: []
I20260709 13:06:51.807425 24490 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.804275 24467 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:51.838577 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 97151us
I20260709 13:06:51.842160 21867 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:51.842963 24364 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.839164 24479 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.851753 22610 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:51.852033 22015 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:51.852469 22015 pending_rounds.cc:85] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 3
I20260709 13:06:51.852710 22015 pending_rounds.cc:107] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:06:51.839406 24637 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.845093 24514 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:51.833598 24549 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:51.845356 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.845660 21944 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.845952 24636 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:51.881728 22021 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:51.846624 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:51.864884 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.882647 22023 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.838927 24629 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.894893 24629 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:51.848862 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:51.895689 21869 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.844010 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.853039 22015 raft_consensus.cc:2889] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.874747 24467 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.847371 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.875149 22022 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:51.902043 22018 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:51.902149 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 47382.7us
I20260709 13:06:51.883440 21949 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:51.889158 24637 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:51.889897 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:51.905686 21869 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:51.840668 24490 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:51.890404 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:51.849114 24625 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:51.890987 24636 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:51.892210 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:51.892961 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:51.882145 22021 pending_rounds.cc:85] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 2
I20260709 13:06:51.953588 22021 pending_rounds.cc:107] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:51.953966 22021 raft_consensus.cc:2889] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.890259 22606 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:06:51.913203 21773 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.918948 21944 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:51.957641 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 65524.1us
W20260709 13:06:51.958251 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 150635us
I20260709 13:06:51.926112 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:51.926909 24624 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:51.927403 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.961158 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.929113 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:06:51.937731 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.698s (SENT) [suppressed 18 similar messages]
I20260709 13:06:51.961850 21867 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.952653 24490 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.955631 24479 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.977658 21773 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 7, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 7 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.964206 24446 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:52.003229 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 77250.9us
W20260709 13:06:52.004544 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 67981.4us
I20260709 13:06:51.979602 24439 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.956561 24549 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:52.015205 24647 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.205s	user 0.002s	sys 0.000s
W20260709 13:06:52.019651 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.020879 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:52.022509 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.011472 21773 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 5, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.026839 21867 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:52.077545 21773 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:51.993237 24479 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.083463 21773 catalog_manager.cc:5697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:52.089596 21841 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.756s (SENT)
W20260709 13:06:52.092878 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 87617.8us
I20260709 13:06:52.087966 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:52.101346 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 97211.5us
W20260709 13:06:52.103631 24646 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:06:52.104733 24629 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:06:52.109670 24364 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.104911 24418 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.111992 21773 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 5, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.116102 22023 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:52.096426 24439 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.144472 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:52.146883 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57325.1us
I20260709 13:06:52.101686 24467 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.077319 24625 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.153398 21773 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:52.154546 24648 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:06:52.155359 21773 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.158119 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:52.126739 24548 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:52.160327 21773 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.163697 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:52.170480 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 338317us
W20260709 13:06:52.170918 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 348083us
I20260709 13:06:52.172572 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.174973 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:52.176225 21841 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.807s (SENT)
I20260709 13:06:52.168483 21773 catalog_manager.cc:5697] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.182842 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:52.183459 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.182869 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:52.184695 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.184834 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.184909 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.185463 22601 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:52.185746 24636 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.186425 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.186685 24549 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.190066 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.184712 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.191295 24514 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:52.191308 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.192744 21949 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
W20260709 13:06:52.194140 24660 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:06:52.126924 24531 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:06:52.110863 24418 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.169162 24548 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:52.180786 24467 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:52.204897 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.205834 24479 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.194882 24632 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:06:52.207618 24463 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.210335 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:52.210924 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 70514.1us
I20260709 13:06:52.234263 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.183831 21773 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.241026 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.216713 24515 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:52.276046 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 99849.3us
I20260709 13:06:52.203464 24534 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.209535 24636 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:06:52.280108 21773 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.246007 24668 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.242669 24656 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.246202 24515 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:52.288285 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76095.5us
I20260709 13:06:52.291131 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:52.293967 21773 catalog_manager.cc:5697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 6, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.304970 23611 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:52.288986 24664 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:52.224115 24514 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.240375 24521 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:52.293217 24515 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.317009 21773 catalog_manager.cc:5697] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 4, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.323669 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.240427 24463 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.327565 24446 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:52.340899 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 157551us
W20260709 13:06:52.341959 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.323200 24476 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:06:52.346462 24662 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:52.324780 24549 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:52.312829 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "590d7eea40954779924038b15b716b58"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:52.349010 21947 raft_consensus.cc:606] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:52.352408 24418 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.352592 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:52.352171 24531 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:52.353945 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:52.354746 23611 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.355998 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:52.357894 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:52.315824 24664 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.358484 21943 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.330158 21773 catalog_manager.cc:5697] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.360497 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.361395 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:52.352250 24534 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:52.354900 24439 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:52.363505 24659 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 13:06:52.367201 24531 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:52.367799 24531 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:52.369086 24644 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:52.369509 24644 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:52.370461 24644 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.371990 24644 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.349332 24667 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.368670 24531 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.378283 24629 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:52.368413 24490 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.380697 24545 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:52.381651 22605 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:52.380841 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:52.384943 21871 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:52.385313 24636 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:52.319324 24548 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.385851 24636 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:52.387025 21943 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:52.393236 23611 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:52.394052 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.395946 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.399425 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:52.403880 22022 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:52.406411 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:52.407141 22021 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:52.410045 23611 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.395810 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.410861 22016 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:52.411338 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 107963us
I20260709 13:06:52.419942 22023 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:52.422626 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:52.422926 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.424871 24676 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.425452 24676 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.420432 22023 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:52.421655 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.431602 22020 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:52.435205 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.435871 22017 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:52.438515 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:52.385319 24490 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:52.442955 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.443982 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:52.446859 21773 catalog_manager.cc:5697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.420768 24479 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.448827 23611 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.420804 24344 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:52.455338 22576 leader_election.cc:336] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.691s (SENT)
I20260709 13:06:52.440529 24439 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:52.454504 22023 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.472126 22023 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:52.472949 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 49870.4us
I20260709 13:06:52.489104 21773 catalog_manager.cc:5697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:52.420761 24673 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:06:52.452314 24624 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.407114 24667 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.494910 21773 catalog_manager.cc:5697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 1 to 3, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.423960 24682 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:06:52.456883 24463 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:52.473219 24669 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:06:52.409601 24636 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.566260 22023 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
W20260709 13:06:52.555708 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 102767us
W20260709 13:06:52.521808 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 66497.8us
I20260709 13:06:52.459648 24479 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.489185 24629 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:06:52.495450 24439 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:06:52.563311 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 124927us
I20260709 13:06:52.573174 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.573982 21872 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:52.575515 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:52.568480 22023 pending_rounds.cc:85] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 4
I20260709 13:06:52.581249 22023 pending_rounds.cc:107] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:06:52.581636 22023 raft_consensus.cc:2889] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:52.572948 24629 consensus_queue.cc:1243] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:52.570345 24549 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:52.596076 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.596547 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.598518 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:52.600069 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 150257us
I20260709 13:06:52.601467 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.607952 24620 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:52.609790 24685 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:52.610294 24685 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.610328 24667 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.610824 24685 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.617784 24549 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.620267 24549 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.621459 24439 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:52.623466 24677 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260709 13:06:52.629091 24676 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.629269 24490 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:52.635666 24418 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:52.636049 24600 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:52.646759 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.647483 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.648998 21871 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:52.666724 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 161007us
I20260709 13:06:52.700277 21869 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:52.646450 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.692534 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.701339 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:52.701740 21874 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:52.698350 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.698009 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:52.703032 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.703504 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.707624 22607 raft_consensus.cc:2410] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:06:52.688483 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 81258.6us
I20260709 13:06:52.710060 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.710599 23611 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.712085 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.713342 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.711194 23611 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.711162 22018 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:52.708982 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:52.717371 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.718050 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.694151 24656 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:52.722014 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:52.729233 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.722958 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.698421 24624 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.695374 24490 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:52.724481 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.725458 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:52.726681 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.696913 24534 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:52.736174 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.728386 22018 raft_consensus.cc:2376] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5. Re-sending same reply.
I20260709 13:06:52.732512 22015 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 3.
I20260709 13:06:52.718701 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:52.795424 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 78537.5us
W20260709 13:06:52.795107 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 94527.5us
I20260709 13:06:52.797552 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.805105 21869 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:52.798197 22023 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:52.797228 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.798873 22020 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:52.800063 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.809367 22018 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:52.810236 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.810349 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.714867 24467 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:52.799703 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.798648 23611 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.817821 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.819384 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.821605 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:52.822068 24344 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.822613 24344 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.825471 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.827389 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:52.851828 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46755.2us
W20260709 13:06:52.852056 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 125693us
I20260709 13:06:52.854866 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:52.843535 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.858181 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.858960 22021 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:52.859977 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.726222 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.730122 24514 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:52.813609 24650 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:06:52.864460 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:52.868319 22023 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.868719 22018 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:52.865587 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:52.866360 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.724784 24515 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.866959 21947 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:52.869840 21869 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:52.873689 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.813591 24364 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.872432 22019 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:52.876962 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.871796 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.882077 21916 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:52.886888 22020 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:52.887980 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.888850 22020 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:52.875450 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.890975 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.891647 22017 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:52.797170 24624 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.886018 22018 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:52.901114 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:52.903348 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.903851 21872 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:52.904001 21947 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:52.904443 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.905761 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.889957 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:52.896497 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.900060 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.809535 24534 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.927733 23611 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.927114 22609 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:52.909076 22608 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:52.931648 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:52.931772 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:52.878971 24479 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.941902 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:52.932775 21945 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:52.935185 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.932965 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:52.827486 24467 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.907533 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:52.736904 24656 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.871452 24476 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:06:52.903290 24514 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.939299 22020 raft_consensus.cc:2368] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:52.948305 23611 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.947109 22023 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:52.909556 24402 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.948396 24632 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.940776 24344 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.900820 24364 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.961977 24479 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:52.998397 24515 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.936229 24625 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:52.948031 24685 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.935072 24671 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.948381 24672 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.935714 24490 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:52.905983 24545 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.968300 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60867.6us
I20260709 13:06:53.009208 22604 raft_consensus.cc:2368] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6.
I20260709 13:06:53.071116 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:53.042474 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.058647 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.074939 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 221245us
I20260709 13:06:53.072858 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:52.977335 24701 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:06:53.100585 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:53.101506 22607 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:52.964115 22606 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:52.968437 24673 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:53.000587 24688 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:06:53.008942 24490 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:53.005620 24680 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.453s	user 0.002s	sys 0.000s
I20260709 13:06:53.005079 24672 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.123073 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.123903 24672 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:53.007644 24664 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:53.004647 24671 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.003980 24685 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.994926 24467 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:53.127341 24671 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.989015 22603 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:52.978968 24534 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:53.074227 24521 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.990507 24624 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.992846 24364 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:52.962235 24620 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:52.965502 24687 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.008214 24681 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:52.968832 24632 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:53.110918 21874 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:53.097469 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:53.111346 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:53.114271 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 213201us
I20260709 13:06:53.007094 24656 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:52.990684 24692 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.096673 24545 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.078293 24667 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.130154 21950 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:52.964900 24514 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:52.969159 24402 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.149068 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.153492 24664 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.149749 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:53.181849 22024 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.148443 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:53.160718 24679 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.189407 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.194437 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:53.185806 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 88446.2us
I20260709 13:06:53.189407 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:53.197005 21866 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.153657 24620 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:53.190614 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 335812us
I20260709 13:06:53.156810 24681 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:53.162007 24632 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:53.148721 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 238027us
I20260709 13:06:53.198331 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:53.199369 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 267785us
I20260709 13:06:53.213413 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.215608 21988 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:53.217449 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:53.219281 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:53.185215 24692 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:53.218504 22606 raft_consensus.cc:2368] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5.
I20260709 13:06:53.225535 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:53.226711 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:53.230791 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:53.231698 21943 raft_consensus.cc:606] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:53.218636 24439 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.192430 24673 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:53.233510 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.233629 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:53.276641 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 81154.4us
I20260709 13:06:53.277401 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.277590 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:53.203454 24620 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.205420 24521 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.283530 24439 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.283900 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:53.232782 24696 consensus_queue.cc:1059] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:06:53.287475 24439 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.288856 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.289744 23611 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.290110 23611 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.290056 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:53.290652 23611 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:53.289740 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 91700.8us
I20260709 13:06:53.292279 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.199278 24515 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.207357 24703 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:53.300443 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 87824.3us
I20260709 13:06:53.299444 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:53.243979 24467 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.303387 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:53.293744 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 90816.8us
I20260709 13:06:53.225636 24692 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.278821 24624 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.288868 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:53.304734 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:53.305464 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:53.293488 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:53.244915 24534 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:53.293715 24676 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:53.315943 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:53.315819 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.310074 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:53.316191 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:53.318308 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.226052 24687 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.298096 24625 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.323629 24667 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.337378 24625 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.337844 24625 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.337936 24534 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.338562 24534 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:53.339967 24687 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.344780 24687 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.333994 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.302564 24685 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:53.312144 24711 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.336860 24418 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:53.298213 24673 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:53.326553 21838 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:53.282050 24644 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:53.312490 24664 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.297798 24716 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.300236 24439 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:06:53.345332 24698 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.474s	user 0.003s	sys 0.000s
I20260709 13:06:53.298322 24548 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:06:53.356262 24600 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:53.414865 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 102199us
I20260709 13:06:53.423900 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:06:53.417703 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 91230.4us
I20260709 13:06:53.352955 24521 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.353607 24534 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:53.324997 24676 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:53.346364 24707 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.441409 24711 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.442607 24545 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:53.442358 24625 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.443547 24534 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.444129 24534 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.414913 24664 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.445784 24664 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.446229 24534 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:53.431128 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:53.345990 24681 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:53.449026 24705 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:53.427158 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.425580 24521 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.449510 24705 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.449780 24521 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.449944 24705 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.435310 24463 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.437733 24676 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:53.452943 24463 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.453387 24463 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.438608 24710 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.439651 24402 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:53.441004 24514 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:53.441473 24707 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.432085 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:53.421051 24656 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.463588 22023 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:53.411691 24549 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:06:53.427177 24467 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:53.456816 23611 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.455267 24625 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:53.472198 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 168585us
I20260709 13:06:53.483247 21867 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:53.498679 23611 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:53.474212 24514 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:53.469808 24707 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.500851 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:53.505890 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:53.506505 22022 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.478818 24467 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:53.480111 24711 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.512930 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:53.518988 21945 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:53.521379 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:53.477421 24476 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:53.524806 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:53.479251 24479 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:06:53.529553 21874 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:53.526145 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:53.528579 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:53.537873 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:53.537956 21869 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.542375 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:53.514117 24656 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.547840 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.551280 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:53.552063 21943 raft_consensus.cc:606] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:53.555392 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:53.560839 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 136868us
I20260709 13:06:53.469414 24710 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.537748 22603 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:53.578357 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:53.572733 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:53.582764 22019 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:53.572297 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:53.584424 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:53.585120 22022 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:53.589289 21869 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:53.597929 21841 leader_election.cc:400] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:53.598461 21841 leader_election.cc:403] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:53.586373 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:53.600656 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:53.601830 22022 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:53.521221 24711 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.532388 24625 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:06:53.613436 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:53.600530 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:53.498364 24673 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:53.620790 22022 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:53.619664 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:53.626664 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:53.633679 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:53.634874 22019 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:53.555910 24656 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:53.626844 24514 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.644131 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:53.616842 24729 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.646981 22022 pending_rounds.cc:85] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 6
I20260709 13:06:53.654366 22022 pending_rounds.cc:107] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:06:53.654719 22022 raft_consensus.cc:2889] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.632673 24479 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.636919 24624 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.633037 24667 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:53.684028 24721 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:06:53.648233 24514 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.693899 24667 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:53.700912 24668 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:53.701588 24549 raft_consensus.cc:993] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:53.703222 21866 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:53.704460 24514 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.780265 22016 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:53.702109 24731 raft_consensus.cc:1081] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:53.675683 24644 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:06:53.783987 24711 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:53.656746 24729 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.792837 22016 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:53.799561 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 237010us
I20260709 13:06:53.812731 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:53.814148 21944 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:53.816987 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:53.818871 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 173327us
I20260709 13:06:53.807113 24696 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.858325 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:53.864229 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 52786.8us
I20260709 13:06:53.869006 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:53.870205 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:53.875422 24692 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.002s
I20260709 13:06:53.875926 24692 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:53.879096 24735 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 13:06:53.789249 24667 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:53.836422 24490 consensus_meta.cc:287] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.000s
I20260709 13:06:53.847532 24733 raft_consensus.cc:2764] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:06:53.895319 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1205) took 1066 ms. Trace:
I20260709 13:06:53.895983 22024 rpcz_store.cc:276] 0709 13:06:52.823279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.826644 (+  3365us) service_pool.cc:224] Handling call
0709 13:06:52.845535 (+ 18891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.192435 (+346900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.889089 (+696654us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54001f0ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:53.889327 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772937088}
I20260709 13:06:53.890805 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 530) took 1188 ms. Trace:
I20260709 13:06:53.880525 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:53.875471 24736 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:06:53.893970 24675 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.900265 21916 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:53.902004 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:53.897993 22604 rpcz_store.cc:276] 0709 13:06:52.702280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.702632 (+   352us) service_pool.cc:224] Handling call
0709 13:06:53.890521 (+1187889us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400134a54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:53.890722 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669448576}
I20260709 13:06:53.902601 21943 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.903091 21916 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:53.893225 24632 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.004s
I20260709 13:06:53.883584 24711 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:53.906344 24632 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:53.907048 24749 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.866237 24696 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:53.908912 24750 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:53.909498 24671 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.928730 21869 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:53.929076 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:53.913061 24739 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:53.916105 24463 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.930912 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:53.921298 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.930328 21870 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:53.928570 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:53.931645 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:53.916841 24745 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:53.935653 21868 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:53.906039 24629 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:53.949152 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:53.951620 22024 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:53.973862 21869 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:53.933799 24671 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.929003 24750 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.929404 24749 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.934027 24733 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:53.980955 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:53.936472 24745 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.945199 24629 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.937783 24710 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:53.986404 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:53.988078 21870 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:53.905555 24675 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:53.978286 24671 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.980402 24750 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.978622 24749 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:53.998652 24744 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:06:53.999847 24751 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:06:53.988799 24629 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:54.085911 24739 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:53.985237 24745 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:53.997455 24620 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.002s
I20260709 13:06:54.100179 24693 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.100711 24668 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.101408 24463 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.112496 23611 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.113170 23611 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:54.104357 24521 consensus_meta.cc:287] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.009s
I20260709 13:06:54.109530 24625 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.129040 24625 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.131214 24625 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.131723 24625 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.132083 24749 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.133648 24729 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.134199 24729 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.134696 24729 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.135175 24749 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.136922 21870 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.139276 24632 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:54.142417 24664 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.000s
I20260709 13:06:54.142894 24664 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.144631 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1155) took 1244 ms. Trace:
I20260709 13:06:54.144307 24745 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.145015 21950 rpcz_store.cc:276] 0709 13:06:52.900547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.900718 (+   171us) service_pool.cc:224] Handling call
0709 13:06:54.144417 (+1243699us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54000fcb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:54.144523 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426274688}
I20260709 13:06:54.145416 24692 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.146430 24745 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:53.988566 24733 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.110147 24620 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.151090 24629 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.117025 24732 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.156324 24732 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.093288 24624 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.117645 24656 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.121256 21949 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:54.121999 24705 consensus_meta.cc:287] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.004s
I20260709 13:06:54.121763 24514 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.111994 24668 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:54.108816 24753 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.125s	user 0.009s	sys 0.004s
W20260709 13:06:54.149564 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.150745 21867 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:54.150872 24676 consensus_meta.cc:287] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.698s	user 0.006s	sys 0.003s
I20260709 13:06:54.167339 21867 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:54.111634 24693 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.170334 21867 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.132150 24625 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.152093 21945 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.159972 24750 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.160225 24733 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:54.109360 24752 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.132s	user 0.000s	sys 0.013s
I20260709 13:06:54.172930 21867 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.171404 21872 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:54.171918 22573 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:54.177508 21866 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:54.163197 24729 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.160065 24624 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.164590 24705 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.181305 24675 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:54.175645 24707 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.003s
I20260709 13:06:54.183331 24668 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:54.184975 24756 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.117s	user 0.001s	sys 0.012s
I20260709 13:06:54.171083 24676 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:54.187331 24755 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:06:54.188175 24364 raft_consensus.cc:3055] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:54.148186 24521 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:54.176256 24687 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.810s	user 0.011s	sys 0.001s
I20260709 13:06:54.215000 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:54.180341 24664 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.193125 24620 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.233533 21867 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:54.234094 21867 pending_rounds.cc:85] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 2
I20260709 13:06:54.234385 21867 pending_rounds.cc:107] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:54.234699 21867 raft_consensus.cc:2889] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.201076 24708 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.197402 24696 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.241817 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.280264 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.265911 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.290701 22023 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.291244 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:54.218602 24364 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:54.296490 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:54.294600 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.296490 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.223636 24490 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.297618 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.297212 22017 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:54.242234 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:54.237834 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 113359us
I20260709 13:06:54.305110 21874 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:54.306869 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:54.307533 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:54.307543 22018 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:54.308288 22015 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:54.290091 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:54.237887 24712 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.309661 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:54.309684 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:54.296587 24620 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.313269 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.314134 22015 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:54.314254 22017 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.299464 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:54.220224 24707 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.225795 24687 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.322667 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:54.310590 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:54.324173 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:54.326258 22023 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:54.337198 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:54.360502 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:54.363541 22020 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.361053 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:54.374095 22017 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:54.319585 24750 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.318989 24620 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.356575 24664 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.317504 24712 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.409674 24664 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:54.411638 24712 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.411962 24664 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.376942 24514 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:54.413429 24761 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:06:54.340294 24402 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:06:54.394886 24629 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.340572 24632 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:06:54.357828 24364 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.419761 24364 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.408764 24763 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:06:54.434264 24625 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.445487 24625 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.399333 24762 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:54.450042 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:54.451014 21942 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
W20260709 13:06:54.451012 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 141427us
I20260709 13:06:54.452271 21988 leader_election.cc:400] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6.
I20260709 13:06:54.452775 21988 leader_election.cc:403] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.454645 24676 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.466979 24773 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.454825 24624 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.467635 24773 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.468369 24624 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.470207 24624 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.478020 24763 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6.
I20260709 13:06:54.492094 24707 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.496027 24620 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.455219 24705 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.463337 24521 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.453440 24762 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.545425 24762 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.498003 24671 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.548404 24671 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.522068 24679 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.553098 24679 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.559448 24775 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.493433 24687 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:54.504675 24764 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260709 13:06:54.564213 22018 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.562857 24775 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:54.570305 24732 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.570711 24775 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.571470 22018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:54.572263 22018 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:06:54.572500 24703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:06:54.572626 22018 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.573297 21839 leader_election.cc:400] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5.
I20260709 13:06:54.573716 21839 leader_election.cc:403] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.576545 24671 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:54.582056 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:54.584830 24446 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:54.493893 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.561570 22015 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:54.589439 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2280) took 1074 ms. Trace:
I20260709 13:06:54.590021 22020 rpcz_store.cc:276] 0709 13:06:53.515486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.515627 (+   141us) service_pool.cc:224] Handling call
0709 13:06:53.527461 (+ 11834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.364061 (+836600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.589138 (+225077us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54001f18d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:54.589364 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922339584}
I20260709 13:06:54.602854 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.591962 22018 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.606174 22017 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:54.607421 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.608023 22018 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.608327 22015 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:54.609710 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:54.619777 22021 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:54.610846 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.620924 22022 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.622104 24681 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.611299 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.629025 22022 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:54.613231 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.629908 22024 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.631562 24624 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.612296 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.633910 22020 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:54.645951 22024 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:54.646970 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:54.647176 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 72346.8us
I20260709 13:06:54.647804 22023 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:54.648379 24707 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.652668 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:54.654371 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:54.657194 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:54.663672 24707 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5.
I20260709 13:06:54.686517 24749 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:54.687305 24749 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:54.747911 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.801056 24776 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:54.801849 24776 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.804643 24776 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.878069 24708 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:54.878615 24708 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.880283 24708 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:54.895665 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 443474us
I20260709 13:06:54.896505 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:54.897353 24776 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.898581 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:54.899356 24776 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.900650 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:54.901407 24776 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.902773 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:54.903647 24776 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:54.905580 24776 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:54.906919 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:54.910065 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.910640 22020 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.914377 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:54.916018 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:54.916941 24775 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.917665 24775 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:54.918104 24775 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:54.918962 24676 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.919040 24775 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.919608 24676 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.921128 24668 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.921658 24668 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.923520 24656 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:54.924046 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:54.924245 24656 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.924880 24762 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:54.926205 24762 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.926939 24762 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:54.916020 24714 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:54.931565 24714 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.935182 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.918144 24707 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:54.935875 21868 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:54.936159 24707 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.936894 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.937611 21870 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:54.938086 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:54.938686 22019 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:54.938810 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.939400 21873 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:54.939824 22019 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.941080 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.941953 21875 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:54.941869 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.942667 21873 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:54.941123 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.943533 21868 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.944648 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:54.944897 24704 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.945073 23611 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.945379 24704 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.946302 24708 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.946856 24708 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.947263 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.947525 24704 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:54.958324 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.948433 24704 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:54.960047 24693 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.959905 24704 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.960649 24463 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.961213 24463 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:54.962116 24704 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.959255 24708 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.963563 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:54.964206 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:54.964463 22019 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:54.965015 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:54.965893 23611 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:54.965749 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.966220 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:54.966818 22019 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:54.967352 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:54.967519 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.967672 23611 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:54.968070 23611 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:54.968521 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:54.968843 24771 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.968726 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:54.972220 24762 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:54.972760 24762 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.974859 24762 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.975378 24762 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.975404 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:54.975838 24762 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.976135 22019 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:54.978421 24773 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:54.968396 23611 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:54.986608 24545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.009s
W20260709 13:06:54.994716 24545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.000s	sys 0.010s
I20260709 13:06:54.995460 24768 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:54.997464 24768 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:54.997830 24768 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:54.998610 24768 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.999810 24768 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.991873 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:55.002627 24600 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.003010 24600 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.003338 24600 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.003777 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.000722 22020 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:55.004405 21871 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:55.006531 21838 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:55.006937 24656 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:54.993429 24704 consensus_queue.cc:1059] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:55.008898 24704 raft_consensus.cc:3055] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:55.009264 24704 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:55.010136 24704 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.011351 24704 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:54.994076 21987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.003s	sys 0.009s
W20260709 13:06:55.012902 21987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.004s	sys 0.010s
I20260709 13:06:55.013491 22574 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:55.015914 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.017582 24490 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.018006 24490 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.018353 24490 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.020800 24749 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:55.021529 24749 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.030355 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:55.035068 24769 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:55.042776 24749 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:55.043403 24749 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:54.994273 24693 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.044816 24693 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:55.045378 24693 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.976377 24762 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.994940 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:55.073735 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 78864.2us
I20260709 13:06:55.044746 24769 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.077468 24704 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.078506 24704 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.072706 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2197) took 1146 ms. Trace:
I20260709 13:06:55.080792 21872 rpcz_store.cc:276] 0709 13:06:53.926441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.928861 (+  2420us) service_pool.cc:224] Handling call
0709 13:06:55.048538 (+1119677us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540022bad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:55.072583 (+ 24045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550484352}
I20260709 13:06:55.081166 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.077975 24768 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.082082 24768 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.083161 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.084203 24768 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.064762 24490 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.086750 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:55.087283 21866 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.093263 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:55.094201 24776 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.094784 24776 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.095216 24686 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.095585 24704 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.098573 24776 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.095090 24490 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.079391 24769 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.050629 24467 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.099068 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.104342 22022 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:55.107457 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.107795 21866 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:55.072171 24693 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.108218 21872 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:55.110954 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.117574 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.112758 24514 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.118633 24675 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.118582 24514 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.119400 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.119254 24675 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.120193 21949 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:55.121145 24514 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:55.117142 24463 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.117241 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.129890 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:55.113659 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.131413 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.119591 24693 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.121528 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:55.122176 22574 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:55.132251 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.134361 21949 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:55.123508 22601 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:55.123636 24749 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:55.114645 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:55.123903 24704 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.125504 24675 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.116806 24668 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:55.124401 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 542416us
I20260709 13:06:55.132416 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:55.133085 24514 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.133486 24463 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.134953 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.145998 24463 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.146433 24463 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.136590 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:55.147034 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:55.147871 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.148777 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:55.150077 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:55.134703 21949 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:55.139631 24687 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.152669 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:55.144550 23611 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.140815 24793 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.141361 24769 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:55.155191 21949 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.151615 24692 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.171663 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:55.159410 21949 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.162750 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.164490 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.166211 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.174237 22021 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:06:55.147017 24514 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.157888 24749 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:55.168982 24446 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:55.170360 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.180989 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:55.158807 24768 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.182403 24514 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.182435 24624 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.185918 24624 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.187472 24773 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.154237 24687 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.188331 24773 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.188905 24687 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.156654 24664 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.183216 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.153872 24521 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:55.158357 24793 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.156467 24675 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.171015 24490 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.190186 24769 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:55.198107 24490 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.198824 24769 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.197161 24446 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:55.200781 24521 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.200944 24446 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:55.201220 24521 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.197649 24793 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.201905 24446 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.203135 21947 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:55.208073 24675 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:55.208630 24749 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.209072 24749 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:55.209424 24668 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:55.209074 24675 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.209475 24749 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:55.208643 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.171183 24545 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:06:55.224483 21869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2200) took 1293 ms (client timeout 1581 ms). Trace:
I20260709 13:06:55.230748 24696 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:55.231098 21869 rpcz_store.cc:269] 0709 13:06:53.931331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.931445 (+   114us) service_pool.cc:224] Handling call
0709 13:06:55.224188 (+1292743us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54003188d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:55.224400 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86018816}
I20260709 13:06:55.231647 24515 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:55.232086 24515 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:55.220999 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:55.233698 24746 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:55.234251 24746 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:55.239324 24515 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.252300 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:55.253553 22605 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:55.235328 24746 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.255368 24706 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.256114 24706 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.255371 24746 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.260205 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.259399 24706 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.265336 24707 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:55.289801 24693 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.290570 24693 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.292035 24768 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:55.292765 24768 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:55.295668 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.298017 24776 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.298867 24776 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.325604 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.329995 24686 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.331892 24686 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.337678 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:55.344404 24625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.008s	sys 0.006s
W20260709 13:06:55.347128 24625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.013s	sys 0.006s
W20260709 13:06:55.353360 24789 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:06:55.355975 24741 raft_consensus.cc:993] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:06:55.356619 24696 raft_consensus.cc:1081] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
W20260709 13:06:55.359898 24667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.221s	user 0.000s	sys 0.014s
W20260709 13:06:55.375988 24667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.000s	sys 0.014s
I20260709 13:06:55.361455 24545 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:55.362918 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 331701us
I20260709 13:06:55.379221 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 279) took 1572 ms. Trace:
I20260709 13:06:55.379688 21943 rpcz_store.cc:276] 0709 13:06:53.806364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.807039 (+   675us) service_pool.cc:224] Handling call
0709 13:06:53.807333 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.902986 (+ 95653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.378921 (+1475935us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b5400299354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:55.379133 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218713984}
I20260709 13:06:55.407119 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.408185 21943 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:55.408774 24714 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:55.409461 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 228555us
I20260709 13:06:55.409673 24676 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.411338 24762 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:55.412103 24679 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.858s	user 0.013s	sys 0.006s
I20260709 13:06:55.412350 24490 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.413538 24762 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.414400 23611 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:55.415505 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 243920us
W20260709 13:06:55.415623 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 182435us
I20260709 13:06:55.434723 21869 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:55.442256 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 248334us
I20260709 13:06:55.456014 23611 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:55.469830 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:55.470551 21867 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.471417 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.469971 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:55.473038 21874 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.472390 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.476277 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:55.477095 22017 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.415117 24467 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.499528 21773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 251) took 10839 ms. Trace:
I20260709 13:06:55.500872 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:55.501585 22606 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:55.501834 24515 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.502977 24686 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.491854 24676 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.436216 24679 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.505115 24676 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.506562 24679 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.507543 24676 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.495451 24726 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:06:55.508845 24726 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:55.509186 24726 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:55.510017 24726 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.512534 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.496750 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:55.518752 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 55609.8us
I20260709 13:06:55.440059 24446 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.519999 21874 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:55.521215 24681 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.530292 24681 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.539976 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:55.540299 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.548758 21867 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:55.552881 21949 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:06:55.550668 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.553620 22022 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:55.555184 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:55.555830 22608 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:55.492353 24704 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.570129 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.563647 21839 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:55.570801 21874 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:55.521099 24726 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.576668 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:55.579380 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:55.581938 24703 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.584106 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:55.584895 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.585633 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.585865 24514 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.586231 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.599450 22018 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:55.587852 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:55.590662 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:55.499955 21773 rpcz_store.cc:276] 0709 13:06:44.660583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.723097 (+ 62514us) service_pool.cc:224] Handling call
0709 13:06:55.499463 (+10776366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:53.368916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:53.483056 (+114140us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:53.483107 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:06:53.483127 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:53.825487 (+342360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:53.825562 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:53.825594 (+    32us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:06:54.109339 (+283745us) tablet.cc:701] Row locks acquired
0709 13:06:54.117418 (+  8079us) write_op.cc:260] PREPARE: finished
0709 13:06:54.117585 (+   167us) write_op.cc:270] Start()
0709 13:06:54.117738 (+   153us) write_op.cc:276] Timestamp: P: 1783602414117521 usec, L: 0
0709 13:06:54.117761 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:54.118604 (+   843us) log.cc:844] Serialized 8166 byte log entry
0709 13:06:54.606633 (+488029us) op_driver.cc:464] REPLICATION: finished
0709 13:06:54.994682 (+388049us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b180021a1e0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:06:55.007656 (+ 12974us) write_op.cc:301] APPLY: starting
0709 13:06:55.007732 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:55.008164 (+   432us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:55.008182 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:55.010434 (+  2252us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:55.010752 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:06:55.010812 (+    60us) write_op.cc:312] APPLY: finished
0709 13:06:55.011224 (+   412us) log.cc:844] Serialized 145 byte log entry
0709 13:06:55.015879 (+  4655us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:55.016067 (+   188us) write_op.cc:454] Released schema lock
0709 13:06:55.016129 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:55.102278 (+ 86149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:55.102309 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23614,"reported_tablets":43,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":29804,"apply.run_cpu_time_us":4469,"apply.run_wall_time_us":94593,"num_ops":21,"prepare.queue_time_us":313214,"prepare.run_cpu_time_us":108583,"prepare.run_wall_time_us":948758,"raft.queue_time_us":42159,"raft.run_cpu_time_us":2310,"raft.run_wall_time_us":29738,"replication_time_us":488724,"spinlock_wait_cycles":8337536,"thread_start_us":399415,"threads_started":4,"wal-append.queue_time_us":210095}]]}
I20260709 13:06:55.590871 21949 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.571559 24729 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.591684 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:55.592103 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:55.589746 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.609519 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:55.602376 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 162862us
I20260709 13:06:55.569161 22017 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:06:55.555732 24625 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:55.613657 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.577654 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:55.611958 24664 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:55.597002 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:55.623960 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.615746 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 161072us
I20260709 13:06:55.541880 24686 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:06:55.614630 24600 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.011s
I20260709 13:06:55.596706 24703 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:55.620026 21949 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:55.624945 22605 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.611208 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:55.686033 21916 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:55.625267 24732 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.625481 24773 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:55.603555 24712 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
W20260709 13:06:55.702503 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 110892us
I20260709 13:06:55.693812 21768 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:06:55.705446 21768 catalog_manager.cc:5697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:55.683063 24768 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.701778 22606 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:55.692385 24703 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.707340 21768 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 2 to 6, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:06:55.712131 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:55.696638 21804 debug-util.cc:398] Leaking SignalData structure 0x7b0800036aa0 after lost signal to thread 20759
I20260709 13:06:55.698035 24762 raft_consensus.cc:2764] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:06:55.721155 21768 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 3 to 6, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 6 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:55.721604 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 112163us
I20260709 13:06:55.711047 21987 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:55.781388 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.697155 24625 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:55.709112 24773 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.784230 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.809545 21867 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:55.696898 24732 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.816934 24813 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:55.785650 21804 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9ce0 after lost signal to thread 21807
I20260709 13:06:55.785360 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:55.818326 24704 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:55.818738 24704 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:55.819594 24704 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.820788 24730 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:55.821056 24696 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.821557 24696 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.821329 24730 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.821965 24696 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.822077 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:55.822762 22022 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:55.823199 24681 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.823841 24730 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:55.704802 24676 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.826419 24676 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.826830 24776 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.804939 24729 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:55.829154 23611 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.829499 24729 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.709228 24693 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.813578 24799 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.817068 24732 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.825346 24714 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.709833 24656 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:55.804399 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 94469.5us
I20260709 13:06:55.691282 24600 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:55.818917 21804 debug-util.cc:398] Leaking SignalData structure 0x7b0800397460 after lost signal to thread 21899
I20260709 13:06:55.835593 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:06:55.863929 21804 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0280 after lost signal to thread 21900
I20260709 13:06:55.864530 22022 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:55.861486 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:55.865116 21804 debug-util.cc:398] Leaking SignalData structure 0x7b0800307280 after lost signal to thread 21974
I20260709 13:06:55.803592 24807 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:55.817075 24796 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:55.867744 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 239532us
I20260709 13:06:55.828505 24676 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:55.875805 21987 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:55.865690 24798 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:06:55.804036 24741 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:06:55.879102 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:55.875135 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 189148us
W20260709 13:06:55.867985 24463 consensus_meta.cc:287] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.014s
I20260709 13:06:55.877220 21874 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.885804 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:55.886428 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:55.887255 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.887885 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:55.890882 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:55.893533 21871 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.891659 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.892838 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.894873 21874 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:55.895932 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:55.896823 21874 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:55.897869 23611 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:55.902277 23611 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:55.902886 23611 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:55.903841 23611 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.898726 21916 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:55.906905 21872 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:55.910847 21870 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:55.856810 24799 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.917934 24799 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.918076 24692 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.918612 24692 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.919476 21916 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:55.920311 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:55.878085 24807 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:55.921744 24797 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:55.922848 24807 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:55.923628 24545 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.923866 24807 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.924119 24545 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:55.924252 24807 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.925148 24545 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.939900 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:55.941039 21868 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:55.930887 24807 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.877934 24811 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.945919 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:55.946112 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:55.946959 21873 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:55.864691 24714 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.951696 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:55.867264 24656 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.886109 24762 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.965376 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:55.897428 24463 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.970353 24463 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:55.972496 21804 debug-util.cc:398] Leaking SignalData structure 0x7b080031fa80 after lost signal to thread 22048
W20260709 13:06:55.972877 21804 debug-util.cc:398] Leaking SignalData structure 0x7b08001cef20 after lost signal to thread 22049
I20260709 13:06:55.973489 22605 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:06:55.973996 21804 debug-util.cc:398] Leaking SignalData structure 0x7b0800390380 after lost signal to thread 22634
W20260709 13:06:55.974319 21804 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3d20 after lost signal to thread 22635
I20260709 13:06:55.975642 24600 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.930048 24817 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:55.910077 24812 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.942837 24668 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:55.978720 24668 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:55.980437 24704 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.982654 22608 raft_consensus.cc:2368] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:06:55.961614 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:55.988451 22022 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:55.920544 24692 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:55.881626 24796 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.034920 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:56.042374 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 44786.5us
I20260709 13:06:55.868415 24664 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:56.051242 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 64419.4us
I20260709 13:06:55.948861 24514 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.052623 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:56.056491 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:06:56.062024 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.062984 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.984004 24765 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.058772 24813 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.083344 24467 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.083674 24813 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.084012 24467 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.085809 24775 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.086113 24467 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:56.086776 24805 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.308s	user 0.003s	sys 0.000s
I20260709 13:06:56.086431 24775 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.036077 24463 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.099844 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:56.053491 22606 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:56.104460 24515 consensus_meta.cc:287] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.009s
I20260709 13:06:56.102597 24467 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.105949 24811 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.105736 24467 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.107960 24813 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.108034 24467 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:55.928701 24625 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.089169 24765 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:56.103962 24446 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.000s
I20260709 13:06:56.128708 21949 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:56.132200 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:56.074525 24797 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:56.132647 22022 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:56.133112 22016 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
W20260709 13:06:56.133200 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 211837us
W20260709 13:06:56.138053 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 47981.3us
I20260709 13:06:56.142668 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:56.120211 24467 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.151661 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.152304 21867 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
W20260709 13:06:56.137122 24749 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.926s	user 0.008s	sys 0.011s
I20260709 13:06:56.157569 21868 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:56.103966 24807 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.134122 24668 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.110436 24463 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.156526 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:56.150323 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:56.146164 24813 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.150724 24707 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.147722 24811 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.150611 24814 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.172991 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:56.172083 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.178463 21868 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.178440 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:56.180043 22606 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:56.181030 24807 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.155573 24467 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.183218 24714 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.185272 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.185354 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:56.189390 24624 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:56.189944 24732 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.191360 24768 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:06:56.233155 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45349.5us
I20260709 13:06:56.191951 24708 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.192482 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.192560 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.192844 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.196540 24730 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.160326 24817 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:56.202728 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.216274 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.249716 21867 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:56.202461 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:56.202946 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:56.226372 21871 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
W20260709 13:06:56.251263 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 48405.6us
I20260709 13:06:56.251524 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.226534 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:56.227222 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.225577 22022 raft_consensus.cc:2410] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:06:56.253473 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 86548.8us
I20260709 13:06:56.236711 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.255522 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.241101 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.256299 21946 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:56.161711 24749 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.242085 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.245359 21942 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:56.241542 21868 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:56.259624 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.246004 24730 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:56.187736 24667 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.186283 24813 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.265316 24667 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.265733 24667 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.265977 24463 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.265620 24730 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.266909 24730 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.267853 24706 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:56.268376 24706 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:56.261811 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.262233 21944 raft_consensus.cc:2368] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:56.269917 21948 raft_consensus.cc:2368] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:06:56.264082 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:56.271314 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.271772 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.247856 24708 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.278110 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.278936 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:56.241986 24624 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.280716 21943 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:06:56.259856 24819 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.198485 24707 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.263808 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:56.266928 24813 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.309602 21869 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.318933 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.328204 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.342475 21946 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.225459 24811 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.282006 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:56.309320 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.329833 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.233034 24797 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.332563 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.343065 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:56.315987 24799 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:56.374316 21943 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.279693 24463 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.378386 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.378928 21944 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:56.380628 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.380863 21871 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 1.
I20260709 13:06:56.282500 24514 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:06:56.335457 24687 consensus_meta.cc:287] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.146s	user 0.000s	sys 0.020s
I20260709 13:06:56.285276 24708 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.398981 22608 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:56.399374 22608 pending_rounds.cc:85] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 6
I20260709 13:06:56.399598 22608 pending_rounds.cc:107] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:56.399832 22608 raft_consensus.cc:2889] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:56.400110 24746 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.140s	user 0.010s	sys 0.005s
I20260709 13:06:56.397883 24687 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.400971 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.401031 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:56.402612 24804 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.620s	user 0.000s	sys 0.002s
I20260709 13:06:56.402860 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.224203 24814 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.401152 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.338557 24812 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.330564 24819 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.334087 24749 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:56.408049 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.379994 24775 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.330150 24624 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.439060 21943 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:06:56.380280 24463 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.442474 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.438709 21941 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:56.498273 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.499326 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:56.447992 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 245605us
W20260709 13:06:56.470345 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.447961 21950 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:56.501245 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:56.501679 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.502610 24681 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.502694 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.503048 24681 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:56.489589 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:56.500418 23611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.007s	sys 0.006s
I20260709 13:06:56.504077 21948 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:56.389024 24799 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:56.491149 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.491712 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.492004 22023 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:56.411132 24656 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.439096 24745 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.369968 22606 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:06:56.527249 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.527969 24811 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:56.443126 24819 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.529479 24707 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.516194 24687 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:56.533502 24809 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.703s	user 0.000s	sys 0.002s
W20260709 13:06:56.534094 24696 consensus_meta.cc:287] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.002s
I20260709 13:06:56.534685 24696 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:56.536100 21945 raft_consensus.cc:2368] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:06:56.442747 24796 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:56.540293 24773 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.001s
I20260709 13:06:56.545993 24773 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.513257 24799 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.548444 24467 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:56.548991 24521 consensus_meta.cc:287] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.347s	user 0.012s	sys 0.007s
I20260709 13:06:56.549454 24521 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.518705 24814 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.490032 24463 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.553800 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1243) took 1385 ms. Trace:
I20260709 13:06:56.493629 24746 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.493980 24800 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.554214 22023 rpcz_store.cc:276] 0709 13:06:55.167966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.168092 (+   126us) service_pool.cc:224] Handling call
0709 13:06:56.553585 (+1385493us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001798d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:56.553724 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3006852480}
I20260709 13:06:56.523537 24765 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.440583 24515 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:06:56.329479 24817 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.551353 24521 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:56.525977 24704 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.545s	user 0.004s	sys 0.005s
I20260709 13:06:56.525458 24745 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.526293 24624 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.503330 24681 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:56.504235 23611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.008s	sys 0.007s
I20260709 13:06:56.388319 24706 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.506240 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.544107 21946 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:56.489986 24810 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:06:56.591931 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:56.509579 24726 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.001s
I20260709 13:06:56.593189 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.594563 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.596885 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.516077 24708 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.585361 24746 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.585635 24814 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.647403 24814 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.648355 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:56.602380 24793 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.400s	user 0.012s	sys 0.007s
I20260709 13:06:56.607033 24819 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.582165 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.616170 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.616551 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.667456 22601 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:06:56.619166 24703 consensus_meta.cc:287] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.005s
I20260709 13:06:56.638180 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1624) took 1180 ms. Trace:
I20260709 13:06:56.639899 24746 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.641414 24708 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.593225 24800 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.638240 24844 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.628731 24667 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.643651 24696 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:56.615425 24732 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.615586 24624 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:56.649053 21943 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:56.657366 22604 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
W20260709 13:06:56.658565 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.669826 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.619025 21950 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:56.686597 21946 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:56.616456 24521 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.690728 21867 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:56.933768 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.935335 21872 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:56.935956 23611 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.936910 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:56.935365 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.938457 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:56.939193 21867 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.689605 21866 rpcz_store.cc:276] 0709 13:06:55.458111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.458263 (+   152us) service_pool.cc:224] Handling call
0709 13:06:55.458615 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:55.458978 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.459004 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:55.459524 (+   520us) log.cc:844] Serialized 52 byte log entry
0709 13:06:55.601562 (+142038us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:55.601603 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.601670 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.402036 (+800366us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:06:56.633962 (+231926us) raft_consensus.cc:1685] finished
0709 13:06:56.633990 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.638103 (+  4113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11067,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":24725,"spinlock_wait_cycles":140609536,"thread_start_us":102650,"threads_started":1,"wal-append.queue_time_us":202243}
I20260709 13:06:56.940789 22023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:43308
I20260709 13:06:56.941330 22023 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:56.941664 22023 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.942895 22022 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.944103 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:56.944654 22016 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.936491 23611 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:56.691368 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.948292 22022 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.795534 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 359) took 1334 ms. Trace:
I20260709 13:06:56.950101 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.950577 21869 rpcz_store.cc:276] 0709 13:06:55.461459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.461885 (+   426us) service_pool.cc:224] Handling call
0709 13:06:55.462129 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.341693 (+879564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.795235 (+453542us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b540034cbd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:56.795471 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948612480}
I20260709 13:06:56.951876 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.955668 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.956519 21866 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 5: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:56.959978 21869 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:56.962414 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:56.963452 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.963106 22021 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.964121 21944 raft_consensus.cc:2368] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:56.965149 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:56.970129 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.971025 21866 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:56.975164 22019 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.975219 22020 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.977000 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:56.977975 21873 raft_consensus.cc:2393] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:56.979038 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.979925 23611 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.981295 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:56.695616 24806 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.865s	user 0.007s	sys 0.000s
W20260709 13:06:56.984275 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.984256 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.986133 21868 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:56.989867 23611 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.990440 23611 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.716946 24799 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.854557 24693 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.772644 24847 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.918545 24821 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.995311 22023 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:56.996660 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:56.783612 24841 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:56.667331 24793 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.030599 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:57.003149 24799 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.033638 24708 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:56.705008 24703 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.961314 24625 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.972829 24814 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.994470 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.009397 23611 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:57.011201 21944 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.013371 22023 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:56.962661 24521 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:56.962806 24844 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.022294 22021 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:56.998162 21867 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:57.039674 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:56.962805 24624 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.050851 24667 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:57.053872 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:56.991674 24704 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:06:57.055024 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:06:57.061174 24463 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.001s
I20260709 13:06:57.112373 24707 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:06:57.079231 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.009574 24693 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.106161 24799 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.151644 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:57.009989 24810 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:57.150313 24463 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.152559 24810 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.153488 24625 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.057554 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.162678 24844 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.126109 24726 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.164079 24625 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:57.150501 24707 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.095083 21875 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:57.106112 24679 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.158133 24463 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.167582 24679 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:57.169116 24679 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.024003 24847 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.172570 24847 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.029422 24821 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.091780 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:57.160740 22608 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:57.176957 24821 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.177076 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.155436 24810 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.185907 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.164320 24726 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.169728 21944 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:57.161468 24624 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:57.056221 24730 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.004s
I20260709 13:06:57.200136 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 485) took 1300 ms. Trace:
I20260709 13:06:57.180094 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.201227 21950 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:57.202622 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:57.184458 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:57.203646 22604 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:06:57.188941 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:57.190289 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:57.205155 21944 raft_consensus.cc:2368] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:06:57.155119 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.200743 22601 rpcz_store.cc:276] 0709 13:06:55.899305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.909479 (+ 10174us) service_pool.cc:224] Handling call
0709 13:06:56.249824 (+340345us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:56.550212 (+300388us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4de9c 00007f6352f4da5b 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:56.550413 (+   201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.694340 (+143927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.199880 (+505540us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54000b1b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:57.200073 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291458944}
I20260709 13:06:57.191788 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:57.154028 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.209108 21946 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:57.210178 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.217036 24693 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:57.191815 24836 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.746s	user 0.013s	sys 0.012s
I20260709 13:06:57.220858 21944 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:57.208189 21839 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:57.158658 24521 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.227811 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.055925 24841 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.237462 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.228325 24656 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:57.261540 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:57.262389 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.262945 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.267186 21943 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:57.263289 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.262739 21944 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.269174 21944 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:57.230028 22606 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:06:57.260408 22016 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:57.274398 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:57.236654 24624 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.285502 21942 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:57.286033 21942 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:57.286885 21942 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.289443 21945 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:06:57.231992 24745 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.270069 21944 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.302409 21944 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.258896 24521 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.258939 24817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.030s
I20260709 13:06:57.260082 24656 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.265127 24726 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.325555 24521 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.325970 24841 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.326267 24762 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:57.327402 24849 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:06:57.327215 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.328025 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.328827 24810 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:57.321959 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:57.321471 24656 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.321920 24817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.007s	sys 0.033s
I20260709 13:06:57.335381 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:57.330878 24800 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.301463 24624 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:57.336205 24681 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.001s
I20260709 13:06:57.347913 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:57.329600 24703 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.335474 24793 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:06:57.455945 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 257289us
I20260709 13:06:57.366820 24681 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.433081 24844 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:57.386932 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:57.448307 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.434262 24854 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:06:57.410333 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:57.463721 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:57.377125 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:57.344781 24810 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.336798 24762 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.386524 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:57.471575 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:57.337088 24732 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:06:57.441344 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.385300 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:57.344319 24841 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:57.349298 24847 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.383960 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:57.374795 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:57.484025 22016 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:57.484666 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:57.358790 21944 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:57.452194 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 394839us
I20260709 13:06:57.485260 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:57.487675 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:57.455510 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 438960us
I20260709 13:06:57.488742 21867 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:57.488956 21948 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:57.460278 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 455424us
I20260709 13:06:57.490370 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:57.490995 21874 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.464399 22017 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
W20260709 13:06:57.453294 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 105493us
I20260709 13:06:57.492959 23611 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.493713 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:57.494688 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:57.453394 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.403841 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:57.461402 24844 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:57.495782 22020 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.495910 22016 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:57.496430 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.493124 21987 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:57.497721 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.471864 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:57.472775 22021 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:06:57.452401 24675 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:57.524004 24675 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.525408 23611 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.525907 23611 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.527154 24810 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.477383 24624 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:57.527776 23611 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.482024 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.456068 24625 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.497973 22605 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:57.498342 21870 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:57.520004 24828 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:57.520989 24521 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.521333 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.486533 24732 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:57.569468 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 76185.7us
I20260709 13:06:57.570238 21874 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:57.570850 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:57.521867 24726 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:57.522264 24859 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:06:57.497473 24817 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:57.522818 21987 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:57.580842 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58087.3us
I20260709 13:06:57.522886 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.523451 24847 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.526185 24675 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.528565 21871 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:57.457607 21914 leader_election.cc:400] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:06:57.587785 21914 leader_election.cc:403] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:57.476676 24841 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.554497 24819 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.555063 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:06:57.599927 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 142521us
I20260709 13:06:57.561264 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.562286 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.600881 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:57.551584 22020 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:57.575210 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:57.602362 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:57.578342 23611 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:57.557762 24681 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:57.555540 24730 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.558236 24707 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.583200 21941 raft_consensus.cc:2376] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7. Re-sending same reply.
W20260709 13:06:57.543254 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 54033.4us
I20260709 13:06:57.561831 24762 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.597471 24861 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:57.598038 24841 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:57.598721 24822 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:57.587203 24847 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.600083 21870 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:57.558529 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:57.580081 24729 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:57.607285 23611 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.607928 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.608842 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:57.621173 24729 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:57.636931 24729 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.616230 24822 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:57.638629 24822 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.639849 24822 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.600349 24810 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:06:57.635694 24818 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.619012 24847 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.644997 24818 raft_consensus.cc:697] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:57.646000 24818 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.649149 24679 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.621253 23611 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:57.613096 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:57.588155 24624 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.606986 24730 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:57.619305 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 60859.5us
I20260709 13:06:57.619979 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:57.651424 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:57.653631 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:57.614364 24857 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.613979 24817 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.659648 21871 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:57.660454 21874 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.663611 21874 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:57.611862 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 113475us
I20260709 13:06:57.616243 24762 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.669708 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.660706 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:57.671574 21871 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.672408 23611 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.650236 21868 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
W20260709 13:06:57.673985 22574 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.840s (SENT) [suppressed 21 similar messages]
I20260709 13:06:57.675661 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:57.654953 24800 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:57.619750 24625 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.614984 22606 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:57.684930 21874 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.655084 24863 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.681268 21866 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:57.685385 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.655083 24624 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.696496 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:57.697957 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.698969 21874 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:06:57.700135 21874 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.701478 21874 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:57.609251 24828 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
W20260709 13:06:57.688406 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.682389 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:57.687551 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:57.672217 24745 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:57.694764 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:57.815604 21866 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.693603 21871 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
W20260709 13:06:57.808945 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 126647us
I20260709 13:06:57.818209 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:57.838709 24769 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.841821 24730 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.843206 24730 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.703609 24871 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:06:57.678783 24681 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
W20260709 13:06:57.848948 24656 consensus_meta.cc:287] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.003s
I20260709 13:06:57.849426 24656 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.850575 21869 raft_consensus.cc:2368] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:57.690014 24863 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.852862 24863 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.854099 24656 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.704344 24624 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.685791 24732 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.680506 24800 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:57.861264 24800 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.862454 24745 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:57.863441 24745 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.685755 24708 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:57.869818 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 51698.4us
I20260709 13:06:57.870428 24847 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.871482 22573 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:57.873077 24686 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:57.873765 24686 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:57.875349 24686 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.875799 24686 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:57.685344 24799 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.877497 24732 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:57.878032 24732 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.880054 24732 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:57.940340 23611 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.946203 21866 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:57.668867 24857 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.949779 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:57.950847 22608 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:57.872469 24847 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:57.968258 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:57.968889 23611 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:57.969110 22601 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:06:57.970170 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 367865us
I20260709 13:06:57.981861 22601 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:06:57.971521 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 382971us
I20260709 13:06:57.977646 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:57.997097 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:58.002786 23611 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.003208 23611 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.003548 23611 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.009414 24857 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:58.010243 24800 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.999683 21988 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:58.011690 23611 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:57.950408 24686 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:57.979550 24729 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:58.028319 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 354339us
W20260709 13:06:58.029011 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.029474 23611 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.013285 24871 consensus_queue.cc:1243] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:06:58.040959 21875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 362) took 2327 ms (client timeout 1840 ms). Trace:
I20260709 13:06:58.041453 24874 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:58.041404 21875 rpcz_store.cc:269] 0709 13:06:55.713980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.776451 (+ 62471us) service_pool.cc:224] Handling call
0709 13:06:58.040741 (+2264290us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001d7ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:58.040842 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3012505472}
I20260709 13:06:58.042057 24844 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.043486 24844 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.044864 24857 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:58.029305 24828 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:06:58.047535 21942 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.007474 22606 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:06:58.032719 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.033449 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:58.056670 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:58.057564 22604 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:58.057832 21988 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.035715 24841 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:58.051061 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 97619.4us
I20260709 13:06:58.051618 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:58.059376 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:58.061779 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:58.059912 23611 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:58.063781 24875 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:58.067770 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 398356us
I20260709 13:06:58.065296 24847 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:58.065289 21838 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.688s (SENT)
I20260709 13:06:58.063377 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:58.073355 21872 raft_consensus.cc:2368] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:06:58.068956 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.060012 24762 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:58.078150 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:58.078421 21916 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:58.081488 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 132219us
W20260709 13:06:58.085161 24873 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:06:58.068778 24625 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.085924 24881 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:58.085809 24625 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.086472 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 606) took 1103 ms. Trace:
I20260709 13:06:58.087263 24880 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.086503 24881 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:58.089118 24881 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:58.094915 24746 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:58.095400 24746 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:58.096412 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.097327 21950 raft_consensus.cc:2410] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:58.095414 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.096472 21941 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:58.087093 22602 rpcz_store.cc:276] 0709 13:06:56.982551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.983778 (+  1227us) service_pool.cc:224] Handling call
0709 13:06:57.562679 (+578901us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b580016e698. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:06:57.562877 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.563302 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.563345 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.563842 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.951889 (+388047us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.971578 (+ 19689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.977831 (+  6253us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.086146 (+108315us) raft_consensus.cc:1685] finished
0709 13:06:58.086173 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.086410 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":46808832,"thread_start_us":368943,"threads_started":1,"wal-append.queue_time_us":441604}
I20260709 13:06:58.099920 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.100616 21944 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.080164 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:58.104933 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:58.066246 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.108076 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.066799 23611 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.111683 23611 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.113665 21944 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:06:58.069911 24810 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:58.073810 24847 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.126672 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.130084 21838 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.083987 24875 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:58.133790 24874 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.139816 24824 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:58.096220 24746 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.117100 24707 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:58.148262 24841 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:58.148950 24800 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.129907 24847 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.134253 24656 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:58.151480 24863 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.157493 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:58.158792 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 80760.4us
I20260709 13:06:58.159929 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:58.166971 23611 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.128566 24668 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:58.189729 21838 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.137759 24810 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:58.098110 24762 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:58.157742 24822 consensus_meta.cc:287] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 13:06:58.188223 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.193034 23611 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.194595 23611 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:58.194952 23611 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.195252 23611 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.195255 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:58.197170 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 87930.1us
I20260709 13:06:58.158705 24875 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:06:58.209007 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 98215.2us
I20260709 13:06:58.211210 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:58.166783 24819 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.228145 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.228816 23611 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.230124 22021 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:58.232038 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.231949 22016 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.236980 21947 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:58.230813 22023 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.169598 24824 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:58.244684 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.241860 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44096.2us
W20260709 13:06:58.243692 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.244443 22015 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.154917 24624 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.250453 21987 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:58.251159 22018 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:58.251219 23611 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.250006 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.250461 22019 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:58.253629 22024 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
W20260709 13:06:58.254637 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.255035 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 65379.9us
I20260709 13:06:58.193156 24841 raft_consensus.cc:2764] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:58.184813 24707 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.257329 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.220750 24656 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:58.256637 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 175022us
I20260709 13:06:58.197034 24874 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:06:58.268941 23611 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:58.220829 24875 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.274572 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.197731 24668 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.274580 23611 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.281634 23611 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.266263 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.278534 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.282667 21869 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:58.268177 24819 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.285291 24863 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:58.290426 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.291973 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:58.288939 22574 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:58.297485 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.301445 21942 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:58.302371 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1772) took 1028 ms. Trace:
I20260709 13:06:58.304121 24810 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:58.304971 24732 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:58.305155 24810 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.305732 24732 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:58.265223 24890 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:58.302893 21942 rpcz_store.cc:276] 0709 13:06:57.273984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.274128 (+   144us) service_pool.cc:224] Handling call
0709 13:06:57.985281 (+711153us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b18000c94e0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560ad646 00007f6355fe758e 00007f6356068f9e 00007f635606a7de 00007f635607627c 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c
0709 13:06:58.047254 (+ 61973us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b58004c5bd0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fce0aa 00007f6356050447 00007f6356068fe7 00007f635606a7de 00007f635607627c 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c
0709 13:06:58.302189 (+254935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708744320}
I20260709 13:06:58.317214 24897 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.318102 24624 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:58.318807 24885 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:58.273988 24729 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:58.323060 24707 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:58.308158 24730 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.325598 24762 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:58.325778 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:58.325893 24730 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:58.326713 24863 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:58.327639 24863 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.327544 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:58.328737 24881 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:58.329157 24881 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:58.330737 24668 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:58.330238 24881 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.297065 24664 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.331913 24881 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.335955 24884 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:58.336472 24884 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.336846 24884 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.325662 24822 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:58.343283 23611 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.356828 23611 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.308445 24667 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:58.328306 24863 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:58.339325 24890 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.340591 24824 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.363155 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.400276 21869 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:06:58.365605 22610 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:58.369156 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.369899 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:58.370198 24625 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.371058 22603 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.373862 24895 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:06:58.383633 24875 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.314560 24841 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.393200 21941 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
W20260709 13:06:58.393937 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 143536us
I20260709 13:06:58.402053 21875 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.411372 21839 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:58.429575 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.430168 21941 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:58.414474 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.418306 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:58.420991 24818 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.422852 22604 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:58.424691 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:58.436447 22608 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:58.414733 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.307104 24732 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.409442 24726 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:58.395560 24667 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.438050 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.442499 21943 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.439245 21941 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:06:58.439848 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.402455 24890 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.446861 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.463689 23611 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.466893 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.464484 23611 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.469995 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.480795 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.481019 21943 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:58.483275 23611 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.484731 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.485672 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.444360 24667 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.484699 24797 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.487106 24797 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:58.489269 24889 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:06:58.491740 24884 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.493227 21948 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:58.494343 24884 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:58.469745 24794 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:06:58.496268 24794 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:58.496825 24794 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:58.443907 24818 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.444972 22606 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.511128 23611 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.461153 24625 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.497892 24794 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.462116 24730 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:58.444685 24726 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:58.631948 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.614951 22608 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:06:58.457935 24875 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.633685 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:58.500489 24664 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:58.528888 21867 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:58.544106 21875 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:58.528143 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1256) took 1147 ms. Trace:
I20260709 13:06:58.620431 23611 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.607266 24899 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.639039 22020 rpcz_store.cc:276] 0709 13:06:57.380988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.384985 (+  3997us) service_pool.cc:224] Handling call
0709 13:06:58.527868 (+1142883us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5400417dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:58.528049 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47733120}
I20260709 13:06:58.667693 22022 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.506621 24847 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:06:58.641094 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 429932us
W20260709 13:06:58.668900 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.670462 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:06:58.671218 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:58.677780 21943 raft_consensus.cc:606] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:58.625349 24625 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.678838 21988 leader_election.cc:400] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:58.682118 21988 leader_election.cc:403] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.680500 23611 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.639178 24668 raft_consensus.cc:2764] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 13:06:58.688747 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 391312us
I20260709 13:06:58.639253 24841 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:58.709403 24797 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:58.718940 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.720367 22020 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.720466 22017 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:58.721495 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 50371.1us
I20260709 13:06:58.629261 24730 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.676910 24794 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:58.724733 21838 leader_election.cc:400] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:58.726800 21838 leader_election.cc:403] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.722193 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:06:58.725859 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.727890 22017 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:58.686954 24810 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.743875 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.730361 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.731117 21838 leader_election.cc:400] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
W20260709 13:06:58.732610 24902 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:58.732923 24707 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:06:58.734542 24625 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:58.735195 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.770125 22024 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:58.771853 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:58.736373 22018 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:58.736892 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.738960 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.773502 22606 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:58.774282 21875 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:58.740298 24656 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:58.778644 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.762984 24667 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.781291 22602 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:06:58.782704 24667 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.780206 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.785292 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.786996 21873 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:58.789675 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.790340 21869 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.724366 24841 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:58.744957 22017 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:58.800690 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.747097 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 604) took 2224 ms. Trace:
I20260709 13:06:58.725193 24706 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:58.747997 24818 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:58.748790 24730 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:58.808935 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.816033 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.752121 24745 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:58.816828 24745 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:58.677727 24899 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.817211 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.817852 21874 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:58.817646 24745 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.818701 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.818864 24745 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.818992 24899 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.819298 21874 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:58.820149 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.820950 21874 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:58.821030 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.821882 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.822146 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.822722 21873 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.822980 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.823434 24624 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.823568 21874 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.823958 24624 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.825047 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.825222 24841 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.826016 24624 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.826261 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.826870 21867 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:58.827704 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.828294 21875 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.756461 24890 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.719590 24726 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:58.729643 24822 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:58.740424 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.732033 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:58.863195 24726 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.863721 24915 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:58.745254 21838 leader_election.cc:403] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:58.864991 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 134008us
I20260709 13:06:58.865736 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:58.866859 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:58.868038 21838 leader_election.cc:400] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:06:58.868319 21838 leader_election.cc:403] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.868779 24707 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:06:58.869486 24707 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.869836 24707 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.870191 24707 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.870438 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.871627 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:58.872159 22021 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:58.872774 24656 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:58.863276 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 122930us
I20260709 13:06:58.873788 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1645) took 1378 ms. Trace:
I20260709 13:06:58.874150 21872 rpcz_store.cc:276] 0709 13:06:57.495645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.496216 (+   571us) service_pool.cc:224] Handling call
0709 13:06:58.873594 (+1377378us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54003773d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:58.873731 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324955904}
I20260709 13:06:58.787014 21839 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:58.879149 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 92213.2us
I20260709 13:06:58.880565 24819 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:58.881177 24819 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:58.882392 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.883139 21872 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:06:58.804371 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.807381 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.884624 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.885780 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:58.801487 21866 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:58.801767 24625 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.891588 24625 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:58.893205 21947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 300) took 2260 ms (client timeout 1840 ms). Trace:
I20260709 13:06:58.893818 24625 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:58.809026 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:58.894655 22022 raft_consensus.cc:2393] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:58.893613 21947 rpcz_store.cc:269] 0709 13:06:56.633141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.665587 (+ 32446us) service_pool.cc:224] Handling call
0709 13:06:57.619139 (+953552us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:06:58.892981 (+1273842us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b5400298e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:06:58.893109 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367982208}
I20260709 13:06:58.896427 22022 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.800876 24913 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:58.809607 24667 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:58.899685 24913 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:58.900170 24913 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:58.802386 22605 rpcz_store.cc:276] 0709 13:06:56.506441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.508639 (+  2198us) service_pool.cc:224] Handling call
0709 13:06:56.527081 (+ 18442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.569422 (+1042341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.688779 (+1119357us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54006d1d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:58.730760 (+ 41981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2182258048}
I20260709 13:06:58.812844 24706 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.902998 24706 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:58.838452 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.906409 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:58.907442 21874 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:58.909070 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:58.911427 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.843969 21875 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:06:58.848191 24847 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:58.853716 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.854421 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:58.882093 24819 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:58.808367 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.913841 22015 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:58.838651 22018 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:58.839861 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:58.916287 22020 raft_consensus.cc:2376] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6. Re-sending same reply.
I20260709 13:06:58.843706 21869 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:06:58.917191 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:58.920614 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 113300us
I20260709 13:06:58.921375 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:06:58.927501 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 73145.8us
I20260709 13:06:58.900425 24696 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:58.929351 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 73815.9us
I20260709 13:06:58.931869 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:58.932435 22017 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.931192 21987 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:58.933389 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:58.933543 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:58.934329 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.936049 21869 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:58.937711 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 205758us
I20260709 13:06:58.940656 24863 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.946219 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:58.947098 21866 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:58.954829 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.956154 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:58.919301 24667 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:58.950232 22021 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:06:58.957528 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.920745 24810 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 3. Current term is 4.
I20260709 13:06:58.930065 24625 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.956801 22023 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.963939 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.982304 21941 raft_consensus.cc:2368] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:06:58.965888 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.965888 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:58.984071 22020 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:06:58.985532 22020 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.967972 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:58.988500 21946 raft_consensus.cc:2368] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:06:58.928462 24668 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:58.959606 24664 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.948089 24914 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:59.002426 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:59.004875 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.002426 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.943238 24863 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:06:58.991707 22605 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEARNER]: Advancing to term 8
I20260709 13:06:58.993160 24656 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.011440 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:58.994139 22015 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.931242 24696 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:58.976455 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.023999 21947 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:58.936242 24865 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:58.919019 24915 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:06:58.954969 24847 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.959839 24861 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.010357 22019 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:06:58.947348 24880 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:06:58.976539 24667 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:58.948151 24844 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:06:58.955453 24884 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:06:59.043172 22023 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:06:58.978474 24871 consensus_queue.cc:1059] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:06:58.994566 24625 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.930362 24897 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:06:58.960938 24797 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:06:58.958484 24814 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 13:06:59.073333 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 156202us
I20260709 13:06:59.080493 21942 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:06:58.978024 24907 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:06:59.085666 24696 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.056176 24844 consensus_queue.cc:1243] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:59.034895 24847 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:58.978233 24886 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:06:59.054693 24667 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.091037 24847 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.055178 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.072064 24625 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:59.069991 24824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.020s	sys 0.022s
I20260709 13:06:59.101365 21950 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:06:59.116237 21873 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:06:59.119225 22605 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:06:59.109716 24824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.021s	sys 0.022s
I20260709 13:06:59.113186 24797 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:59.083253 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.096688 24923 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:06:59.134636 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 137647us
I20260709 13:06:59.161413 21916 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:59.132090 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 48920.5us
I20260709 13:06:59.165484 24706 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.166043 24706 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:59.167346 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.167066 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.168742 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.169638 22606 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:06:59.170720 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:06:59.171845 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.173293 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.174856 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:06:59.176203 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.173271 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.131136 24797 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.132769 24668 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:59.185628 24921 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:59.185475 24932 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.186282 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:59.186545 21948 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:06:59.195600 24707 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.164361 24890 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:59.204741 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 272933us
I20260709 13:06:59.179876 24863 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.211234 24861 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:59.214125 24906 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:59.214633 24906 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.214339 24861 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.215541 24906 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.217932 24906 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.175506 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:59.198468 24932 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:59.221388 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45968.7us
I20260709 13:06:59.198026 24875 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.249250 21866 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.250351 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:06:59.251020 21867 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.252022 21869 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:59.253297 21870 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:59.253459 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:06:59.254616 21870 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:59.209225 24707 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:59.255249 21869 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:59.224589 24800 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:59.256964 24922 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:06:59.263163 21867 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
W20260709 13:06:59.264914 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78703.1us
I20260709 13:06:59.265811 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:06:59.245630 24920 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:06:59.268839 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 87237us
I20260709 13:06:59.226287 24932 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.222201 24863 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.298134 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:59.282392 24919 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:06:59.272284 24880 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:59.321269 24880 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:06:59.318123 24927 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:59.319551 24679 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:59.246731 24875 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:06:59.320122 24934 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:06:59.340590 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70556.6us
I20260709 13:06:59.321807 24880 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.329792 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.267568 24797 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.332185 24667 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.334973 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:06:59.338690 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72999.4us
I20260709 13:06:59.339342 24886 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:59.340037 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.350006 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 46156us
I20260709 13:06:59.341346 24656 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:59.355991 21946 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:59.354328 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:59.374569 22608 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:59.345296 24934 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:59.345697 24696 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.362141 24901 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:59.401196 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.364473 24679 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:06:59.375202 24656 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:06:59.458590 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 102341us
I20260709 13:06:59.429806 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:59.393185 24934 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:06:59.432046 24940 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:06:59.417819 24913 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.003s
I20260709 13:06:59.399909 24886 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.403405 24901 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.493145 24886 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.411178 24730 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:06:59.498926 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.499725 22018 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.500169 21838 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.501190 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.501459 21944 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:59.507608 22018 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:59.503527 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:06:59.473764 24905 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:59.515826 22016 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:59.483572 24918 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:06:59.519075 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:06:59.478590 24871 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.527978 21941 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:59.530936 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.532174 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:06:59.533082 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.533751 21946 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:06:59.535794 21838 leader_election.cc:400] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:06:59.537360 21838 leader_election.cc:400] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:06:59.540050 21838 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.458362 24828 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:59.541534 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.407013 24935 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:06:59.544293 22015 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.551347 24901 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.552413 24901 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.556325 22024 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:59.556562 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 157741us
I20260709 13:06:59.481532 24875 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:59.558944 21866 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:59.559134 21872 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:59.547401 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.560045 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.547798 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.619445 22605 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:06:59.561275 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:06:59.585356 24943 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:06:59.624905 22603 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:59.590469 23611 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:59.546245 24800 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:59.604054 24679 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:59.635376 24944 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:06:59.540776 24937 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:59.620713 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60727.7us
I20260709 13:06:59.546746 21838 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.622040 24707 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.645237 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:59.482802 24913 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:59.649255 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 102584us
I20260709 13:06:59.650051 24841 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:59.650419 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:59.651211 24924 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.625188 24939 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:59.634522 24857 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:59.657753 24939 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.657819 24857 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.658321 24939 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.658829 24857 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.546463 24925 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.660815 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:59.661631 24800 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:59.662087 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:06:59.662158 24800 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:59.627219 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69435.9us
W20260709 13:06:59.663859 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 102635us
I20260709 13:06:59.545123 24664 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.650606 24841 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:59.547644 24794 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.638423 24667 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:59.643957 24947 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:59.562929 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:06:59.659688 24915 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:59.664474 24625 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.003s
I20260709 13:06:59.626479 24884 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:59.663790 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:06:59.625880 24746 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.688055 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.695535 22015 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:06:59.674295 24668 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:59.694628 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 131764us
I20260709 13:06:59.627097 24881 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:06:59.705538 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.679951 24707 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:59.719843 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.686915 24915 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:59.628137 24545 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:06:59.690845 24819 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:59.688433 24863 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:59.727591 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:59.695067 24884 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.736224 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:06:59.704397 24945 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:06:59.738204 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:59.704466 24861 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:59.721771 24847 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.003s
I20260709 13:06:59.747393 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:59.750525 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:06:59.691542 24625 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.755421 24726 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:59.755694 24883 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:06:59.733714 24668 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:59.756865 24929 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.734826 24915 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.735047 24899 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.761379 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.756294 24903 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:06:59.748816 24667 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.744930 24686 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.752997 24937 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.744860 24819 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:06:59.745729 24861 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:59.770082 22021 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.773952 21988 leader_election.cc:400] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:06:59.791319 21988 leader_election.cc:403] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:59.765350 24957 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:06:59.764796 24810 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:59.771972 24913 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:59.766300 24929 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.805418 24929 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.809514 24819 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.793179 24861 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.791965 23611 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:06:59.762619 24938 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.818739 24938 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.821709 24938 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:06:59.793008 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.759902 24847 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.822979 22017 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:59.793982 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.768440 24899 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:59.772624 24890 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.778636 24732 raft_consensus.cc:2764] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:59.766149 24863 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:06:59.782415 24686 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.777441 24884 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.824558 24847 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:59.832546 24884 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.798626 24957 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.834990 24957 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:59.804770 24936 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:59.835947 24936 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.838871 24936 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:59.824484 24800 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:59.827271 24625 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:59.829777 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:06:59.830047 24899 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.830684 24732 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.830307 24890 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.849455 24732 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:59.850529 24732 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.851352 24890 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:06:59.851565 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.852005 24890 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:59.765605 24841 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.832077 24686 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.799444 24668 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.759720 24871 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.868094 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:59.784369 24935 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.886970 21988 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:59.888698 24847 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:59.889516 24876 raft_consensus.cc:3055] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:59.889963 24876 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.890828 24876 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.807770 24939 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.894994 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.895790 22016 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:59.895972 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.897063 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.898018 22023 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:06:59.891215 24915 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.865679 24890 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:06:59.905421 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.891901 24876 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:59.907327 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.921679 22015 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:06:59.903172 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:59.903658 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.923012 22020 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:06:59.923579 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:06:59.924485 22018 raft_consensus.cc:2368] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:06:59.924548 22020 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:59.909250 22023 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:06:59.912305 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 144191us
I20260709 13:06:59.927215 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.927977 22015 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:06:59.892741 24625 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.930456 24800 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:06:59.953655 24800 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.953972 24915 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:06:59.957019 24800 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:59.932271 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.933219 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.934027 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.935597 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.903661 24847 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:59.959488 21948 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:06:59.936843 24928 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:06:59.960631 24928 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.923674 22022 pending_rounds.cc:85] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 6
I20260709 13:06:59.962433 22022 pending_rounds.cc:107] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:59.962731 22022 raft_consensus.cc:2889] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:59.962930 24906 consensus_meta.cc:287] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.003s
I20260709 13:06:59.965943 21945 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:06:59.966450 21945 pending_rounds.cc:85] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 5
I20260709 13:06:59.966696 21945 pending_rounds.cc:107] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:06:59.966948 21945 raft_consensus.cc:2889] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:59.970237 24939 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:06:59.974576 24656 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.976866 24656 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.981354 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:06:59.986039 24951 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:06:59.986727 24951 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:06:59.990324 24932 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.699s	user 0.006s	sys 0.003s
I20260709 13:06:59.990444 24951 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:06:59.991055 24932 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:06:59.991979 21875 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:59.991901 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:06:59.992435 21941 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.993377 24800 raft_consensus.cc:2764] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:06:59.993957 24880 consensus_meta.cc:287] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
I20260709 13:06:59.994632 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2372) took 1031 ms. Trace:
I20260709 13:06:59.994473 24880 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:06:59.995074 22021 rpcz_store.cc:276] 0709 13:06:58.963555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.963672 (+   117us) service_pool.cc:224] Handling call
0709 13:06:58.963973 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.791167 (+827194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.994368 (+203201us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540005d554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:06:59.994543 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853451136}
I20260709 13:06:59.996830 21950 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:59.997735 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.998399 21948 raft_consensus.cc:2376] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7. Re-sending same reply.
I20260709 13:06:59.999997 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:06:59.999768 24890 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.001052 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:00.001667 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:00.003793 21948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:00.004344 21948 raft_consensus.cc:606] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:00.005438 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.005903 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.942376 24644 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:00.007131 24644 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:06:59.949568 24726 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:00.005790 24706 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.008232 24644 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.008970 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:00.011317 21948 raft_consensus.cc:614] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:00.013283 24707 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:00.013756 24962 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:00.013960 24707 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.014699 24962 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:00.015151 24962 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:00.016928 24644 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.940850 24871 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.019026 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:00.020226 24726 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:00.020699 24726 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.021093 24726 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.023550 24545 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:00.024981 24958 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.025434 24958 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:00.025614 24880 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.026283 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.026360 24958 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.015960 24962 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.029289 24962 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.030916 24950 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:00.033203 24893 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:00.028337 22017 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:00.033959 24893 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:00.038197 22019 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:00.041642 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:00.042171 24857 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.043972 24932 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:00.048899 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:00.048586 24930 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.049577 21869 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.049739 24930 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.051964 24934 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.050341 22018 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:00.053310 24934 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.047864 24925 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.053999 24925 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.025017 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:00.062492 24624 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:00.063714 24939 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:00.064168 24939 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:00.065092 24939 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.033317 24950 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.066588 24950 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:00.016413 24707 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:00.067664 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 309) took 1653 ms. Trace:
I20260709 13:07:00.068569 21945 rpcz_store.cc:276] 0709 13:06:58.414680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.414799 (+   119us) service_pool.cc:224] Handling call
0709 13:06:58.433552 (+ 18753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.967413 (+1533861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.067408 (+ 99995us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540009bfd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:00.067594 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3523148160}
I20260709 13:07:00.035060 24893 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.073261 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:00.039371 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:00.074764 24928 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:00.075625 24958 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.074790 24797 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.078922 24929 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.080499 22024 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:00.081550 24929 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:00.083302 24937 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.084151 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:00.084685 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:00.085357 21942 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.086481 21946 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:00.085273 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:00.089112 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:00.089778 21950 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:00.090404 24861 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.091787 22016 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:00.093155 24861 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:00.094333 24925 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:00.096774 24686 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.153579 21942 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:00.097788 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:00.155696 24686 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:00.099359 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.100080 24930 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:00.067651 24950 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.158547 24950 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.159060 21869 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:00.162006 24955 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.162503 24955 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:00.163355 24955 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.164551 24955 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.100638 24947 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:00.101446 24800 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:00.103515 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 441468us
I20260709 13:07:00.169202 24865 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:00.103760 24893 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.106787 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:00.172394 24933 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.173004 24933 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:00.173345 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:00.112761 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:00.113691 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:00.174117 24933 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.114455 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:00.175555 22602 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:00.175706 24933 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.179513 24819 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:00.113197 24939 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.116325 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:00.180135 24819 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:00.181088 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64849.9us
I20260709 13:07:00.182173 24686 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.183151 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:00.183756 24819 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.184641 24951 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:00.117277 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.118129 21841 leader_election.cc:400] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:07:00.185568 21841 leader_election.cc:403] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.185668 21871 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:07:00.186049 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 68071.3us
I20260709 13:07:00.117957 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:00.188697 21868 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.188781 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:00.189513 21950 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:00.190229 24664 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:07:00.191188 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:00.191951 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.188867 22024 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.192550 21871 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:00.193377 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.195300 24664 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.199221 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:00.200789 24800 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.201256 24800 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:00.201684 24800 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.203877 22024 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:07:00.194356 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.206565 21873 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:00.208158 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:00.125880 22604 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:00.209100 24924 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.126675 21948 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:00.211186 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:00.211951 24924 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.212317 24924 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:00.212702 24924 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.217375 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:00.221310 21866 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:00.221766 21950 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:00.222630 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:00.222873 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:00.223384 21946 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.128266 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:00.225643 24915 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:00.226307 24915 consensus_queue.cc:1243] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:00.226738 24915 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:00.227035 24915 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:00.228087 24915 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.229537 24915 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.128273 24937 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:07:00.135667 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:00.136440 21949 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:00.137157 21872 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:00.137252 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:00.141485 22020 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:00.232319 21946 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:00.127663 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:00.150738 24914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.020s	sys 0.049s
W20260709 13:07:00.233237 24914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.020s	sys 0.050s
I20260709 13:07:00.233422 24937 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:00.233587 24914 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:00.233856 24937 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.234321 24937 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.109097 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.234526 21944 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:00.235111 21870 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:00.234552 24914 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.121519 24876 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.200393 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:00.223479 21866 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:00.149434 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.163846 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:00.236946 24876 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.238207 24947 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.098218 24899 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.239053 24876 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.240139 24899 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:00.240085 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:00.244998 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 117426us
I20260709 13:07:00.245476 24732 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:00.246309 24899 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.246845 24899 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.250989 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:00.094262 24726 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.252292 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:00.252463 24899 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:00.247985 21941 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:00.246078 24732 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.249655 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:00.250289 21944 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:00.254808 21949 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:00.254846 24924 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.260396 24924 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:00.260720 24732 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:00.261106 24924 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.261376 24732 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.261945 24732 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.264460 24841 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:00.247195 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:00.267496 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:00.247268 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:00.268986 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:00.270943 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.273808 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.275166 21866 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:00.265081 24841 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.270782 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:00.278507 21987 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:00.284719 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.287585 22604 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:00.288211 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:00.278324 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:00.282120 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:00.311026 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:00.289222 21944 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:00.290472 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:00.313874 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:00.216280 24664 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.315311 21949 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:00.389571 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:00.278548 24890 raft_consensus.cc:2764] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:07:00.434427 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 123227us
W20260709 13:07:00.434664 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 154828us
I20260709 13:07:00.278383 24899 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.292037 24861 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:00.278215 24929 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.441075 21987 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:00.315779 24865 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.315448 24959 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.292263 24624 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 13:07:00.308281 24876 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 13:07:00.440848 24545 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.444943 24847 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.429586 24947 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:00.315279 24625 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:07:00.388095 24810 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:07:00.434729 24951 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:00.456703 24890 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.453282 24726 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.444118 24800 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.460584 24861 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:00.460363 24937 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.470798 24890 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.496321 24937 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:00.501228 24959 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:00.291865 21870 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:00.538213 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 107741us
I20260709 13:07:00.439579 21916 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:00.541623 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 101983us
W20260709 13:07:00.543136 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 264728us
I20260709 13:07:00.486276 24890 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.572494 22610 raft_consensus.cc:2410] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:00.576191 24656 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:00.576501 24828 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.466204 24545 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.573189 24800 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:00.616645 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.617702 24924 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:00.626884 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78718.1us
I20260709 13:07:00.628686 24819 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.632752 24828 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:00.634642 24828 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.637221 24841 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.637683 24958 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.638718 24958 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.645020 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:00.596565 24545 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.576699 24824 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 13:07:00.609858 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 327694us
I20260709 13:07:00.577338 24656 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.664748 24679 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:00.666711 24679 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:00.667273 24679 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:00.665328 21870 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:00.637593 24865 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:00.678551 24865 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.684837 24861 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:00.687265 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.696266 24818 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:00.696836 24818 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:00.698184 24818 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.699615 24818 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.700567 22609 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:00.656271 24959 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.772123 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:00.773732 21771 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 2 to 5, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:00.775918 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:00.748360 24958 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.782855 24656 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.782514 24819 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:07:00.813036 22609 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:00.813894 24991 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:00.815585 24992 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:00.817245 24992 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:00.817848 24992 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:00.767014 24679 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.818871 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:00.819943 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.821323 24951 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.821928 24951 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:00.822407 24951 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:00.822710 24686 consensus_queue.cc:1175] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
W20260709 13:07:00.823244 24986 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:07:00.820636 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.817169 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:00.825775 22610 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:00.813067 24988 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:00.829495 24988 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.831240 21768 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 284) took 9787 ms. Trace:
I20260709 13:07:00.827654 24886 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.834256 24886 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.835625 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:00.836683 22016 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:07:00.837638 24800 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:00.838349 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:00.839208 22020 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.839125 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:00.843531 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:00.849125 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:00.850204 21949 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:00.850633 21949 pending_rounds.cc:85] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 3
I20260709 13:07:00.850909 21949 pending_rounds.cc:107] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:00.851243 21949 raft_consensus.cc:2889] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:00.856797 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 49526.4us
I20260709 13:07:00.857894 24890 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.858451 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:00.849434 21948 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.805017 24924 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:00.882768 24924 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.885771 24924 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:00.886796 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 387927us
I20260709 13:07:00.892825 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:00.894095 24988 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.895771 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:00.900774 24893 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.832772 21768 rpcz_store.cc:276] 0709 13:06:51.043557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.043906 (+   349us) service_pool.cc:224] Handling call
0709 13:07:00.830963 (+9787057us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:56.157330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:56.345728 (+188398us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:56.370153 (+ 24425us) write_op.cc:435] Acquired schema lock
0709 13:06:56.377333 (+  7180us) tablet.cc:662] Decoding operations
0709 13:06:56.552881 (+175548us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:56.552934 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:56.552960 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:56.553345 (+   385us) tablet.cc:701] Row locks acquired
0709 13:06:56.553363 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:56.553502 (+   139us) write_op.cc:270] Start()
0709 13:06:56.553611 (+   109us) write_op.cc:276] Timestamp: P: 1783602416553458 usec, L: 0
0709 13:06:56.553632 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:56.633778 (+ 80146us) log.cc:844] Serialized 1672 byte log entry
0709 13:06:57.552241 (+918463us) op_driver.cc:464] REPLICATION: finished
0709 13:06:57.877705 (+325464us) write_op.cc:301] APPLY: starting
0709 13:06:57.877795 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:57.877933 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:57.878061 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:57.878645 (+   584us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:57.878905 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:57.878980 (+    75us) write_op.cc:312] APPLY: finished
0709 13:06:57.879304 (+   324us) log.cc:844] Serialized 41 byte log entry
0709 13:06:57.879514 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:57.879618 (+   104us) write_op.cc:454] Released schema lock
0709 13:06:57.879667 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:57.880049 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:57.880074 (+    25us) write_op.cc:454] Released schema lock
0709 13:06:58.334712 (+454638us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635606f32a 00007f6355ff4f14 00007f6355ff4ec3 00007f6355ff4e38 00007f6355ff4df3 00007f6355ff40dc 00007f635601de16 00007f6356005cbb 00007f6355ff039d 00007f6355ff3d75
Metrics: {"mutex_wait_us":649,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":150799,"apply.run_cpu_time_us":2315,"apply.run_wall_time_us":2323,"num_ops":4,"prepare.queue_time_us":254262,"prepare.run_cpu_time_us":23740,"prepare.run_wall_time_us":840344,"raft.queue_time_us":270153,"raft.run_cpu_time_us":46185,"raft.run_wall_time_us":843618,"replication_time_us":998392,"spinlock_wait_cycles":10266880,"thread_start_us":800516,"threads_started":4,"wal-append.queue_time_us":547157,"wal-append.run_cpu_time_us":54870,"wal-append.run_wall_time_us":1687865}]]}
I20260709 13:07:00.908186 21945 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:00.909837 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:00.910533 24667 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.877012 22015 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:00.923753 24824 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.924580 24824 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.927181 24824 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.872653 24958 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.874099 21771 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 6, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:07:00.937271 22020 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:00.844159 24656 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:07:00.880543 24732 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:00.959297 24865 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:00.962706 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:00.968750 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.962296 21771 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 6, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:00.978591 24929 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:00.979245 24929 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:00.982070 24880 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.982837 24880 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:00.984390 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.985083 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:00.986007 21870 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:00.987141 24865 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.987725 22601 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:00.988304 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.942328 24886 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:00.985219 21875 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:07:00.994741 21948 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:00.972411 24861 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.900852 24992 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.003026 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:01.006134 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.963027 24958 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.001541 22020 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:07:01.015547 24913 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.016256 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:01.017262 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:01.017310 24935 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.018949 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:00.998545 24890 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:01.037357 22016 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.036945 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:01.040014 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 144438us
W20260709 13:07:01.046473 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 53798.7us
I20260709 13:07:01.047348 24960 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.047842 24960 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.048226 24960 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.006862 24861 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:01.000865 24667 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:01.063437 21869 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.079629 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:01.080582 24924 raft_consensus.cc:2764] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:01.080809 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 64758.1us
I20260709 13:07:01.083528 21875 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:01.083127 24991 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:01.043911 21771 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.060148 24861 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:01.096894 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 45177.6us
I20260709 13:07:01.097532 24930 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:01.097098 21771 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:01.098186 24930 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:01.099432 24930 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.105137 24800 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.105937 24800 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.100224 21771 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 5, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:07:01.115128 24915 consensus_meta.cc:287] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.885s	user 0.004s	sys 0.016s
W20260709 13:07:01.116808 24975 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:01.111899 21771 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 5, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 5 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:00.996239 24929 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.084780 24913 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.084695 24886 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.094748 21870 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:01.070269 24992 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.137974 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:01.142814 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.140414 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:01.147467 25005 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.148207 24958 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.151621 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:01.152779 22018 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:01.153659 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.154458 22018 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:01.157114 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:01.157888 21950 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.158658 24951 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:01.156431 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.108485 24800 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.164767 24800 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:01.164914 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:01.165237 24886 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.165529 24800 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.167057 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:01.167850 24886 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:01.168679 24824 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:01.168992 24876 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:01.172510 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:01.173472 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.148466 25005 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.174883 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:01.175609 24819 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:01.175621 21872 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:01.176188 24679 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.176417 24819 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.177012 24925 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.177495 24925 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.177801 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:01.178826 24819 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.179769 24925 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:01.181041 22574 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:01.181931 24865 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:01.173405 22022 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:01.167950 24800 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.163946 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:01.192919 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:01.199823 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:01.176224 25005 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:01.209509 21875 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:01.186542 24865 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.077385 24935 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.080740 24939 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:07:01.196274 24951 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.145895 24915 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:01.224720 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.199316 24880 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:01.231077 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.217310 24865 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.233044 24732 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:01.233227 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:01.236629 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 46675.2us
I20260709 13:07:01.240958 24929 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.247063 21942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:01.248478 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:01.257967 24913 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.258118 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.259048 24913 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:01.259481 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.260247 22019 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:01.260174 24913 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:01.266280 22023 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 13:07:01.271199 24861 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.273448 22022 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:01.274035 24935 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:01.292497 22019 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:01.274196 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:01.224017 21771 catalog_manager.cc:5697] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 4, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 4 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:01.276659 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.278093 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.280812 24656 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.281296 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:01.283826 21950 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:01.251892 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:01.296288 22023 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.254577 24732 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:01.287612 24913 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:01.312873 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61049.1us
I20260709 13:07:01.319581 21945 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:01.321900 22020 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:01.316044 24824 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:01.327644 24824 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.328142 24824 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.324008 21916 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:01.332307 22017 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:01.332536 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:01.335350 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:01.336074 21945 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:01.337164 24876 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.337757 24876 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:01.338189 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.339080 22019 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:01.338721 24876 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.320081 21987 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:01.340395 24861 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:01.340828 24828 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:01.341253 24861 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:01.342007 24861 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:01.343513 24991 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:01.344509 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 70415us
I20260709 13:07:01.237303 24915 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.311214 24935 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.350515 22018 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:01.349190 21869 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:01.319726 24958 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.362838 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:01.352146 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:01.361059 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.368583 22019 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:01.364053 21771 catalog_manager.cc:5697] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 4, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 4 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:01.341279 24828 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.370086 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:01.253759 24667 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.313020 24656 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.380295 24828 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.349751 24886 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:01.343437 24861 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.381217 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:01.514499 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.432761 22023 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:01.376698 21868 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:01.412465 21946 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
W20260709 13:07:01.433760 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 63803.8us
W20260709 13:07:01.536791 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.542464 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.462121 21771 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:07:01.533401 24998 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.300s	user 0.005s	sys 0.000s
W20260709 13:07:01.531630 25003 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:07:01.586093 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:01.587298 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.588302 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 105641us
I20260709 13:07:01.383244 24545 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.527336 24992 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.460222 24951 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:01.593839 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.480705 24991 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:01.596300 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:01.598335 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.480684 24929 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.367069 24960 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.599872 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.515064 24865 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.587971 24924 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.390412 24935 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.595216 24925 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.597936 24951 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:01.611333 24818 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.014s	sys 0.033s
I20260709 13:07:01.495693 24913 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.388983 24732 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.638927 22604 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:01.632627 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:01.597023 24545 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.652119 25014 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:01.653167 25014 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:01.656677 24624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.004s	sys 0.019s
W20260709 13:07:01.657187 24624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.005s	sys 0.019s
I20260709 13:07:01.688858 24935 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.689724 24935 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:01.691588 25016 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:07:01.635444 24818 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.014s	sys 0.034s
I20260709 13:07:01.629179 24951 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.656252 25014 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.726810 21950 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:01.622655 24924 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.728801 24962 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.729660 24962 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:01.730180 24962 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.731153 24960 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.621438 24992 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.626888 24929 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.634593 24925 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.632095 24991 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.816367 24656 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.817013 24893 raft_consensus.cc:1064] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:07:01.736405 24890 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.835600 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:01.767069 24915 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:01.839088 22024 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:01.841284 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:01.845363 22020 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:01.842720 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 228037us
I20260709 13:07:01.847468 22023 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:07:01.848120 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 258842us
I20260709 13:07:01.859989 21950 raft_consensus.cc:1217] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:07:01.865051 21950 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:01.865783 24929 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:01.866004 24915 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:01.866780 25031 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.866603 24915 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.867329 25031 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.869493 25031 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.870625 25031 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.871080 25031 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.872084 24819 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.872570 24819 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.881311 24545 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.884886 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:01.885808 24706 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:01.886404 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:01.887715 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:01.895723 24679 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:01.895891 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:01.896222 24679 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:01.897564 24679 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.898255 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:01.899039 24679 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.899246 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:01.899626 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1827) took 1119 ms. Trace:
I20260709 13:07:01.900059 21944 rpcz_store.cc:276] 0709 13:07:00.779775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.780070 (+   295us) service_pool.cc:224] Handling call
0709 13:07:00.961346 (+181276us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4deee 0000000000375939 00007f635afc11e0 00007f635b08a0c4 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:07:00.961529 (+   183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.085348 (+123819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.085392 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.187345 (+101953us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.590175 (+402830us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:01.590215 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.691803 (+101588us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b54000fc654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:01.691876 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.899279 (+207403us) raft_consensus.cc:1685] finished
0709 13:07:01.899297 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.899434 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11274,"raft.queue_time_us":10540,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":4313,"spinlock_wait_cycles":225177216,"thread_start_us":374853,"threads_started":1,"wal-append.queue_time_us":694411}
I20260709 13:07:01.894016 24929 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:01.901721 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:01.901963 24929 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.902977 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:01.903846 24958 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:01.904214 24929 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:01.880434 24819 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.907212 21947 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:01.905705 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:01.904928 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:01.905298 21866 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:01.873227 25027 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:07:01.904631 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:01.904914 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:01.824417 24893 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.840826 24890 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.960724 21948 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.960690 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:02.003655 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:01.849807 24824 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.001s
I20260709 13:07:01.854820 21771 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:01.873790 24865 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.874492 24810 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.972577 21871 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:01.973228 21874 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:02.006946 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 182665us
I20260709 13:07:01.989558 24915 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.973865 25031 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.965313 24962 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.975734 24951 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:01.979607 24841 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:01.980741 24819 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:01.984354 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.976027 24828 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:01.876356 24925 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:01.874336 24992 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:01.987946 22020 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:01.967317 21868 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.984742 24656 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:01.997002 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 75203.4us
I20260709 13:07:01.904507 24958 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:01.991041 21988 connection.cc:256] RPC call timeout handler was delayed by -1.2088259789999256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260709 13:07:02.008000 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:02.061664 21875 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:02.031414 21941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.051s	sys 0.117s
W20260709 13:07:02.062423 21941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.051s	sys 0.118s
I20260709 13:07:02.027137 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:02.063685 21942 raft_consensus.cc:606] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:02.064198 21942 raft_consensus.cc:614] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:02.054150 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.072113 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.074101 21944 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.076210 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:02.030893 24924 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.071409 21771 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:02.055644 24915 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.006701 24824 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:02.084758 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.074167 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:02.089540 22601 raft_consensus.cc:2368] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:07:02.079053 24818 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.115234 21947 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:02.093868 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:02.060153 24819 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.113667 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.077824 24624 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.080449 24667 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.108839 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:02.030640 24810 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.053617 25028 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:07:02.092890 24929 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.097883 24908 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.068972 24841 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.121857 22609 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:02.134598 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.135149 21948 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:02.135221 21950 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:02.080111 24656 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.100401 24732 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.094444 24915 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.218295 25028 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.220721 25028 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.165477 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.225548 21875 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
W20260709 13:07:02.174966 25007 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.929s	user 0.000s	sys 0.010s
W20260709 13:07:02.214998 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.243244 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:02.244889 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 168777us
W20260709 13:07:02.160737 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 84723.9us
I20260709 13:07:02.133837 24908 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.141856 24929 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.289546 24908 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:02.291877 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 192350us
I20260709 13:07:02.194880 21944 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:07:02.297082 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.297760 21950 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
W20260709 13:07:02.166020 25033 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:07:02.217209 25025 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:07:02.173400 25030 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:02.134220 24991 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:02.307512 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:02.219223 25029 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:02.221554 24841 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.320498 22020 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:02.137391 25019 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:02.318179 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:02.320961 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:02.318064 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:02.324396 22017 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:02.327584 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 186367us
I20260709 13:07:02.173264 24828 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.296828 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:02.297654 24861 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.132138 24667 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.334934 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:02.346848 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.342943 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.347483 21950 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:02.347848 21948 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 2.
I20260709 13:07:02.345722 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:02.344823 25019 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.349812 25034 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:02.350260 25034 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.350663 25034 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:02.354616 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57898.6us
I20260709 13:07:02.347222 22021 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:02.304368 24819 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.142526 24624 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.363090 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:02.363466 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 64476.4us
W20260709 13:07:02.364384 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 241814us
I20260709 13:07:02.221483 24732 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.352319 25019 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:02.353394 25036 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:07:02.367319 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.339771 25029 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:02.219326 25037 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.236s
I20260709 13:07:02.346077 25028 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.137271 24818 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.372092 22020 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:02.367830 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:02.341615 24890 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.394898 22016 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:07:02.373380 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:02.444701 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68300.1us
I20260709 13:07:02.372783 21950 raft_consensus.cc:2410] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:07:02.356844 24686 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:02.428635 21868 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:02.442596 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.361080 24951 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:02.459450 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.357427 24861 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:02.371855 24706 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.461252 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:02.466393 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:02.467095 22020 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.464735 21948 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:07:02.383248 24824 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.471597 22601 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:07:02.486179 24861 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.490253 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2419) took 1114 ms. Trace:
I20260709 13:07:02.490824 22022 rpcz_store.cc:276] 0709 13:07:01.375976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.546244 (+170268us) service_pool.cc:224] Handling call
0709 13:07:01.592796 (+ 46552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.848997 (+256201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.849040 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:01.853865 (+  4825us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:01.853925 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.489904 (+635979us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54001f04d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:02.489960 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.490168 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588588928}
I20260709 13:07:02.455971 24929 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:02.482537 22601 pending_rounds.cc:85] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 6
I20260709 13:07:02.504721 22017 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:02.461881 24865 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.507470 21948 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:02.503921 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:02.516211 22604 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:02.513446 22601 pending_rounds.cc:107] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:07:02.516876 22601 raft_consensus.cc:2889] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:02.524847 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 64126.5us
W20260709 13:07:02.531447 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 169257us
W20260709 13:07:02.519192 25025 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:02.539634 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:02.508174 25049 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.508174 24819 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:02.536777 24656 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.484907 24706 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.513487 25050 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.526842 25031 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:02.551505 24890 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:02.554999 25052 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.533872 24810 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:02.542899 24915 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:02.567281 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.568257 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:02.549294 24865 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.574425 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:02.574441 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:02.561295 24841 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:02.596446 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:02.550238 25049 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.612316 22020 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:02.574716 24876 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:02.613871 22023 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:02.551936 24819 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:07:02.617008 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47425.8us
I20260709 13:07:02.618170 22606 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:02.618482 25035 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:07:02.618788 24913 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:02.619342 25041 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260709 13:07:02.619612 24624 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:02.620096 25044 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:07:02.645774 24706 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:02.619640 25024 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.514s	user 0.002s	sys 0.000s
I20260709 13:07:02.647522 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1828) took 1845 ms. Trace:
I20260709 13:07:02.644153 22023 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:02.647950 21941 rpcz_store.cc:276] 0709 13:07:00.804096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.818060 (+ 13964us) service_pool.cc:224] Handling call
0709 13:07:01.051562 (+233502us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:07:01.059869 (+  8307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.101261 (+ 41392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.101292 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.286376 (+185084us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b2c00010da8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:07:01.301983 (+ 15607us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.062880 (+760897us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:02.062931 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.063037 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.561215 (+498178us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:02.647289 (+ 86074us) raft_consensus.cc:1685] finished
0709 13:07:02.647313 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.647457 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12644,"raft.queue_time_us":13204,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"spinlock_wait_cycles":82971392,"thread_start_us":729431,"threads_started":1,"wal-append.queue_time_us":685974}
I20260709 13:07:02.626579 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:02.605211 24915 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.592125 24810 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:02.652829 24810 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:02.654043 24893 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.653877 24810 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.654528 24893 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:02.654989 24893 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.561483 25050 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.659363 25050 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.618221 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:02.635738 25037 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 13:07:02.644078 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 83229.6us
I20260709 13:07:02.663064 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:02.663548 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48038 (request call id 23) took 1530 ms. Trace:
I20260709 13:07:02.664861 24818 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.664072 21942 rpcz_store.cc:276] 0709 13:07:01.141952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.187540 (+ 45588us) service_pool.cc:224] Handling call
0709 13:07:02.663323 (+1475783us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b5400299854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635606c853 00007f635b03a60a 00007f63545c07d4 00007f63545c0762 00007f63545c0691 00007f63545c060c 00007f63545bf8c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:02.663454 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875631488}
I20260709 13:07:02.616209 24667 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:02.666106 24890 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:02.614307 24865 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:02.573096 25031 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.670555 25031 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.670464 24893 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.673030 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.621675 24841 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.674825 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.675661 24841 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:02.644878 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 84096.8us
I20260709 13:07:02.654289 24958 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.654776 21943 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:07:02.686465 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:02.614650 24876 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:02.686693 21916 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:02.698670 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.697825 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:02.699151 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:02.633498 24732 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.699426 21942 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:02.701313 22016 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:02.704221 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:02.710500 22574 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:02.559367 25029 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.715639 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:02.698799 24876 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:02.736354 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.747087 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:02.748975 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:02.750366 21950 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:02.752800 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:02.753664 21871 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.716398 24865 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:02.708540 24686 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.702884 25037 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.719648 24893 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.757838 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.719504 24679 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:02.599965 25052 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.764895 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:02.768792 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 104295us
I20260709 13:07:02.769260 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.757257 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.773563 21987 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:02.761399 25048 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.775882 25037 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.782764 21941 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:02.747151 24960 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.701779 24841 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:07:02.777343 21948 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 2.
I20260709 13:07:02.778667 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:02.762297 24828 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:02.772814 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:02.748440 24913 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:07:02.756121 24930 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:02.775882 22576 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.506s (SENT) [suppressed 17 similar messages]
I20260709 13:07:02.759058 24925 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.781744 21950 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:02.789014 22608 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:02.782609 25037 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.718142 25034 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.761179 24818 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.796857 21947 raft_consensus.cc:606] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:02.810276 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:02.724181 24915 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:02.797258 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:02.769992 24686 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:02.775590 24656 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.756745 24886 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:07:02.810559 21947 raft_consensus.cc:614] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:02.782401 25048 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.786721 24960 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.762230 24824 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:02.792290 25057 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.810554 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:02.811375 22610 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.785772 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:02.800849 24890 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:07:02.850010 21868 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:02.798974 24679 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:02.849205 21874 raft_consensus.cc:2410] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:02.804256 24935 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:02.809618 24828 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:02.790103 24908 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:02.884351 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72229.1us
I20260709 13:07:02.819414 24930 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:02.886667 22601 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:02.888190 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:02.848913 24686 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.813265 24624 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:07:02.873394 25057 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.854836 24960 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:02.901645 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 125748us
W20260709 13:07:02.898527 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 105028us
I20260709 13:07:02.818298 24818 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.905633 21950 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
W20260709 13:07:02.896104 25053 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:07:02.911294 21945 raft_consensus.cc:2393] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:02.914623 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 210445us
I20260709 13:07:02.890009 24935 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.851890 24656 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.919888 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:02.852044 24915 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.851912 24925 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.902810 25057 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.937188 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:02.937506 22603 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:07:02.938560 24545 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:02.938231 24679 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.939221 24545 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.916991 24726 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:07:02.941064 24828 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.942690 25064 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:02.943251 25064 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:02.944145 24925 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.920856 24935 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:02.945580 25064 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.946627 24930 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:02.952420 22606 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:02.921962 24810 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:02.886701 25067 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:02.981503 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:02.982478 21949 raft_consensus.cc:606] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:02.926471 24819 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.948868 25049 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.986301 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:02.943183 24915 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:02.993748 24545 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:02.997391 25034 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:03.011191 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:03.028811 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.029558 21947 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:02.979449 25043 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:03.032778 22610 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:02.981108 24732 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.981213 24925 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:03.041153 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 121338us
I20260709 13:07:03.042305 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:03.054746 21838 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:03.056707 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 131617us
I20260709 13:07:02.937211 25073 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:07:03.059365 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.061065 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:03.063104 21947 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:03.105691 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 188928us
I20260709 13:07:03.105984 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.107549 21941 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:03.053928 24841 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.054139 24819 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.006374 24810 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.061131 24890 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:03.115568 21839 leader_election.cc:400] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
W20260709 13:07:03.213192 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 97979.7us
I20260709 13:07:03.154244 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:03.056558 24732 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:03.198376 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.214069 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:03.254796 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.159282 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.186525 21871 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:03.059275 24865 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:03.153708 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:03.256708 21947 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:03.053719 25043 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.195411 24915 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.211843 24929 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.110908 24951 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:03.271127 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:03.217563 24841 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.265969 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:03.266755 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.269268 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.282030 21941 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:03.175000 25031 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:03.286573 25031 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.259959 24890 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:03.270807 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 154600us
I20260709 13:07:03.290503 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:03.292768 25064 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.263859 24908 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:03.293956 24890 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:03.271817 25073 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:03.295053 25073 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.296662 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:03.116792 24935 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.111495 24925 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.281626 24656 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:03.285691 25043 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:03.285781 24679 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.280438 24841 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.267396 24915 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:03.311986 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 158353us
I20260709 13:07:03.318262 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:03.318965 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:03.273630 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.262533 24819 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.209246 25083 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:07:03.281759 24991 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:03.333442 22016 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:03.326298 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.322633 25089 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.334969 24819 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:03.354399 25089 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.354704 24819 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:03.355008 25089 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.355279 24819 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.346127 24686 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.348505 25087 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:03.350136 25083 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:03.351990 24810 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:03.333730 25039 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:07:03.335331 25073 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:03.336119 24679 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:07:03.324262 25068 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:03.317045 24890 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:03.386708 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 64713.3us
I20260709 13:07:03.404173 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:03.427251 21947 raft_consensus.cc:2376] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7. Re-sending same reply.
I20260709 13:07:03.323315 24656 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.329680 24915 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.297993 24951 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.325416 24818 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:03.283529 24929 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.392096 25087 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:03.324975 25064 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:07:03.392439 25083 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:03.434952 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:03.443998 22019 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:03.391100 25030 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:07:03.436167 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:03.461367 22017 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:03.324537 25049 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:07:03.444913 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:03.446462 24679 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.449347 24732 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:03.480341 22019 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:03.484591 24925 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:03.445132 25074 raft_consensus.cc:2764] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:03.488222 25072 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:03.488505 25094 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.431347 25073 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.488756 25045 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:03.411355 24865 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.489938 24686 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:03.490254 25057 consensus_meta.cc:287] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.006s
I20260709 13:07:03.428750 24656 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:03.437266 25087 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:03.497857 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 110286us
I20260709 13:07:03.520612 25045 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:03.501680 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:03.535310 22017 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:03.519714 25073 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.521525 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:03.536772 22020 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.544035 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:03.502497 25072 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:03.537717 24656 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.553591 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:03.560316 24925 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:03.561261 24925 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.444031 25083 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.577703 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:03.578182 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:03.578655 22017 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:03.579700 22021 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:03.579792 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:03.580962 22017 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:03.581585 22023 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:03.608613 24819 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:03.538159 25057 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.564533 24925 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:03.546720 25089 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.574646 24924 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.632895 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:03.626161 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.628427 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.625883 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.532240 25094 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.640401 22574 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:03.629920 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:03.644559 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:03.610539 25079 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.407s	user 0.000s	sys 0.002s
I20260709 13:07:03.651081 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:03.647542 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:03.609184 24935 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:03.609364 24951 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:03.629170 25093 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:07:03.616948 24929 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:03.655824 21874 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:07:03.798454 25094 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:03.798622 21943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1235) took 1718 ms (client timeout 1781 ms). Trace:
I20260709 13:07:03.799387 21874 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:03.799479 25112 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:03.799870 21874 pending_rounds.cc:85] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 3
I20260709 13:07:03.800316 21874 pending_rounds.cc:107] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:03.800187 25112 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.800757 21874 raft_consensus.cc:2889] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:03.799106 21943 rpcz_store.cc:269] 0709 13:07:02.085489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.090467 (+  4978us) service_pool.cc:224] Handling call
0709 13:07:03.798461 (+1707994us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54003d2cd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:03.798548 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232009472}
I20260709 13:07:03.614490 25083 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.785050 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.624653 25099 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.619331 24876 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.000s
I20260709 13:07:03.805676 21872 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:07:03.779385 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:03.777639 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.763962 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.711874 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:03.714999 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.639762 25097 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:07:03.624177 24960 consensus_meta.cc:287] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.000s
I20260709 13:07:03.617945 25052 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:03.630198 25057 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:03.778520 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.779482 22020 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:03.808272 21871 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:03.807937 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:03.612385 25102 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:03.621757 25089 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:03.748633 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 101142us
I20260709 13:07:03.646787 25049 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:03.588033 25045 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.793900 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:03.814529 21872 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:03.815117 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.806012 25004 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.852550 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.646286 25029 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:03.764684 24810 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:03.653229 25039 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.630577 24908 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.179s
I20260709 13:07:03.825882 25108 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:03.758495 24991 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:03.794359 25040 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:03.904681 25040 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.905478 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.906656 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.906845 25040 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:03.827919 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.784358 25073 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:03.830610 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:03.652850 24913 raft_consensus.cc:2764] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:03.706725 24819 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.816085 25037 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.966s	user 0.005s	sys 0.008s
I20260709 13:07:03.853473 21867 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.622023 24924 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.885524 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:03.890030 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.817937 24929 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:03.684474 24915 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:03.853425 24841 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.001s
I20260709 13:07:03.812824 24876 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.899142 25108 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:03.902189 24991 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:03.903771 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.903892 25031 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:03.859743 25004 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.853358 25049 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.816493 24960 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.625692 25072 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.829424 25102 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:04.203632 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 401210us
I20260709 13:07:04.206476 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.914000 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.994551 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:04.203770 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 449196us
I20260709 13:07:03.910051 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:03.907807 21943 raft_consensus.cc:2410] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:04.230659 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:03.916118 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1240) took 1575 ms. Trace:
I20260709 13:07:03.885950 24810 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.888049 25039 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:04.234613 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 409638us
I20260709 13:07:04.237655 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.242373 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.242925 21869 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:04.240108 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:03.888722 25045 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:03.994029 25106 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:07:04.238857 24841 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.253999 21866 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 5: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:04.241132 24810 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.255156 24960 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.255972 24960 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:04.257007 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.257661 22602 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:04.261451 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.262432 21869 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
W20260709 13:07:04.245234 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.907262 21946 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:04.240199 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.231899 21945 rpcz_store.cc:276] 0709 13:07:02.340848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.341403 (+   555us) service_pool.cc:224] Handling call
0709 13:07:03.915882 (+1574479us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b5400377654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:03.916045 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258359680}
W20260709 13:07:04.187702 25105 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.378s	user 0.001s	sys 0.000s
I20260709 13:07:04.269029 21943 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:04.070487 25069 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.905s	user 0.002s	sys 0.000s
I20260709 13:07:03.907919 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.271785 21873 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:04.245172 21948 raft_consensus.cc:2376] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5. Re-sending same reply.
I20260709 13:07:04.245533 25040 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:04.242008 24819 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:03.869097 25099 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.275043 21941 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.246003 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.237357 25037 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.231041 25049 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.234262 25004 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.240435 25061 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:04.218986 24706 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:04.247555 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:04.284085 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:04.269873 25098 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.000s	sys 0.033s
I20260709 13:07:04.249691 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.250411 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.265619 22604 raft_consensus.cc:2410] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:04.288960 22610 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:07:04.267174 21867 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:04.268286 21949 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:03.852138 25110 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:03.911198 24880 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:04.123947 25113 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.390s	user 0.000s	sys 0.005s
I20260709 13:07:04.201226 25112 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.038285 25074 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.270659 21870 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:04.269963 22574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.008s
I20260709 13:07:03.894973 25029 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.273721 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:04.265499 25039 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.277180 21942 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:04.277602 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.279070 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:03.910641 24656 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.314178 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.314793 24841 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.315477 21875 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:04.315864 24819 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.316107 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.279770 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:04.248934 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:04.317651 22021 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:04.317746 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.318202 21873 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 5: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:04.318602 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.287745 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.289058 22601 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:04.293799 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.294296 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.319505 22602 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:04.294870 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.286250 25061 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.289515 24951 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.301340 21944 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:04.297472 21874 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:04.301972 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.301357 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:04.303013 22574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.008s	sys 0.008s
I20260709 13:07:04.314178 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:04.292515 24706 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.278949 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:04.294607 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.264333 24960 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.286571 25040 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:04.317869 21945 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:04.383122 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:04.384407 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 135550us
I20260709 13:07:04.287959 25052 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.431622 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:04.409111 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.320468 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.320874 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.432929 22020 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:04.379751 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.363027 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.445719 21950 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:04.467231 22603 raft_consensus.cc:2410] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:04.464764 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:04.434044 21867 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:07:04.387205 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.433856 21945 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.433550 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.292873 24880 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:04.419226 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 732709us
I20260709 13:07:04.432708 21941 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:04.469020 21839 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:04.435374 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.293067 25094 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:04.385335 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.471902 22610 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:04.469413 22574 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:04.445796 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.428061 25061 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.383944 25089 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:04.481047 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:04.472101 25087 consensus_meta.cc:287] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.918s	user 0.012s	sys 0.000s
I20260709 13:07:04.427448 25116 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:04.480389 24915 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.301834 24890 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 13:07:04.482527 24656 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.319437 25074 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.485673 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:04.446043 25114 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:04.486863 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.445358 24951 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.475162 25112 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:04.492136 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:04.495316 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.471490 25094 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.495926 21869 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.496275 21873 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:04.498481 22015 raft_consensus.cc:2410] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:04.485400 24667 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:04.488741 24706 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.502653 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.483413 24810 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.511157 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.511718 22605 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.497676 25028 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:04.513957 25028 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.516453 25028 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.507462 25040 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.498644 24876 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.520949 25037 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.517452 25029 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.522073 25099 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.484720 24880 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.487407 25087 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.502174 25094 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.497916 25112 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:04.509106 24667 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.548262 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:04.553512 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:04.556213 25112 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.496989 25089 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.581775 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:04.582427 24960 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.512955 24991 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.583273 25099 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:04.511924 24706 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.595609 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.596793 21871 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 2.
I20260709 13:07:04.596983 22610 raft_consensus.cc:2410] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:04.584059 24706 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.597913 24951 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.598095 24706 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.598932 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.599505 22610 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:04.600798 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.601557 22610 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:04.604300 22605 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
W20260709 13:07:04.605341 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 135983us
I20260709 13:07:04.544847 25054 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:04.606559 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 175007us
I20260709 13:07:04.499874 25114 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.570078 24924 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.611933 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:04.590059 24880 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.620555 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.619578 21869 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:04.622380 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:04.622933 21869 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.612100 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:04.631139 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.610738 25110 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:04.634461 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.634938 21867 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:04.638034 21987 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:04.630177 25099 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:04.646530 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:04.666039 21869 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:04.648092 24732 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.673164 24991 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.695652 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.672842 25048 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.692281 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:04.679704 25074 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.700882 25119 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:04.702854 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2441) took 1762 ms. Trace:
I20260709 13:07:04.703109 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 349) took 1602 ms. Trace:
I20260709 13:07:04.703536 21944 rpcz_store.cc:276] 0709 13:07:03.100864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.110110 (+  9246us) service_pool.cc:224] Handling call
0709 13:07:03.163246 (+ 53136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.431009 (+1267763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.702911 (+271902us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400299354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:04.703058 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2616935296}
I20260709 13:07:04.703294 22018 rpcz_store.cc:276] 0709 13:07:02.940314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.940524 (+   210us) service_pool.cc:224] Handling call
0709 13:07:02.954265 (+ 13741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.023368 (+ 69103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.023397 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.032083 (+  8686us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.168999 (+136916us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:03.169057 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.169152 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.700471 (+1531319us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b24001bd9b8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352e0b9c4 00007f6352e09acb 00007f6352fc4dc9 00007f6352fc4a55 00007f6352fc3fb0 00007f6355c3a488 00007f6355c3abe8 00007f6355c12398 00007f6355c0d76a 00007f6355c0cbb6
0709 13:07:04.702501 (+  2030us) raft_consensus.cc:1685] finished
0709 13:07:04.702525 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.702760 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107678,"raft.queue_time_us":69312,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4107,"spinlock_wait_cycles":24877824,"thread_start_us":67693,"threads_started":1,"wal-append.queue_time_us":325603}
I20260709 13:07:04.694435 25067 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:07:04.708264 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 445) took 1084 ms. Trace:
I20260709 13:07:04.676364 25099 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:04.709035 21868 rpcz_store.cc:276] 0709 13:07:03.623595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.630120 (+  6525us) service_pool.cc:224] Handling call
0709 13:07:03.630527 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.269987 (+639460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.270007 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.270035 (+    28us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:04.270054 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.707938 (+437884us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54000e0bd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:04.708001 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.708157 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470188928}
W20260709 13:07:04.743901 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 174036us
W20260709 13:07:04.744184 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 51990us
I20260709 13:07:04.694121 25045 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.690503 24732 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.745927 25127 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.749889 24732 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.750188 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.750289 25127 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.750874 21868 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:04.751893 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.752485 21868 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:07:04.752854 25127 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.753409 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.753508 25110 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.756069 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.693678 24991 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:04.698168 24667 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:04.698452 25089 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.765321 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.688680 25040 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:07:04.648241 25121 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:07:04.777720 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.779254 21870 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:04.746995 25067 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.745688 25099 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.766005 25054 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:04.761050 24810 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.749027 25045 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:04.795383 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:04.767923 24991 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.801586 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:04.801663 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.794816 25054 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:04.747917 25126 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:07:04.805867 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:04.809574 21869 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:04.778618 24908 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:04.811363 25114 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:04.811821 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.816941 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:04.793143 25087 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:04.839681 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 94609.9us
I20260709 13:07:04.818934 25054 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.849086 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.806772 24958 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.849977 21869 raft_consensus.cc:2368] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8.
I20260709 13:07:04.807478 25045 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.792922 24890 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:07:04.853714 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:04.855533 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.857630 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:04.858392 21946 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:07:04.861347 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:04.861948 21944 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.858317 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:04.804018 25039 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.846005 24841 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.848135 24880 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:04.881608 24880 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.884173 24880 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.866580 25087 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.869313 25089 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:07:04.875908 25112 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.905040 22023 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:04.905593 25112 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.868752 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:04.870786 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:04.908668 21943 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:04.872991 24706 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:04.874540 25004 consensus_meta.cc:287] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
I20260709 13:07:04.875393 25039 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:04.840977 24908 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.877655 24732 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.860177 24958 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:04.915442 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44498.7us
I20260709 13:07:04.966140 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:04.966567 24706 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:04.858203 25040 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:04.967180 25040 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:04.954866 25004 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.968405 25040 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.955632 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:04.970547 21943 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.857111 25114 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:07:04.868064 25054 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.979123 25094 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:04.982409 25094 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:04.961320 25039 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.963014 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:04.992659 21942 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:07:04.963510 25099 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:04.964627 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:04.965107 24732 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:04.984196 21949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1254) took 1548 ms (client timeout 2020 ms). Trace:
I20260709 13:07:04.986727 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:04.990013 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:04.990234 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:05.002038 21869 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.960165 21944 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:04.993710 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 86124.3us
I20260709 13:07:05.004701 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:04.994930 21943 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
W20260709 13:07:04.995879 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 233241us
I20260709 13:07:04.989871 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:05.001843 21949 rpcz_store.cc:269] 0709 13:07:03.435539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.909791 (+474252us) service_pool.cc:224] Handling call
0709 13:07:04.983986 (+1074195us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b540019c154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:04.984131 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85098752}
I20260709 13:07:05.006199 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.007419 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.008303 21949 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:05.009555 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.010210 21946 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.010185 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:05.010547 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.011762 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.012068 22606 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:04.990065 25040 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.024052 21869 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:07:05.001933 25089 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:05.052685 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.004346 24958 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:05.004652 25122 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.005367 24624 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:05.079952 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.069330 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.137523 21949 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.018685 24706 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.019778 25124 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.080888 21869 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
W20260709 13:07:05.082113 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 75994.4us
I20260709 13:07:05.081435 24908 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.086030 24958 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:05.090212 24991 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.091279 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:05.082406 24667 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:05.092288 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.092813 24841 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.092832 24732 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.093861 25048 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.094270 25072 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.095518 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2303) took 1265 ms. Trace:
I20260709 13:07:05.025754 25004 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.097368 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:05.100167 25046 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.004441 25039 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.027534 24865 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:07:05.101112 24624 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.163245 24624 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.034757 24925 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.104861 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:05.164393 22606 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.070214 25075 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.123286 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2302) took 1309 ms. Trace:
I20260709 13:07:05.127369 25082 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:05.169051 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 147546us
I20260709 13:07:05.005748 25112 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 13:07:05.085356 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 59564.2us
I20260709 13:07:05.136199 21946 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:05.179458 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.179733 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:05.136824 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 66370.1us
W20260709 13:07:05.080444 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66279.4us
I20260709 13:07:05.019124 25110 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.139300 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:05.210543 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 71371us
I20260709 13:07:05.062634 25114 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.069465 25061 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.002s
I20260709 13:07:05.144506 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.163988 24925 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:05.149799 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.151913 21870 rpcz_store.cc:276] 0709 13:07:03.830421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.885135 (+ 54714us) service_pool.cc:224] Handling call
0709 13:07:05.095299 (+1210164us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b5400217854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.095429 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96936192}
I20260709 13:07:05.140487 24706 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:05.159178 21838 leader_election.cc:336] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.696s (SENT)
I20260709 13:07:05.160248 25046 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.081636 25122 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.167249 21871 rpcz_store.cc:276] 0709 13:07:03.814078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.814751 (+   673us) service_pool.cc:224] Handling call
0709 13:07:05.123103 (+1308352us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54003179d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.123219 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845094144}
I20260709 13:07:05.169451 25082 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:05.228997 25061 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.246125 25082 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.246979 25102 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.247453 25061 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.223050 25124 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.248296 25124 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.250437 25124 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:05.251125 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:05.149720 24732 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:05.252420 24732 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:05.252724 25135 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:07:05.253952 25039 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.184655 21943 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.255373 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:05.256007 21871 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:05.193675 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.182542 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:05.175467 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:05.212253 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:05.221524 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:05.145398 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.218587 22606 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:05.259472 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.260437 21869 raft_consensus.cc:2368] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:07:05.261478 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.230381 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:05.237208 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.263088 21870 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:05.153277 25048 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:05.239765 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 138637us
W20260709 13:07:05.223678 25049 consensus_meta.cc:287] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.931s	user 0.011s	sys 0.002s
I20260709 13:07:05.228277 25114 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.242483 25046 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:05.251286 25133 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.178s	user 0.001s	sys 0.002s
I20260709 13:07:05.258234 21872 raft_consensus.cc:2410] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:05.231952 21945 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:07:05.266134 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53937.2us
W20260709 13:07:05.266846 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 84388us
I20260709 13:07:05.212127 24841 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.270139 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:05.270283 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.223026 24624 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.271910 25122 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:05.272334 25099 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:05.273013 21875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2289) took 1562 ms (client timeout 1647 ms). Trace:
W20260709 13:07:05.305676 21875 rpcz_store.cc:269] 0709 13:07:03.711112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.711273 (+   161us) service_pool.cc:224] Handling call
0709 13:07:05.272839 (+1561566us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54001b8854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.272962 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166308736}
W20260709 13:07:05.272328 21866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2293) took 1560 ms (client timeout 1602 ms). Trace:
W20260709 13:07:05.275519 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 81938us
I20260709 13:07:05.278509 21871 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3.
I20260709 13:07:05.230830 24925 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:05.283790 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47632.5us
I20260709 13:07:05.236320 24706 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.283672 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.288719 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:05.279489 25061 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.290786 25114 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:05.292799 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 133654us
I20260709 13:07:05.283504 25039 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:05.293318 25028 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:05.293957 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2304) took 1426 ms. Trace:
I20260709 13:07:05.172591 25075 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.327472 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:05.295943 21870 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.330786 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.332238 21988 leader_election.cc:400] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8.
I20260709 13:07:05.332527 21988 leader_election.cc:403] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:05.335855 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.309835 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:05.307009 21866 rpcz_store.cc:269] 0709 13:07:03.712445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.712555 (+   110us) service_pool.cc:224] Handling call
0709 13:07:05.272128 (+1559573us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b540044f554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.272265 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025744256}
I20260709 13:07:05.339432 22022 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:05.279819 25087 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.281097 24991 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.313041 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:05.319756 21869 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:05.299090 25048 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.323841 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1312) took 1028 ms. Trace:
I20260709 13:07:05.285262 25049 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.289022 25102 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.325826 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:05.327235 21872 rpcz_store.cc:276] 0709 13:07:03.867514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.175114 (+1307600us) service_pool.cc:224] Handling call
0709 13:07:05.293895 (+118781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.324487 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:05.382915 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:05.383191 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58804.1us
I20260709 13:07:05.383563 21945 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:05.354559 22023 rpcz_store.cc:276] 0709 13:07:04.295486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.301115 (+  5629us) service_pool.cc:224] Handling call
0709 13:07:05.323635 (+1022520us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54004187d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.323784 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095172864}
I20260709 13:07:05.351902 21870 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:05.353230 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.315387 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.340965 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.343333 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.342994 25028 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.391302 25028 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:05.392783 25061 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.393258 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 657) took 1095 ms. Trace:
I20260709 13:07:05.393780 22605 rpcz_store.cc:276] 0709 13:07:04.297610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.297769 (+   159us) service_pool.cc:224] Handling call
0709 13:07:05.393013 (+1095244us) spinlock_profiling.cc:243] Waited 92.4 ms on lock 0x7b540067f2d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.393153 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212438400}
I20260709 13:07:05.395051 25049 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.395773 25049 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.396060 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 654) took 1110 ms. Trace:
I20260709 13:07:05.397190 22016 raft_consensus.cc:2368] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:07:05.397712 25045 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.398171 22021 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:05.352787 24929 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.399818 25045 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.349367 25139 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:05.400702 25139 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.400987 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.401567 21866 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:05.402475 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.402742 25139 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.403178 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1697) took 1173 ms. Trace:
I20260709 13:07:05.403501 21866 rpcz_store.cc:276] 0709 13:07:04.229944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.402217 (+1172273us) service_pool.cc:224] Handling call
0709 13:07:05.403102 (+   885us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.338040 25136 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:05.349856 21948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1249) took 2010 ms (client timeout 1696 ms). Trace:
I20260709 13:07:05.337759 25052 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.350508 25039 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:05.409158 21948 rpcz_store.cc:269] 0709 13:07:03.339518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.650716 (+311198us) service_pool.cc:224] Handling call
0709 13:07:05.349588 (+1698872us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400140fd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.349748 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364316032}
I20260709 13:07:05.409190 25136 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.410151 25039 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.412097 25136 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.350796 24624 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.412783 25099 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:05.412842 24624 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:05.413407 25099 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:05.413599 24624 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.352080 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:05.413975 25099 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.381255 25114 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:05.418359 25114 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:05.419253 25114 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.358829 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:05.421515 21873 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:05.423013 21873 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:05.423547 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2306) took 1150 ms. Trace:
I20260709 13:07:05.423853 21873 rpcz_store.cc:276] 0709 13:07:04.272781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.422241 (+1149460us) service_pool.cc:224] Handling call
0709 13:07:05.422618 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.423345 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.423501 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.361788 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:05.365171 21874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2299) took 1561 ms (client timeout 1624 ms). Trace:
I20260709 13:07:05.366365 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:05.425341 21874 rpcz_store.cc:269] 0709 13:07:03.804292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.805277 (+   985us) service_pool.cc:224] Handling call
0709 13:07:05.364978 (+1559701us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54003ad754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.365103 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020147584}
W20260709 13:07:05.426034 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 69861.9us
I20260709 13:07:05.426560 21867 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:05.425320 21868 raft_consensus.cc:2410] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:05.367376 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:05.373857 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.427870 25052 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.428377 25052 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.430455 25052 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.316754 24865 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:07:05.408377 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:05.431296 22609 raft_consensus.cc:2376] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8. Re-sending same reply.
I20260709 13:07:05.431484 24865 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:05.396651 22607 rpcz_store.cc:276] 0709 13:07:04.285493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.285794 (+   301us) service_pool.cc:224] Handling call
0709 13:07:05.125460 (+839666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.125660 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.125692 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.125740 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:05.125799 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.125871 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.395829 (+269958us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b5400587350. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.395966 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894306560}
I20260709 13:07:05.427141 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1703) took 1128 ms. Trace:
I20260709 13:07:05.369305 24841 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.432876 21867 rpcz_store.cc:276] 0709 13:07:04.298940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.425968 (+1127028us) service_pool.cc:224] Handling call
0709 13:07:05.426275 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.426912 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.427092 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.375663 24935 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.434592 21867 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:07:05.434806 24935 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.435748 21871 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:05.436013 21867 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:05.436998 21871 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.437198 24935 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.437460 21950 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.438292 21871 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:05.439364 21871 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:05.441150 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:05.441431 21871 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:07:05.442590 25075 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.358492 25108 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.443725 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:05.431918 24865 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:07:05.457290 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 141999us
I20260709 13:07:05.448520 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.464226 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:05.466495 25148 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:07:05.461648 25144 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.468966 22608 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:05.468358 24667 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:07:05.466791 25061 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8.
I20260709 13:07:05.444371 21941 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:05.473284 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.473959 21867 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:05.384155 21838 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:05.474843 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:05.475291 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 91192.5us
I20260709 13:07:05.475870 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.476186 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:05.477257 24841 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:05.477490 25122 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:05.444916 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.477799 24841 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:07:05.478155 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.478741 24841 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.479477 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:05.441045 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:05.446058 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.447561 22606 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:05.477087 24865 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.478096 25122 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:05.446964 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.482340 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:05.482389 21872 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.353835 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.441844 21871 pending_rounds.cc:85] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 4
I20260709 13:07:05.471334 24732 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.756139 21871 pending_rounds.cc:107] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:05.476461 21867 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:05.589421 21941 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:05.646250 21866 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:05.522503 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.502460 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.659104 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.758206 21942 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:05.758751 22020 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:05.496851 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:05.759236 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.456260 21950 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:05.501822 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:05.760026 22023 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:05.613726 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.760949 22018 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:05.679708 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:05.757637 21866 pending_rounds.cc:85] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 4
W20260709 13:07:05.761783 21949 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260709 13:07:05.760257 22603 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.762521 21949 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:05.761935 21866 pending_rounds.cc:107] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:05.544916 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:05.762742 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 146190us
I20260709 13:07:05.659101 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.763438 21866 raft_consensus.cc:2889] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.664462 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.502194 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.766100 22024 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:05.645430 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2321) took 1045 ms. Trace:
I20260709 13:07:05.767192 21868 rpcz_store.cc:276] 0709 13:07:04.599731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.753118 (+153387us) service_pool.cc:224] Handling call
0709 13:07:05.645145 (+892027us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540006f9d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:05.645350 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543051136}
I20260709 13:07:05.483695 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:05.765268 22017 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 4.
I20260709 13:07:05.756733 21871 raft_consensus.cc:2889] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.763796 22021 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.758618 21870 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:05.766853 21946 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:05.761864 22601 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.763795 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.770145 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:05.770607 21949 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:05.774358 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.775031 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.775771 22023 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:05.777670 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2323) took 1177 ms. Trace:
I20260709 13:07:05.781100 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:05.504551 25054 consensus_meta.cc:287] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.005s
W20260709 13:07:05.781927 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.781982 21871 rpcz_store.cc:276] 0709 13:07:04.600299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.440867 (+840568us) service_pool.cc:224] Handling call
0709 13:07:05.441121 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.777403 (+336282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.777615 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.775053 22018 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:05.784457 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:05.788797 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 436057us
I20260709 13:07:05.789546 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.461787 25072 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:05.793509 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.794716 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:05.802618 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.795915 22015 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:05.515290 24706 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.807934 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.809175 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.810060 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:05.810892 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.811461 21871 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:05.812144 25073 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:05.812767 25102 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.813166 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:05.799973 24865 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.813932 21875 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:05.814334 22604 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:05.511763 25061 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.817349 21987 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:05.802914 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:05.800705 24924 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.798826 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.645157 25136 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:05.805094 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.810153 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.796434 22019 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.813601 25073 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:05.833704 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:05.540310 25099 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.819067 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:05.836119 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.824672 24960 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:05.396201 25049 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.783258 25086 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.539053 24624 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.829893 25144 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:05.802738 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:05.834177 21942 raft_consensus.cc:2368] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:07:05.800280 25046 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.806499 25087 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.877530 25087 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:05.877956 25087 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.878130 21988 leader_election.cc:400] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:07:05.878497 21988 leader_election.cc:403] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:05.879359 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:05.880280 22601 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:05.838025 22015 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:05.852284 25029 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.794036 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:05.818553 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:05.881956 25140 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.815236 25110 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.884078 25110 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.862574 25086 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.822211 25061 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.885049 25086 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.881971 21870 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:05.885370 25061 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.886583 21870 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:05.887187 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1710) took 1286 ms. Trace:
I20260709 13:07:05.887486 21870 rpcz_store.cc:276] 0709 13:07:04.600627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.886098 (+1285471us) service_pool.cc:224] Handling call
0709 13:07:05.886421 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.886958 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.887136 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.819725 22603 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:05.855613 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:05.858817 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:05.792721 25146 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:07:05.892881 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:05.805938 25072 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.895545 24732 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.895624 25072 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:05.875840 25049 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.876220 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.826789 25054 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:05.880391 24890 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:05.884801 25040 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:05.900000 22018 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:05.837320 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:05.889930 22020 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:05.890185 21868 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:05.891652 22604 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:05.892643 25123 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.893689 21870 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:05.903775 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1714) took 1302 ms. Trace:
I20260709 13:07:05.904110 21870 rpcz_store.cc:276] 0709 13:07:04.601800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.888200 (+1286400us) service_pool.cc:224] Handling call
0709 13:07:05.888535 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.903499 (+ 14964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.903698 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.877043 25046 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.891357 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:05.901091 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 63911us
I20260709 13:07:05.855526 24960 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:05.833449 24924 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.902922 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1715) took 1273 ms. Trace:
I20260709 13:07:05.928719 21868 rpcz_store.cc:276] 0709 13:07:04.629514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.889717 (+1260203us) service_pool.cc:224] Handling call
0709 13:07:05.889995 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.902674 (+ 12679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.902871 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.931687 22020 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.875855 24624 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:05.849916 25136 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.925680 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:05.927771 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.932745 25052 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:05.942835 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.943212 25052 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:05.943756 25052 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:05.944093 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:05.945225 24925 consensus_meta.cc:287] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 13:07:05.930603 24960 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:05.945869 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.945724 24925 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.947933 24925 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:05.934098 24935 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:05.948329 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.949297 22017 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:05.913430 25004 raft_consensus.cc:2764] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:05.949525 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:05.897379 25144 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.950744 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.951391 21947 raft_consensus.cc:2368] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:05.952033 25144 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:05.953686 25136 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.953516 22609 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.900298 25049 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.957800 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:05.944796 25052 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:05.960644 22573 leader_election.cc:400] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:05.962901 22022 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:05.963300 22573 leader_election.cc:403] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:05.961977 21942 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 3: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:05.968212 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:05.969980 22603 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:05.976835 25099 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.979204 24706 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:05.980209 24706 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.935194 25054 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:05.991295 25054 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:05.981839 25154 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:05.902534 25146 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:07:05.982136 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:05.965890 25144 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:05.989966 25004 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:05.983518 24706 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:05.997375 24960 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.998142 24924 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:06.008948 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:06.032892 22609 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:06.036520 21943 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:05.952045 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:06.010077 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2326) took 1326 ms. Trace:
W20260709 13:07:06.013424 25156 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:07:05.913043 24890 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:05.927863 25153 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:07:06.015393 25082 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.019454 25052 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.932366 25046 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:06.026090 25144 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:06.060964 25144 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.061862 25046 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:05.868337 25122 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:06.022636 22016 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1311) took 1727 ms (client timeout 2137 ms). Trace:
W20260709 13:07:06.062675 22016 rpcz_store.cc:269] 0709 13:07:04.295305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.301462 (+  6157us) service_pool.cc:224] Handling call
0709 13:07:06.022395 (+1720933us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540017b6d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:06.022551 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136181504}
I20260709 13:07:06.063879 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:06.066058 24890 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:06.066409 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:06.066635 25087 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:06.030498 21872 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:06.032162 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:06.034152 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 215663us
I20260709 13:07:06.034276 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2309) took 1589 ms. Trace:
I20260709 13:07:06.034997 22021 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
W20260709 13:07:06.068858 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.038573 21869 rpcz_store.cc:276] 0709 13:07:04.684121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.261169 (+577048us) service_pool.cc:224] Handling call
0709 13:07:06.009856 (+748687us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b54003188d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:06.010002 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132354432}
I20260709 13:07:05.926141 25061 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:06.042009 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:06.071365 22023 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:06.051390 24960 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:06.052474 21949 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:06.108860 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:06.067974 21868 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.068382 21874 rpcz_store.cc:276] 0709 13:07:04.445167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.426278 (+981111us) service_pool.cc:224] Handling call
0709 13:07:05.426552 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.426751 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:05.703341 (+276590us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.032855 (+329514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.033997 (+  1142us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.034049 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.034113 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.034222 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":386760,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":35,"raft.queue_time_us":15631,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":605236,"threads_started":3,"wal-append.queue_time_us":334027}
I20260709 13:07:06.029522 24828 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:07:06.035601 24706 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.112675 21875 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:06.527421 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.534756 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1720) took 1780 ms. Trace:
I20260709 13:07:06.535457 21875 rpcz_store.cc:276] 0709 13:07:04.753932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.112035 (+1358103us) service_pool.cc:224] Handling call
0709 13:07:06.112343 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.534479 (+422136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.534697 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.535997 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:06.115103 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.474269 21914 leader_election.cc:336] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.526s (SENT)
I20260709 13:07:06.537284 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:06.035610 25108 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.111804 21943 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.184054 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1718) took 1481 ms. Trace:
I20260709 13:07:06.206609 21947 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
W20260709 13:07:06.537484 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 63285.8us
W20260709 13:07:06.610946 21914 leader_election.cc:336] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.539s (SENT)
I20260709 13:07:06.537864 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:06.611400 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:06.114346 21988 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:06.338888 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.528234 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 458172us
I20260709 13:07:06.613175 21841 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:06.610353 21874 rpcz_store.cc:276] 0709 13:07:04.702709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.115628 (+1412919us) service_pool.cc:224] Handling call
0709 13:07:06.183330 (+ 67702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.183572 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.183610 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.183667 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:06.183716 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.183810 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.183971 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.611399 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:06.617058 21947 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.538507 21942 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
W20260709 13:07:06.540498 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 582725us
W20260709 13:07:06.640735 21914 leader_election.cc:336] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.566s (SENT)
I20260709 13:07:06.641135 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:06.641242 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.641248 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:06.642117 21869 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
W20260709 13:07:06.161962 25142 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:06.646577 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:06.648063 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.648779 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:06.649268 21875 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.650269 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.650878 21874 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:06.651340 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:06.160202 25140 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:07:06.463686 24930 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.377609 25061 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:06.651947 21942 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:06.244812 24960 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.158273 25087 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:06.654284 21869 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:07:06.481145 25004 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:06.212265 25146 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:06.654253 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.658257 21873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.040s	sys 0.096s
I20260709 13:07:06.659907 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:06.660295 21873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.041s	sys 0.096s
I20260709 13:07:06.660590 21874 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:06.661952 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.643808 24828 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:06.670353 21869 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
W20260709 13:07:06.660362 25144 consensus_meta.cc:287] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
I20260709 13:07:06.187405 25086 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:06.676316 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1723) took 1914 ms. Trace:
I20260709 13:07:06.678097 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:06.676784 21869 rpcz_store.cc:276] 0709 13:07:04.761867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.671113 (+1909246us) service_pool.cc:224] Handling call
0709 13:07:06.675864 (+  4751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.676022 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.676044 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.676081 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:06.676112 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.676161 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.676253 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.679669 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:06.680418 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 361) took 1065 ms. Trace:
I20260709 13:07:06.676168 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1722) took 1915 ms. Trace:
I20260709 13:07:06.729132 21874 rpcz_store.cc:276] 0709 13:07:04.760521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.670358 (+1909837us) service_pool.cc:224] Handling call
0709 13:07:06.675696 (+  5338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.675857 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.675882 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.675921 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:06.675952 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.676004 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.676108 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.732071 22601 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:06.733592 21947 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:06.734603 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:06.735149 21947 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.680721 22024 rpcz_store.cc:276] 0709 13:07:05.614970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.766978 (+152008us) service_pool.cc:224] Handling call
0709 13:07:06.679512 (+912534us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b5800200498. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:07:06.680370 (+   858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6695168}
I20260709 13:07:06.667574 25166 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:07:06.747565 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1895) took 1404 ms. Trace:
I20260709 13:07:06.748027 21941 rpcz_store.cc:276] 0709 13:07:05.342856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.343102 (+   246us) service_pool.cc:224] Handling call
0709 13:07:06.747370 (+1404268us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b54001405d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:06.747498 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128881536}
I20260709 13:07:06.659080 24930 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:06.750279 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2454) took 1429 ms. Trace:
I20260709 13:07:06.750725 22019 rpcz_store.cc:276] 0709 13:07:05.321201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.321335 (+   134us) service_pool.cc:224] Handling call
0709 13:07:05.321620 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.828245 (+506625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.750050 (+921805us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54000dd9d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:06.750220 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091532160}
I20260709 13:07:06.751433 24930 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:06.752071 21947 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:06.755087 21867 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.759038 21945 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:07:06.756449 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1709) took 2156 ms. Trace:
I20260709 13:07:06.759861 21867 rpcz_store.cc:276] 0709 13:07:04.600331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.790868 (+1190537us) service_pool.cc:224] Handling call
0709 13:07:05.809200 (+ 18332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.754942 (+945742us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b54002948a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fe9dc0 00007f63560741c0 00007f6356075231 00007f6356071d8f 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c
0709 13:07:06.755535 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.756190 (+   655us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54001b8854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:06.756382 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938928128}
I20260709 13:07:06.761900 21875 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:06.763377 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 458) took 1403 ms. Trace:
I20260709 13:07:06.763715 21875 rpcz_store.cc:276] 0709 13:07:05.360151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.762632 (+1402481us) service_pool.cc:224] Handling call
0709 13:07:06.762926 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.763091 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.763117 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.763154 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:06.763186 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.763238 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.763327 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.764029 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 452) took 1921 ms. Trace:
I20260709 13:07:06.765064 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 456) took 1405 ms. Trace:
I20260709 13:07:06.765590 21867 rpcz_store.cc:276] 0709 13:07:05.359560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.760559 (+1400999us) service_pool.cc:224] Handling call
0709 13:07:06.764573 (+  4014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.764770 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.764799 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.764837 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:06.764864 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.764915 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.765013 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.661708 24960 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:06.767954 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.768142 21874 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:06.765496 21869 rpcz_store.cc:276] 0709 13:07:04.842527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.679420 (+1836893us) service_pool.cc:224] Handling call
0709 13:07:06.763470 (+ 84050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.763611 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.763732 (+   121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.763796 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:06.763829 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.763883 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.763981 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.664197 25004 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:06.768776 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 453) took 1410 ms. Trace:
I20260709 13:07:06.668699 25146 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:06.773443 21875 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:06.773998 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 460) took 1401 ms. Trace:
I20260709 13:07:06.770565 21874 rpcz_store.cc:276] 0709 13:07:05.358559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.729914 (+1371355us) service_pool.cc:224] Handling call
0709 13:07:06.765778 (+ 35864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.768464 (+  2686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.768718 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.731360 24828 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:06.774240 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:06.774250 21875 rpcz_store.cc:276] 0709 13:07:05.372816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.772989 (+1400173us) service_pool.cc:224] Handling call
0709 13:07:06.773222 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.773797 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.773957 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.778400 22602 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.778826 25086 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:06.675706 25144 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:06.756814 25054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.008s	sys 0.017s
I20260709 13:07:06.784420 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 459) took 1424 ms. Trace:
I20260709 13:07:06.785122 21874 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:06.786330 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:06.767910 25122 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:06.791126 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:06.789122 21871 rpcz_store.cc:276] 0709 13:07:05.360488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.770552 (+1410064us) service_pool.cc:224] Handling call
0709 13:07:06.783971 (+ 13419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.784133 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.784162 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.784204 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.784239 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.784295 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.784372 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.789454 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 159352us
I20260709 13:07:06.809674 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:06.788975 25054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.008s	sys 0.017s
I20260709 13:07:06.820112 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:06.820187 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:06.834124 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 193191us
W20260709 13:07:06.834929 21914 leader_election.cc:336] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.584s (SENT)
W20260709 13:07:06.835879 21914 leader_election.cc:336] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.602s (SENT)
I20260709 13:07:06.836328 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:06.837735 21914 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.624s (SENT)
W20260709 13:07:06.838601 21914 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.647s (SENT)
W20260709 13:07:06.838656 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 225555us
I20260709 13:07:06.839145 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:06.817945 25121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.970s	user 0.012s	sys 0.019s
I20260709 13:07:06.841722 21874 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.843179 21841 leader_election.cc:400] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:07:06.855348 21874 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:06.841823 25029 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.836990 25164 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.858775 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:06.834721 24951 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 13:07:06.847736 25121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.998s	user 0.012s	sys 0.020s
I20260709 13:07:06.874071 21838 leader_election.cc:400] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:07:06.874617 21838 leader_election.cc:403] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:07:06.833180 25175 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:07:06.875751 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:06.881304 21874 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.859894 24828 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.865566 25121 consensus_queue.cc:1243] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:07:06.883643 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 63610.9us
I20260709 13:07:06.903908 22608 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:06.902745 21874 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
W20260709 13:07:06.891742 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72127.1us
I20260709 13:07:06.915681 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.916383 21874 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:06.920431 21874 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:06.865850 25087 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:06.922924 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.883983 24679 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.925915 21874 raft_consensus.cc:2376] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5. Re-sending same reply.
I20260709 13:07:06.893643 25176 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:06.936952 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.937141 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:06.955325 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:06.955981 21874 raft_consensus.cc:2376] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8. Re-sending same reply.
I20260709 13:07:06.956913 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.957787 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.958318 21874 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:06.885237 25132 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:07:06.969103 25173 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:07:06.939065 25176 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:06.970397 25176 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.970566 25146 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:06.971498 25165 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:07:06.972613 22608 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.923177 25181 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:06.961261 25144 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:06.965293 25169 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:07:06.966473 25174 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:06.967555 25004 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:06.968683 25185 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:07:06.979329 24930 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:06.925849 24828 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:06.959017 24960 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:06.937496 24679 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:06.960327 25170 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:07:06.975180 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:06.974396 25087 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:06.984952 24951 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:07.010716 24679 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.010933 25087 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:07.011552 24951 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:06.985635 25175 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:07.012100 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2307) took 2727 ms. Trace:
I20260709 13:07:07.012174 25175 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:07.011922 25087 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:06.954892 25177 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:07:06.986142 25132 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.013175 25175 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.014093 25132 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:06.959087 25114 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:07:07.015079 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.015801 21874 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 5: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:06.986006 25162 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:06.990651 21949 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.990692 22573 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:06.968313 24706 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:06.995581 21943 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.013425 25087 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.011924 24951 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:06.982587 25181 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.024423 25162 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.024729 25189 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:07.024972 25162 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:07.025434 25189 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:07.025970 25162 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:07.026911 25190 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:07.027344 25162 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.016896 25174 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.025978 25181 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:06.990562 25191 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:07.017146 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.012638 21873 rpcz_store.cc:276] 0709 13:07:04.287271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.424521 (+1137250us) service_pool.cc:224] Handling call
0709 13:07:05.483253 (+ 58732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.754162 (+270909us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:06.024463 (+270301us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.661038 (+636575us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.766740 (+105702us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.766892 (+   152us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:06.766922 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.766992 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.011887 (+244895us) raft_consensus.cc:1685] finished
0709 13:07:07.011905 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.012044 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4951,"prepare.queue_time_us":59509,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":343278,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":13307,"thread_start_us":837817,"threads_started":2,"wal-append.queue_time_us":735814}
I20260709 13:07:07.029546 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:07.029731 25174 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:07.021958 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.030122 21873 raft_consensus.cc:2376] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6. Re-sending same reply.
I20260709 13:07:07.029577 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.031081 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.016294 25132 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:07.031759 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.032563 21875 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:07.033669 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:07.034137 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 112183us
I20260709 13:07:07.034309 21874 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.026402 25189 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.034446 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.036831 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.037678 21873 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:07.040450 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:07.041033 21873 raft_consensus.cc:2376] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8. Re-sending same reply.
I20260709 13:07:07.041800 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.045243 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:07.045859 21873 raft_consensus.cc:2376] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9. Re-sending same reply.
I20260709 13:07:07.046675 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.047305 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:07.048508 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:07.049329 21946 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:07.053757 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:07.053184 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:07.055850 22605 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:07.055831 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 188674us
I20260709 13:07:07.056814 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:07.057653 21873 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:07.059643 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:07.061240 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:07.066454 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:07.067381 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:07.068446 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:07.055223 25029 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:07.109282 24706 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:07.061141 25114 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:07.072316 21874 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:07.071674 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:07.072531 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:07.043337 24960 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:07:07.034879 25176 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:07.118762 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 47160.9us
I20260709 13:07:07.059312 25164 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:07.119936 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.055208 25185 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:07:07.121858 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:07.072467 25177 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.123792 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:07.064342 25181 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:07:07.072942 25180 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.115386 21914 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:07.072885 25174 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:07.110620 25029 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.031778 24951 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:07.138661 25004 consensus_queue.cc:1175] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:07:07.142438 24960 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:07.143041 24960 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:07.120280 24828 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:07.070240 25184 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.131599 21874 raft_consensus.cc:2376] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5. Re-sending same reply.
I20260709 13:07:07.146188 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.147388 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.147967 21874 raft_consensus.cc:2376] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3. Re-sending same reply.
I20260709 13:07:07.121665 25114 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.148840 25114 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.149221 25114 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.151713 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2482) took 1193 ms. Trace:
I20260709 13:07:07.136350 25029 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:07.152808 25029 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.153169 21875 raft_consensus.cc:2410] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:07.152125 22021 rpcz_store.cc:276] 0709 13:07:05.958436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.069119 (+110683us) service_pool.cc:224] Handling call
0709 13:07:06.069377 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.069674 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.069703 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.110885 (+ 41182us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.009072 (+898187us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b1800439ae0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:07:07.071990 (+ 62918us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:07.072032 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.072101 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.151399 (+ 79298us) raft_consensus.cc:1685] finished
0709 13:07:07.151422 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.151651 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39217,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":47110,"spinlock_wait_cycles":15003392,"thread_start_us":62726,"threads_started":1,"wal-append.queue_time_us":1038895}
I20260709 13:07:07.144152 24960 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.130218 25192 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:07.156296 25178 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.156855 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2474) took 1494 ms. Trace:
I20260709 13:07:07.156921 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.157444 25181 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:07.157845 25181 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:07.158221 24890 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.158378 25119 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.158695 24890 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.158936 25119 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.161365 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1700) took 2924 ms. Trace:
I20260709 13:07:07.161586 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.161799 21866 rpcz_store.cc:276] 0709 13:07:04.236995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.404172 (+1167177us) service_pool.cc:224] Handling call
0709 13:07:05.645613 (+241441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.778943 (+133330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.161155 (+1382212us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540006f9d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:07.161293 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554515328}
I20260709 13:07:07.162240 22019 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:07.163012 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:07.163296 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:07.163553 21866 raft_consensus.cc:2376] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 3. Re-sending same reply.
I20260709 13:07:07.164290 25119 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:07.159103 25126 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:07.165174 25126 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:07.165521 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.166090 25126 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.167408 25126 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.170504 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:07.170356 25029 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.171612 25192 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:07.171813 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:07.172819 22604 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:07.172591 25192 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.173532 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:07.154213 25176 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:07.174649 22021 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.166090 21874 raft_consensus.cc:2376] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8. Re-sending same reply.
I20260709 13:07:07.157292 22017 rpcz_store.cc:276] 0709 13:07:05.662828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.951168 (+288340us) service_pool.cc:224] Handling call
0709 13:07:05.951446 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.951638 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:05.951947 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.185265 (+233318us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.156297 (+971032us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b1800439d20. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:07:07.156486 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.156551 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.156619 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.156681 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.156799 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":930887,"prepare.queue_time_us":27755,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":1034481,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":20186,"spinlock_wait_cycles":65942656,"thread_start_us":230540,"threads_started":1,"wal-append.queue_time_us":725531}
I20260709 13:07:07.179262 24890 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:07.180545 25029 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:07.181859 25046 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:07.186707 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 362) took 1571 ms. Trace:
W20260709 13:07:07.185132 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.182595 25054 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:07.187166 22023 rpcz_store.cc:276] 0709 13:07:05.615265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.863879 (+248614us) service_pool.cc:224] Handling call
0709 13:07:06.071148 (+207269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.113971 (+ 42823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.186521 (+1072550us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540017acd0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:07.186652 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394126208}
I20260709 13:07:07.158654 25181 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.188436 25046 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.188766 25181 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.189888 25054 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:07.190308 25054 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.190661 25054 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.184846 25185 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:07.192996 25185 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:07.193706 25167 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.424s	user 0.000s	sys 0.001s
I20260709 13:07:07.194139 25185 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.164522 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:07.196925 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:07.197242 25174 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:07.197690 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:07.198297 25174 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.198966 25140 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.199379 25140 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.199729 25140 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:07.200623 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.185107 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 363) took 1569 ms. Trace:
I20260709 13:07:07.200770 25193 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:07.201427 25193 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:07.201808 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1893) took 1867 ms. Trace:
I20260709 13:07:07.201059 25086 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:07.183511 25179 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.202503 25193 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.203248 25178 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:07.202253 21944 rpcz_store.cc:276] 0709 13:07:05.334699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.342021 (+  7322us) service_pool.cc:224] Handling call
0709 13:07:05.369068 (+ 27047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.432818 (+ 63750us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:05.433058 (+   240us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.824336 (+391278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.824396 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:05.824452 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.201601 (+1377149us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b540019ad54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:07.201641 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.201755 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53990,"prepare.queue_time_us":814,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":56380,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9264,"spinlock_wait_cycles":146144640,"thread_start_us":336938,"threads_started":1,"wal-append.queue_time_us":456602,"wal-append.run_cpu_time_us":1991,"wal-append.run_wall_time_us":1154610}
I20260709 13:07:07.205441 22609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 585) took 1400 ms. Trace:
I20260709 13:07:07.188851 25046 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:07.206032 25194 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:07.206704 25046 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.206950 25194 consensus_queue.cc:1059] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:07.207278 21916 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:07.207821 25194 raft_consensus.cc:3055] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.207893 25046 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.208261 25194 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:07.205812 22609 rpcz_store.cc:276] 0709 13:07:05.804691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.830085 (+ 25394us) service_pool.cc:224] Handling call
0709 13:07:07.205217 (+1375132us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b54006c2854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:07.205379 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147866368}
I20260709 13:07:07.201035 22015 rpcz_store.cc:276] 0709 13:07:05.615560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.881257 (+265697us) service_pool.cc:224] Handling call
0709 13:07:05.881579 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.065919 (+184340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.065947 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.065986 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:06.066014 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.184889 (+1118875us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54001f13d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:07.184928 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.185056 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423550336}
W20260709 13:07:07.184163 25157 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 1.251s	user 0.007s	sys 0.025s
W20260709 13:07:07.208739 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.155283 24960 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.209199 22607 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:07.178547 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.207098 25176 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:07.218768 25176 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:07.219841 25176 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.221709 25176 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.225189 25199 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:07.134625 25180 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.064795 25144 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 13:07:07.227515 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.209578 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 94268.1us
I20260709 13:07:07.235157 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:07.209209 25086 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:07.241192 25194 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.234625 25180 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.206928 25054 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.270018 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:07.217640 24679 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.272802 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:07.275130 22604 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 6: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:07.280494 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 540) took 2000 ms. Trace:
I20260709 13:07:07.262959 25194 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:07.285921 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 1.17155e+06us
I20260709 13:07:07.170533 25164 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:07.284570 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.269455 24828 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:07.281080 22610 rpcz_store.cc:276] 0709 13:07:05.279620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.287329 (+  7709us) service_pool.cc:224] Handling call
0709 13:07:05.311950 (+ 24621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.312457 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.312499 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.388573 (+ 76074us) log.cc:844] Serialized 548 byte log entry
0709 13:07:05.678800 (+290227us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:05.678848 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.678950 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.183401 (+1504451us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:07.269217 (+ 85816us) raft_consensus.cc:1685] finished
0709 13:07:07.269237 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.280390 (+ 11153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44356352,"thread_start_us":289722,"threads_started":1,"wal-append.queue_time_us":479917}
I20260709 13:07:07.288213 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:07.268925 25126 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.289454 25082 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:07.292955 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:07.300163 21869 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:07.293891 21871 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.296444 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:07.309792 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 101381us
I20260709 13:07:07.320125 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:07.323761 22574 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:07.324901 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 110097us
I20260709 13:07:07.325413 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:07.326472 25153 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.326860 25153 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:07.326928 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:07.327266 25153 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.333071 24890 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.333312 21988 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:07.333534 24890 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.333956 24890 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.334252 25121 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:07.334717 25121 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.335098 25121 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.335707 21988 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:07.336494 25052 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.336890 25052 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.337256 25052 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.341630 24890 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.342939 25121 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.343914 24890 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:07.335075 25153 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.345860 25052 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.347834 25153 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:07.311630 25179 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:07.299178 25126 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.349629 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:07.310544 25114 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.323508 25146 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.353055 25054 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:07.302791 25082 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:07.356045 25175 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:07.283162 25086 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.356472 21873 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:07.363530 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:07.364655 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44420.1us
I20260709 13:07:07.364846 24706 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:07.309125 25204 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:07.370545 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.347894 25052 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:07.360720 25121 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:07.322290 25119 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:07:07.355230 25206 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:07:07.416455 21866 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:07.453320 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 448) took 2767 ms. Trace:
I20260709 13:07:07.476143 21868 rpcz_store.cc:276] 0709 13:07:04.686297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.929821 (+1243524us) service_pool.cc:224] Handling call
0709 13:07:05.930199 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.109791 (+179592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.453033 (+1343242us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540044fa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:07.453250 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316451712}
W20260709 13:07:07.397368 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47797.9us
I20260709 13:07:07.476719 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:07.498028 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 586) took 1540 ms. Trace:
I20260709 13:07:07.498512 22601 rpcz_store.cc:276] 0709 13:07:05.957756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.958389 (+   633us) service_pool.cc:224] Handling call
0709 13:07:05.958748 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.732555 (+773807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.497772 (+765217us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400134a54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:07.497966 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777862912}
I20260709 13:07:07.369697 25179 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.479974 25204 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.399914 25153 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:07.368834 25200 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:07.526108 21872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 454) took 2138 ms (client timeout 1870 ms). Trace:
I20260709 13:07:07.479864 24679 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:07.527865 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:07.502288 25086 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.549998 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:07.527072 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 292026us
I20260709 13:07:07.526844 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:07.407402 25054 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:07.535580 22609 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:07:07.532475 21872 rpcz_store.cc:269] 0709 13:07:05.358927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.440949 (+ 82022us) service_pool.cc:224] Handling call
0709 13:07:07.497487 (+2056538us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b5400025154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:07.497605 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93366144}
I20260709 13:07:07.550171 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.550763 22016 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:07.554023 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:07.501408 24890 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:07:07.541795 25119 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.563498 22022 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:07.563380 25119 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.564180 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.564970 22017 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:07.565182 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:07.565500 25202 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:07:07.565740 25119 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:07.565961 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.566295 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.566707 22017 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:07.567001 25177 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.567559 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.567610 25177 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.568899 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.569653 22018 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:07.397229 25140 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.555073 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:07.486472 24706 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.555213 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:07.497411 25146 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:07.527647 25192 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:07.531325 25179 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.571800 22024 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:07:07.664674 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.608475 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2476) took 1945 ms. Trace:
I20260709 13:07:07.666590 22021 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:07.667167 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 113210us
I20260709 13:07:07.679265 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:07.564690 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.680567 22022 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:07.608933 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:07.670310 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.695645 22021 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:07.701810 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:07.704728 22021 raft_consensus.cc:2368] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:07:07.706702 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.713841 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:07.572466 22019 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
W20260709 13:07:07.739288 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.600694 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:07.598170 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.535495 25204 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.552894 25046 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.572089 22023 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:07.597121 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.676839 22020 rpcz_store.cc:276] 0709 13:07:05.663446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.038240 (+374794us) service_pool.cc:224] Handling call
0709 13:07:06.527897 (+489657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.791006 (+263109us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:06.907603 (+116597us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.184127 (+276524us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.184190 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:07.184236 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.608125 (+423889us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001798d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:07.608191 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.608389 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253346,"prepare.queue_time_us":145753,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":253920,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":604605824,"thread_start_us":106317,"threads_started":2,"wal-append.queue_time_us":60282}
I20260709 13:07:07.606142 25045 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:07.839578 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.840195 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.793175 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.601147 25181 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.598150 25213 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:07.774451 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.747887 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.555876 25082 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.606941 25121 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.784528 24960 consensus_meta.cc:287] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
W20260709 13:07:07.826524 25215 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 13:07:07.838150 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 158969us
I20260709 13:07:07.880223 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:07.881079 21867 raft_consensus.cc:2376] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6. Re-sending same reply.
I20260709 13:07:07.881276 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:07.883071 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:07.665752 24991 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:07.806524 25176 consensus_meta.cc:287] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.001s
I20260709 13:07:07.875810 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:07.783273 25201 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.470s	user 0.007s	sys 0.002s
I20260709 13:07:07.819548 25193 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.890973 21987 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:07.896822 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:07.897717 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:07.878723 22021 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:07.878511 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:07.580971 25206 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:07.847559 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 363528us
I20260709 13:07:07.884553 22016 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:07:07.900995 22024 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:07.900993 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:07.808007 24667 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:07.872908 25162 consensus_meta.cc:287] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.845s	user 0.015s	sys 0.000s
I20260709 13:07:07.573218 25054 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.807014 25114 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:07.887725 25217 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:07.781562 25126 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:07.885928 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.848379 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:07.827052 25140 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:07.844707 25181 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:07.964977 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 670) took 1187 ms. Trace:
I20260709 13:07:07.892361 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.965426 22607 rpcz_store.cc:276] 0709 13:07:06.777740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.779830 (+  2090us) service_pool.cc:224] Handling call
0709 13:07:07.209005 (+429175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.217393 (+  8388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.964782 (+747389us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54006c2850. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:07.964913 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963555072}
I20260709 13:07:07.966243 22020 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:07.871903 25213 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:07.944129 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.744197 25192 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:07:07.887940 25082 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.944154 24667 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:07.602996 25177 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:07.875499 24679 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:07:07.885247 25153 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:07.904340 25206 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.879863 25121 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.960369 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:07.961218 25048 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:07.889902 24991 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:07.896170 25176 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:07.921545 25146 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:07.970222 22021 raft_consensus.cc:2368] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:07:08.019523 22021 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:07.873172 25045 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:07.946161 25119 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:07.861545 25046 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.005796 22023 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:07:07.960155 24706 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:07.962698 25214 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:08.010311 22020 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.961522 25186 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.965113 25181 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.004546 25164 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.014247 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 53546us
I20260709 13:07:08.012001 24828 raft_consensus.cc:2764] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:07:08.036540 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 135508us
W20260709 13:07:08.055680 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.018530 25206 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.099015 21950 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:08.080068 22015 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:08.016230 25217 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:08.095659 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.025712 25048 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:08.101613 21943 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:08.031440 25191 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.100466 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.118708 21950 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.103363 22024 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:08.103665 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 220680us
I20260709 13:07:08.104194 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.117877 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.121791 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:08.122812 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.122879 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:08.018026 25177 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:07:08.123585 21946 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.082927 24706 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.125200 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.019392 25176 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.118502 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.038993 25214 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:08.128193 21943 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:08.125914 21948 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:08.129705 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:08.089564 25119 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:08.135861 21949 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.139019 25119 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.142596 21950 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:08.143383 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.146600 21946 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
W20260709 13:07:08.131105 25200 consensus_meta.cc:287] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.578s	user 0.003s	sys 0.007s
I20260709 13:07:08.151476 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2352) took 1220 ms. Trace:
I20260709 13:07:08.098762 25186 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.136337 25214 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.183310 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 364) took 2667 ms. Trace:
I20260709 13:07:08.188722 21945 rpcz_store.cc:276] 0709 13:07:05.482908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.483055 (+   147us) service_pool.cc:224] Handling call
0709 13:07:06.758785 (+1275730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.762696 (+  3911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.150371 (+1387675us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001405d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:08.150546 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933308800}
I20260709 13:07:08.136552 25181 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.200353 21945 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:08.196729 25216 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 13:07:08.102355 25164 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.233425 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.234202 25164 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.234561 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.235337 21950 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:08.235889 25086 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.000s
I20260709 13:07:08.241016 24810 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.241608 24810 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:08.242700 24810 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.244105 24810 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:08.245162 25223 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:07:08.247634 25045 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:08.136768 24706 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.112067 25217 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:08.329602 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 199961us
I20260709 13:07:08.330600 21914 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:08.331331 24706 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.331533 25217 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:08.332198 21942 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:08.332453 25197 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:08.333166 25197 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.334141 25146 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:08.334673 25146 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:08.335935 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 69845.9us
I20260709 13:07:08.336666 22016 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:08.337029 25227 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:08.337175 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:08.338151 22015 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:08.338555 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.339094 25238 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:08.339607 25238 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:08.339731 25221 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.340523 25238 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:08.344197 25194 consensus_meta.cc:287] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.046s	user 0.008s	sys 0.006s
I20260709 13:07:08.369465 21772 catalog_manager.cc:5697] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 1 to 5, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 5 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.371259 21772 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 3 to 4, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 4 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.152777 21866 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:07:08.372763 21866 pending_rounds.cc:85] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 8
I20260709 13:07:08.373032 21866 pending_rounds.cc:107] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:07:08.373252 21866 raft_consensus.cc:2889] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.374899 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:08.376140 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:08.165892 25200 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.428933 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:08.184479 21875 rpcz_store.cc:276] 0709 13:07:06.931379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.033974 (+102595us) service_pool.cc:224] Handling call
0709 13:07:08.151212 (+1117238us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003ad254. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:08.151400 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269928192}
I20260709 13:07:08.378214 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:08.378763 21875 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:08.202386 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.332255 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1716) took 3657 ms. Trace:
I20260709 13:07:08.238364 25186 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.129307 25191 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.202625 25054 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:08.234238 21946 raft_consensus.cc:2368] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8.
I20260709 13:07:08.380061 21870 rpcz_store.cc:276] 0709 13:07:04.674559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.905298 (+1230739us) service_pool.cc:224] Handling call
0709 13:07:05.931817 (+ 26519us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:05.954497 (+ 22680us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:05.954786 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.182384 (+227598us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.229056 (+ 46672us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:06.276188 (+ 47132us) log.cc:844] Serialized 52 byte log entry
0709 13:07:06.276384 (+   196us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.276433 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.985748 (+709315us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b18004aa100. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f85522 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:07.196041 (+210293us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b18004aa100. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:07.946726 (+750685us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b18004aa100. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f532a6 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419
0709 13:07:08.263149 (+316423us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b540044e154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:08.263228 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.331968 (+ 68740us) raft_consensus.cc:1685] finished
0709 13:07:08.331992 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.332161 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12431,"prepare.queue_time_us":1008,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":67211,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":129096,"spinlock_wait_cycles":210232576,"thread_start_us":205517,"threads_started":1,"wal-append.queue_time_us":707373,"wal-append.run_cpu_time_us":3610,"wal-append.run_wall_time_us":1337374}
I20260709 13:07:08.135784 24667 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.324870 25225 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.404878 25197 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.409039 25225 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.411501 25225 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:08.328673 25204 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:07:08.412155 25204 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.413094 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:08.414363 25204 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:08.414642 24930 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:08.415407 22024 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:08.415261 24930 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:08.416134 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.416296 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:08.417151 25186 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:08.417358 24930 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.417546 25186 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:08.417989 25186 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.418191 24930 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:08.418495 25029 consensus_queue.cc:1059] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:08.418741 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.200120 25162 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:08.419288 24930 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:08.419539 25029 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:08.419718 24930 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:08.420135 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.420962 21949 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:08.422212 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:08.271885 25048 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.151865 25153 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:08.344895 25180 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.082s	user 0.009s	sys 0.004s
I20260709 13:07:08.344882 25121 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:08.345911 25192 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:08.346735 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.347358 25176 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.348026 25177 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:08.349792 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:08.350328 25179 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 13:07:08.350976 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:08.350924 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:08.352458 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:08.206249 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 315188us
I20260709 13:07:08.419508 25162 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:08.329636 25046 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:08.354189 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.355216 25209 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:08.357339 25146 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:08.358528 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:08.462582 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:08.464210 22019 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:08.363698 22018 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:08.364547 24991 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:08.367561 25222 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 13:07:08.378242 21871 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:07:08.390672 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:08.397768 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 67220us
I20260709 13:07:08.473408 21866 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.473878 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:08.329005 25193 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:08.423494 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:08.424049 25227 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 13:07:08.432717 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.440258 21875 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:08.438412 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:08.449240 21872 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:08.449723 21874 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:08.444720 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:08.442066 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.352979 25221 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.477349 25230 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.484915 25193 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:08.485559 25230 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:08.486554 25230 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.486371 25193 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.459829 25179 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.489017 22022 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:08.489902 25179 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:08.441041 25180 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.405184 24706 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:08.458364 22574 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:08.458979 21869 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.493027 24706 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.493476 25180 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.495507 24706 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.479035 22020 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:08.464326 22023 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:08.420199 25029 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:08.476894 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.480667 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:08.498046 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 59758.4us
I20260709 13:07:08.504632 21869 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:08.499264 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:08.503364 21866 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:08.505505 21914 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:08.408247 25214 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.508304 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.511320 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:08.514262 25029 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.515540 25029 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.469368 24679 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.518111 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 59835us
I20260709 13:07:08.522786 25214 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.483950 24951 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.460728 25177 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.524789 25206 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.524202 25162 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.524763 25186 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.528383 25180 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:08.530280 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:08.530459 24828 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.530403 25082 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:08.484695 25209 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:07:08.536302 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.534230 21949 raft_consensus.cc:2368] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
W20260709 13:07:08.544479 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.535230 21945 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:08.540030 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:08.537369 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.536705 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.561713 22604 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:08.535831 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.517096 25132 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:08.563676 21947 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:08.529273 25199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.303s	user 0.035s	sys 0.016s
I20260709 13:07:08.518046 25217 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:08.572088 22576 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.664s (SENT) [suppressed 34 similar messages]
I20260709 13:07:08.573329 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:08.438400 24930 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.575172 25162 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.575842 25180 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:08.572574 25132 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:08.569511 25199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.344s	user 0.041s	sys 0.016s
I20260709 13:07:08.526021 25197 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:08.533695 25225 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:08.578159 25186 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.534158 24679 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.580948 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:08.693491 22020 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.585188 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:08.586660 25177 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:08.587662 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1326) took 1016 ms. Trace:
I20260709 13:07:08.696748 22018 rpcz_store.cc:276] 0709 13:07:07.570853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.571776 (+   923us) service_pool.cc:224] Handling call
0709 13:07:08.587470 (+1015694us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540017b1d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:08.587597 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652085632}
I20260709 13:07:08.589430 25228 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:08.534897 24706 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:08.553679 24841 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.617578 21841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.009s	sys 0.029s
I20260709 13:07:08.620492 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.638129 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.640354 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:08.695983 21869 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:08.616438 25200 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.639541 25221 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:08.685308 25132 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.688648 25086 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:08.711475 25200 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:08.713498 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.714345 25234 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.715082 25235 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:08.716712 25206 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:08.717314 25175 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.721158 25189 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:08.688396 25126 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.685536 25199 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:08.722147 25180 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.697253 24930 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.706380 21950 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:08.685854 25197 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:08.734288 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.735661 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 470) took 1449 ms. Trace:
I20260709 13:07:08.736385 22608 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:08.696429 25225 raft_consensus.cc:697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:08.698726 25228 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:08.749182 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.775627 25175 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.803406 25228 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.728223 21947 raft_consensus.cc:2410] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:08.805578 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.806512 22609 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:08.807080 22610 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:08.807926 25175 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:08.808216 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:08.808815 21869 raft_consensus.cc:2376] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9. Re-sending same reply.
I20260709 13:07:08.750267 21987 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:08.809541 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 59391.8us
W20260709 13:07:08.809749 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.810220 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:08.765655 25234 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.790478 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:08.791865 21871 rpcz_store.cc:276] 0709 13:07:07.286657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.322991 (+ 36334us) service_pool.cc:224] Handling call
0709 13:07:08.712669 (+1389678us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54003adc54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:08.735550 (+ 22881us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053903616}
I20260709 13:07:08.812511 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.813131 22573 leader_election.cc:400] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
I20260709 13:07:08.813505 22573 leader_election.cc:403] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:08.813380 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:08.813879 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:08.792184 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.813170 21949 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:08.815054 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.815461 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.816340 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:08.809777 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:08.817596 21869 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.793903 22020 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:08.794268 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:08.789876 25176 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:08.821852 25176 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.824805 21868 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:08.775590 25179 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:08.801293 25199 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.808465 25126 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.809640 24991 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.757582 21874 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:08.746572 25119 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:07:08.780136 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 208063us
I20260709 13:07:08.729208 24841 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.795121 25197 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.829866 24706 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.765488 25235 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.830351 25175 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:08.830024 25146 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:08.844727 25082 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.749100 25086 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.848026 24991 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.911307 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:08.849960 25241 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
W20260709 13:07:08.919770 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 108499us
I20260709 13:07:08.920017 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:08.947922 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:08.952625 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.957273 21871 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
W20260709 13:07:08.962044 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.965315 22017 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:08.969974 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1342) took 1370 ms. Trace:
I20260709 13:07:08.971385 22017 rpcz_store.cc:276] 0709 13:07:07.599932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.745786 (+1145854us) service_pool.cc:224] Handling call
0709 13:07:08.969873 (+224087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.968566 21869 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:08.975045 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:08.981316 25243 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:07:08.981923 25227 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.982551 25227 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.983219 25234 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:08.948333 25082 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:08.984802 21942 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.986195 21942 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.986474 25082 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:08.905813 25175 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.000833 25225 consensus_queue.cc:237] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.004802 25235 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.006255 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.012210 21869 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:09.007161 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:08.870724 25176 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.006614 21874 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:07:09.017153 25179 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.017764 25119 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.946287 24991 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.949632 25185 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:09.023012 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.022647 22017 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:09.035324 21874 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.947453 25146 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:08.838054 25213 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:08.945634 25230 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:07:09.072744 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.037055 21869 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:09.065469 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 205512us
I20260709 13:07:09.074641 25179 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:09.117311 25146 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.007530 25175 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:09.141693 21841 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.689s (SENT)
W20260709 13:07:09.137612 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.142668 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.019392 25082 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.116185 21874 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:09.136899 25185 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:09.143651 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:09.095039 25194 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.140444 25179 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:09.168779 25224 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:09.170076 24951 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.004s
I20260709 13:07:09.137790 25126 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:09.187830 22020 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:09.122782 25192 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:09.123023 25164 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:07:09.204905 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 373618us
W20260709 13:07:09.206244 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.206569 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.126493 25119 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.177899 25189 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.217381 22017 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:09.185237 25227 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.189594 24679 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.154655 25082 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.211185 25224 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.178712 25194 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.214716 25200 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.226395 25230 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.168835 25179 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:09.259646 22022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1341) took 1660 ms (client timeout 1646 ms). Trace:
W20260709 13:07:09.260099 22022 rpcz_store.cc:269] 0709 13:07:07.599605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.737715 (+138110us) service_pool.cc:224] Handling call
0709 13:07:09.259411 (+1521696us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400333454. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:09.259574 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417382656}
I20260709 13:07:09.261775 22016 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.263329 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:09.254801 25242 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 13:07:09.276494 22017 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.223104 25189 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:09.282274 25250 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:07:09.284957 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.294217 25194 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:09.295241 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.285280 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.262148 24841 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:09.288084 25247 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:09.285714 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.286362 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:09.289027 25254 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:07:09.286607 22017 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:09.242173 25185 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.246225 25224 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.293056 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.304474 22024 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 4.
I20260709 13:07:09.296576 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.295994 25197 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.305904 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:09.310608 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:09.295264 25259 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:09.326309 22022 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.296814 24667 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.303663 25179 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.266644 25230 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.307245 25126 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:09.347078 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 333464us
I20260709 13:07:09.341625 21948 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:09.349145 21987 leader_election.cc:400] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8.
I20260709 13:07:09.349565 21987 leader_election.cc:403] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:07:09.255862 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 206738us
I20260709 13:07:09.361351 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:09.362129 21950 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:09.330511 25146 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:09.366382 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.374647 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:09.375360 21950 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:09.354010 25086 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:09.373107 25162 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.001s
I20260709 13:07:09.382740 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:09.399930 25230 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.400691 25082 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:09.401988 25132 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.002s
I20260709 13:07:09.402503 25132 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.371480 25267 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:09.406816 25224 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:09.406476 24991 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.409368 22018 raft_consensus.cc:2393] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:09.408102 25197 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.398391 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:09.411784 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:09.421692 22023 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:09.423848 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.447654 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.448572 22024 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:09.449995 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.433187 25268 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:09.433951 25048 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.433434 25086 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.430356 25146 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:09.450899 25119 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:09.468065 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 152078us
I20260709 13:07:09.470381 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:09.471037 21944 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:09.468050 25086 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.473577 25086 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:09.474237 25274 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:07:09.475941 25266 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:07:09.478544 25264 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:09.481099 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:09.481822 22607 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
W20260709 13:07:09.481130 25276 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:09.459591 25268 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.484903 25268 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:09.493659 24991 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:09.495663 25146 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.497014 21944 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:09.496208 25086 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.499840 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:09.506778 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:09.453853 25126 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:09.428562 25265 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:07:09.523298 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:09.529124 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:09.529873 22605 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:09.531607 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:09.532455 22605 raft_consensus.cc:2410] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:07:09.533239 21914 connection.cc:256] RPC call timeout handler was delayed by -1.4813306089999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:07:09.533833 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.535055 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:09.524104 22610 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:09.536852 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:09.538590 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 178688us
I20260709 13:07:09.461628 25267 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:09.542212 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:09.541316 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:09.608515 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 66404.6us
I20260709 13:07:09.611738 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:09.612516 22609 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:09.613214 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:09.570428 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.555229 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:09.624933 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:09.557303 25282 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:09.517216 25227 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:09.618876 21988 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:09.556990 25273 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:07:09.634025 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.634671 21873 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5.
I20260709 13:07:09.635040 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:09.612393 24706 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.002s
I20260709 13:07:09.641124 24991 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:09.641619 24991 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:09.641682 21942 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:07:09.642134 24991 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.645371 25175 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.646266 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.541342 25132 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.612344 25267 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:09.648039 25267 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.648499 25227 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:09.648947 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:09.649283 25267 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.649899 25227 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.651363 24841 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.651902 24841 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:09.653028 25285 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:07:09.653658 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.654326 24841 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:09.655274 25176 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.655902 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:09.656190 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.657325 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.657998 25029 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:09.617765 25283 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.658443 25029 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:09.655776 25176 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.594585 25178 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.659365 25114 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.598881 25191 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.689951 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:09.690726 21869 raft_consensus.cc:2376] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5. Re-sending same reply.
W20260709 13:07:09.661849 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.664038 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.611817 25146 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:09.659399 25029 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.695923 25029 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:09.696766 25162 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.696970 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:09.697384 25162 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.698292 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:09.699455 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:09.699545 25162 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:09.556190 25272 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:07:09.702430 21866 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:09.703691 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.633216 25086 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.669229 21950 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:09.637758 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 101035us
I20260709 13:07:09.665323 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:09.540958 24960 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:09.638685 21988 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:09.724509 25048 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8.
I20260709 13:07:09.623713 25286 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.725209 25279 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:09.725881 25279 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:09.633719 25126 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.727017 25279 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:09.729187 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 90595.7us
I20260709 13:07:09.706314 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.710757 21942 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:09.706338 21874 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:07:09.719762 25175 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:09.732286 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:09.733546 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.707967 25176 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:09.722235 25268 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.661969 25119 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:09.735810 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.737864 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:09.743096 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:09.733566 21869 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:09.744431 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.739400 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.680590 24706 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
W20260709 13:07:09.744975 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 79766.7us
I20260709 13:07:09.746119 21869 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:09.746685 21841 leader_election.cc:400] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:07:09.748625 21841 leader_election.cc:403] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:09.753334 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.755162 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.751816 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:09.755921 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.759985 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:09.760937 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.761461 22023 raft_consensus.cc:2368] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
I20260709 13:07:09.705641 25194 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:09.762030 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.771130 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.762624 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:09.779521 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.780478 22021 raft_consensus.cc:2368] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
I20260709 13:07:09.780781 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.781594 22015 raft_consensus.cc:2410] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:09.781965 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:09.771818 22019 raft_consensus.cc:2376] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8. Re-sending same reply.
I20260709 13:07:09.784853 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.785251 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.785557 22020 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:09.786492 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:09.786756 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.787609 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.788677 22017 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:09.748557 25235 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:09.786543 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.790343 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.789103 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.797204 22024 raft_consensus.cc:2368] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
I20260709 13:07:09.791441 22023 raft_consensus.cc:2410] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:09.761157 25119 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:09.798244 25146 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.798870 25146 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.800173 22019 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:07:09.800565 22019 pending_rounds.cc:85] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 6
I20260709 13:07:09.800800 22019 pending_rounds.cc:107] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:09.801020 22019 raft_consensus.cc:2889] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.802238 22015 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:09.758996 25281 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:07:09.805482 25281 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:09.805857 25281 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:09.780135 25267 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.759205 25176 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:07:09.763468 25029 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.781239 24841 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:09.791040 25174 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:07:09.808283 25177 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:09.809111 25162 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:09.810948 25174 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.770010 25234 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:09.812892 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:09.822602 22609 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:09.798960 25119 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.822908 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.825923 22015 raft_consensus.cc:2376] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9. Re-sending same reply.
I20260709 13:07:09.828838 25260 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.832149 21866 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:09.820272 22604 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:09.763304 25114 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:07:09.834954 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.839210 25179 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.839807 25281 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.839927 25179 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.841226 25281 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.843631 25179 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:09.844843 22015 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:09.811379 25174 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:09.786254 25194 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.822397 25234 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:09.860908 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.872968 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:09.834854 25004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.010s	sys 0.021s
W20260709 13:07:09.876044 22608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 551) took 1318 ms (client timeout 1542 ms). Trace:
I20260709 13:07:09.876166 22607 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.838059 25146 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:09.911243 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:09.876513 22608 rpcz_store.cc:269] 0709 13:07:08.557440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.557597 (+   157us) service_pool.cc:224] Handling call
0709 13:07:09.875868 (+1318271us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b540057dfd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:09.875989 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95904000}
I20260709 13:07:09.911993 21943 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 4.
I20260709 13:07:09.887729 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:09.876112 25004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.011s	sys 0.021s
I20260709 13:07:09.918196 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.919154 22023 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:09.875088 25234 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.937821 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.938891 22023 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 5: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:09.829473 25260 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:09.948360 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:09.950174 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.951670 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 161765us
W20260709 13:07:09.953992 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.956295 25153 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.956845 25153 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.959059 25153 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:09.960196 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:09.962481 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:09.963187 22018 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:09.967170 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:09.969681 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:09.971973 25294 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:09.972546 25194 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:09.973192 24841 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:09.974838 24991 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.977023 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:09.978762 24991 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:09.948899 25174 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:09.980341 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:09.980926 21872 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:09.950856 25178 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.981565 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:09.981573 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:09.983945 25174 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.987533 25194 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.988075 25194 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:09.988526 25194 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.990085 25260 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:09.998677 25278 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.525s	user 0.003s	sys 0.000s
I20260709 13:07:10.007874 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:10.008805 22023 raft_consensus.cc:2376] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7. Re-sending same reply.
I20260709 13:07:10.030776 25189 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:10.043110 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:10.048167 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:09.970961 25224 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.048934 21870 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:10.055085 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:10.055897 21870 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:10.056792 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:10.057374 21870 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:10.058204 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:10.058921 21870 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:09.967011 25192 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:07:10.064968 21870 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:10.060839 25178 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.069855 25178 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.073807 25178 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.076244 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:10.101891 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 345157us
I20260709 13:07:10.104552 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:10.110106 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.078912 25303 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:07:10.148995 24960 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.149662 24960 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.150707 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:10.129601 25301 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:10.151479 22602 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
W20260709 13:07:10.130574 25298 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:10.128103 21867 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:10.133037 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:10.134081 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:10.148952 25194 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:10.142688 21871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2375) took 1383 ms (client timeout 1787 ms). Trace:
W20260709 13:07:10.154759 21871 rpcz_store.cc:269] 0709 13:07:08.759210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.813118 (+ 53908us) service_pool.cc:224] Handling call
0709 13:07:10.142478 (+1329360us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54000dbe54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:10.142623 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328723712}
I20260709 13:07:10.155114 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:10.155731 22602 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:10.084085 25179 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:07:10.078696 25178 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:07:10.146842 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.158422 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:10.159099 22602 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:10.148238 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:10.149137 25303 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:10.160185 25303 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:10.161149 25303 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.078925 24991 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:07:10.150063 25246 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.902s	user 0.000s	sys 0.002s
I20260709 13:07:10.154340 22015 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:10.142571 25164 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.165103 25164 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.157691 25178 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.147948 22605 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:10.166427 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:10.167124 22608 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:10.126183 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:10.168964 25189 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.169101 25178 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.169458 25189 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.169869 25189 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.171083 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:10.078660 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:10.172725 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:10.173199 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47093.5us
I20260709 13:07:10.173456 22017 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 3.
I20260709 13:07:10.175310 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:10.176038 22015 raft_consensus.cc:2368] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10.
I20260709 13:07:10.173808 21839 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:10.177927 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:10.178675 22023 raft_consensus.cc:2376] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8. Re-sending same reply.
W20260709 13:07:10.179085 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 100530us
I20260709 13:07:10.177313 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:10.182458 21839 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:10.186491 21839 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:10.187192 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:10.190807 22574 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:10.193418 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:10.194552 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:10.195115 22017 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:07:10.198939 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:10.200940 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:10.224773 25176 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:10.225454 25176 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.225909 25176 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.202874 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:10.226995 21866 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 3.
I20260709 13:07:10.226890 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:10.227633 21871 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.228797 24841 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:10.229034 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.230569 25192 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:10.231971 24841 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:10.224917 25221 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:10.211122 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:10.249409 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 61076.7us
I20260709 13:07:10.203392 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:10.233439 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:10.236713 21871 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:10.254509 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:10.252219 22608 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
W20260709 13:07:10.257372 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.252265 22015 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:10.253140 21871 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:10.204998 21875 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:10.182093 25297 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.204367 22605 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:10.209414 21841 leader_election.cc:400] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 2 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 2. Current term is 3.
W20260709 13:07:10.267289 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 58069.2us
I20260709 13:07:10.268818 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.270198 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.190207 25114 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:10.188910 25177 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:10.259455 24930 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.232422 24841 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:10.185750 25281 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.178328 25178 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:10.257045 25291 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.306802 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.308378 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:10.264957 25164 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:10.271720 24706 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.271929 25297 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.275063 25114 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.276495 25260 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.319672 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:10.311676 24960 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.323917 25194 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.325110 21867 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:10.256685 25234 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:10.312193 25300 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:07:10.294973 25177 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.331135 22605 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:07:10.332350 21867 pending_rounds.cc:85] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 3
I20260709 13:07:10.341544 21867 pending_rounds.cc:107] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:10.341868 21867 raft_consensus.cc:2889] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.308527 25192 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:10.317077 25164 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:10.329851 25297 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.313542 25281 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.331913 25114 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:10.347512 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 156784us
I20260709 13:07:10.356438 21866 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.356164 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.361574 22574 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:10.345167 25177 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.320380 25178 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.347666 25164 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:10.356859 25281 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.391232 21866 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:10.393010 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 86311.7us
W20260709 13:07:10.395360 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 134787us
I20260709 13:07:10.330242 24841 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.327150 25291 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.417505 25291 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.422508 25189 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.425540 25178 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.430516 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.397398 25164 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.448414 25320 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:10.438158 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:10.462114 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.414367 25304 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:10.400238 25310 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:10.465618 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.467010 25174 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.470275 25213 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.450832 25192 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.473407 25234 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:10.474001 21946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 384) took 2059 ms (client timeout 1866 ms). Trace:
I20260709 13:07:10.476667 24841 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.476951 25114 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.482013 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2495) took 2059 ms. Trace:
I20260709 13:07:10.506299 22016 rpcz_store.cc:276] 0709 13:07:08.422130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.422866 (+   736us) service_pool.cc:224] Handling call
0709 13:07:09.261596 (+838730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.262217 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.481696 (+1219479us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b5400333450. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:10.481911 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1928222976}
W20260709 13:07:10.485438 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 129369us
I20260709 13:07:10.472082 25189 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.508836 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:10.486467 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.490365 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1355) took 1206 ms. Trace:
I20260709 13:07:10.509898 22022 rpcz_store.cc:276] 0709 13:07:09.284034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.285790 (+  1756us) service_pool.cc:224] Handling call
0709 13:07:09.306678 (+ 20888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.326931 (+ 20253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.490108 (+1163177us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b5400198f54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:10.490300 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44495104}
I20260709 13:07:10.510625 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:10.497764 25318 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:10.499033 21948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1937) took 1780 ms (client timeout 1515 ms). Trace:
I20260709 13:07:10.464809 25319 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:07:10.502790 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.502751 21946 rpcz_store.cc:269] 0709 13:07:08.414893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.418498 (+  3605us) service_pool.cc:224] Handling call
0709 13:07:10.473786 (+2055288us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400299354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:10.473922 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2366852480}
W20260709 13:07:10.481001 25308 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.122s	user 0.000s	sys 0.007s
W20260709 13:07:10.511503 21948 rpcz_store.cc:269] 0709 13:07:08.718673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.725762 (+  7089us) service_pool.cc:224] Handling call
0709 13:07:10.498813 (+1773051us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54002788d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:10.498935 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238466304}
I20260709 13:07:10.483696 25176 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.517905 25029 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.518464 25029 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.519424 25176 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:10.487253 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73759.6us
I20260709 13:07:10.520807 21944 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:10.521611 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:10.517093 24960 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.522753 25029 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:10.523844 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.523518 24960 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.524812 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.525543 21943 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:10.525959 24960 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.526613 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:10.527271 21945 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.528097 25293 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:10.531198 22573 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:10.532313 25309 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:10.532886 25309 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.533294 25309 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.520869 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:10.537001 24960 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.537596 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:10.539005 25029 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:10.539875 25029 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.540634 25029 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.542183 25309 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.543493 21945 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:10.467139 25304 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:10.546895 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:10.556532 21943 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.547703 25126 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.548264 25283 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.549460 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.538960 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:10.552448 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 66043.3us
I20260709 13:07:10.570044 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.492264 25177 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.538002 24960 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:10.560737 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:10.487603 25310 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:10.572631 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.587584 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:10.553658 25318 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:10.544790 25309 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:10.509542 25178 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.607162 25178 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.582716 21943 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:10.577672 25234 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.584237 25319 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:10.588475 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:10.574136 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:10.564030 25304 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.590785 25176 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.591256 25192 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:10.591764 25153 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.592845 25328 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:10.592227 25321 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:10.586895 24960 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.589174 25189 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:10.572352 25283 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:10.612390 21841 leader_election.cc:400] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10.
I20260709 13:07:10.621834 21841 leader_election.cc:403] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:10.613986 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:10.616110 22573 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:10.644583 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 54520us
I20260709 13:07:10.647109 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:10.648756 25126 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.649178 25126 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.649528 25126 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.651966 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:10.653388 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:10.609542 25178 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:10.665975 25322 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:10.666422 25310 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.611292 25297 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.622809 25320 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:07:10.672840 25297 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:10.673359 25114 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:10.620955 25283 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.674199 21875 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.619349 25234 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:10.679759 25234 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:10.680826 25260 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.680760 25234 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.678339 25321 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.618710 25192 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.617103 25291 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:10.677732 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.611464 25319 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.665693 25178 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:10.674105 25320 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:10.684924 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 68898.5us
I20260709 13:07:10.643512 25318 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.619920 25153 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:10.615720 25281 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.608568 25164 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.701483 25321 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.684814 25189 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:10.712421 25326 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:10.700930 25319 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:10.699132 25291 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:10.691205 25192 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.716650 21941 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:10.713584 25281 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:10.706221 25153 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.730098 25291 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.730721 25185 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.761766 25341 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:10.762454 25341 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:10.769205 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 155283us
I20260709 13:07:10.770924 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.772143 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.773447 21947 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:10.733898 25326 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:10.774204 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.775051 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.776690 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.777304 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.778384 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:10.778942 21945 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.774955 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 121641us
I20260709 13:07:10.779495 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.784029 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:10.784672 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:10.784955 22019 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.785337 22016 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.785581 22601 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:10.786669 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.787304 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:10.787822 21944 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:10.788030 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.788630 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.706048 25320 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.752167 25336 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.791688 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:10.798154 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.800951 21950 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:10.772001 25029 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.797305 25174 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.809338 24960 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.774629 25185 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.794854 25341 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:10.793325 25336 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:10.819830 25320 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.791656 25189 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.843459 25336 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:10.845841 25311 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.484s	user 0.000s	sys 0.001s
W20260709 13:07:10.850965 25337 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:10.852564 25164 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.853766 25325 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.814426 25304 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.854367 25325 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:10.812235 25318 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10.
I20260709 13:07:10.824451 25326 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.871469 25291 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:10.841113 25313 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.479s	user 0.004s	sys 0.000s
I20260709 13:07:10.855602 25325 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:10.836256 25268 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:10.856578 25304 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:10.892728 25325 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:10.882673 25305 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.719s	user 0.002s	sys 0.002s
I20260709 13:07:10.901018 25291 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:10.903329 25307 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.724s	user 0.002s	sys 0.000s
I20260709 13:07:10.961684 21945 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:10.973706 21949 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:10.876657 25126 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:10.838503 25029 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:11.019127 25221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.000s	sys 0.008s
W20260709 13:07:11.019927 25221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.000s	sys 0.008s
I20260709 13:07:11.020439 25221 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:11.021598 25177 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:11.022840 25174 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.023546 25289 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:11.023708 25174 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:11.026734 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.027289 25126 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:10.900390 25283 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.029150 25185 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:11.030205 21870 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:11.031759 25283 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:10.874298 25176 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.979272 22601 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:07:10.960263 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.036454 21871 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:11.003227 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:10.972244 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:11.041222 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69439.7us
I20260709 13:07:11.044710 25318 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:11.045320 25318 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.045835 25318 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.023638 25224 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:11.058465 24960 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:11.059278 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1756) took 1363 ms. Trace:
I20260709 13:07:11.056475 25224 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.065343 25289 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.031829 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:11.068854 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1757) took 1373 ms. Trace:
I20260709 13:07:11.066857 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1758) took 1370 ms. Trace:
I20260709 13:07:11.072515 21872 rpcz_store.cc:276] 0709 13:07:09.695903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.716704 (+ 20801us) service_pool.cc:224] Handling call
0709 13:07:09.980688 (+263984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.981298 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.066219 (+1084921us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540040f6d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:11.066584 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605950208}
I20260709 13:07:11.086449 25224 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:11.092461 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.072453 21874 rpcz_store.cc:276] 0709 13:07:09.695660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.696243 (+   583us) service_pool.cc:224] Handling call
0709 13:07:09.696563 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:09.732092 (+ 35529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.068100 (+1336008us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b540044f554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:11.068657 (+   557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21909760}
I20260709 13:07:11.097095 25289 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:11.094290 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:11.097955 22607 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:07:11.099371 25283 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:11.099910 25126 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:11.105036 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:11.112130 25214 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.113762 25218 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:11.115724 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.070935 21873 rpcz_store.cc:276] 0709 13:07:09.695380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.712853 (+ 17473us) service_pool.cc:224] Handling call
0709 13:07:10.143299 (+430446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:10.143511 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.143550 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.143604 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:10.143641 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.143691 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.058876 (+915185us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54000dbe50. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:11.059062 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988939648}
I20260709 13:07:11.120059 25218 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:11.120591 25218 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:11.122574 25218 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.125080 25086 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:11.126425 25086 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.159165 22020 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:11.160705 25218 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.022431 25221 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.181015 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:11.178009 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 131510us
I20260709 13:07:11.188685 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:11.191421 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.193836 22020 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.226439 21870 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:11.239125 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60557.8us
I20260709 13:07:11.193931 22024 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:11.578056 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.488178 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.718679 25348 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.775713 25348 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:11.778530 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 592851us
W20260709 13:07:11.779476 25153 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.023s	user 0.004s	sys 0.014s
I20260709 13:07:11.779763 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:11.219512 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:11.781328 25325 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.882s	user 0.009s	sys 0.010s
I20260709 13:07:11.781502 22015 raft_consensus.cc:2410] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:11.781854 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.781998 25325 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.782814 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.783174 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.784181 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:11.787679 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:11.240697 25319 consensus_meta.cc:287] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.008s
I20260709 13:07:11.788914 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.789645 22015 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:11.789153 25319 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.790575 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.791818 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.780063 25153 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.191857 22016 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:11.793018 21945 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 10. Ops: []
I20260709 13:07:11.793231 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1393) took 1009 ms. Trace:
I20260709 13:07:11.793686 22016 rpcz_store.cc:276] 0709 13:07:10.784270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.784397 (+   127us) service_pool.cc:224] Handling call
0709 13:07:11.793156 (+1008759us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:11.356427 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:11.794384 25153 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:11.784895 25348 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:11.795164 22016 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.795343 25348 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:11.796074 25348 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.796588 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:11.797305 22607 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.798528 25348 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:11.798698 25234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.030s
W20260709 13:07:11.799134 25234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.000s	sys 0.030s
I20260709 13:07:11.799857 25234 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:11.800649 25234 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.785290 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:11.803663 25234 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:11.785873 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:11.804291 22024 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:11.220163 25192 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.806627 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:11.778712 25244 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.782845 25325 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:11.808025 25244 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.809124 25325 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:11.809548 25325 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.810000 25325 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:11.804064 25334 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:11.810971 25334 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.811694 25283 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:11.812148 25283 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.812541 25283 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.807900 25192 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:11.784371 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.798554 22023 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:07:11.701828 25318 consensus_meta.cc:287] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.007s
W20260709 13:07:11.764875 25218 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.567s	user 0.003s	sys 0.006s
W20260709 13:07:11.386650 21838 leader_election.cc:336] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.675s (SENT)
I20260709 13:07:11.808403 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:11.253471 24991 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.826171 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:11.485337 25265 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.833243 25086 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:11.792425 25319 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:11.825819 25153 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:11.837158 24706 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.840653 25192 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:11.841406 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1303) took 1035 ms. Trace:
I20260709 13:07:11.826138 25318 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.845196 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:11.829802 22019 consensus_meta.cc:287] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.041s	user 0.014s	sys 0.002s
I20260709 13:07:11.821076 25234 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:11.846690 25336 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.002s	user 0.013s	sys 0.009s
I20260709 13:07:11.860180 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.858135 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:11.869633 21870 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:11.872948 22019 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 5.
I20260709 13:07:11.874082 22016 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:11.876838 22020 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:11.864261 25234 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.860100 21942 rpcz_store.cc:276] 0709 13:07:10.782020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.782164 (+   144us) service_pool.cc:224] Handling call
0709 13:07:10.791365 (+  9201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.791589 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.791616 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.793182 (+  1566us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.080636 (+287454us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:11.080735 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.080843 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.525178 (+444335us) raft_consensus.cc:1685] finished
0709 13:07:11.525206 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.817063 (+291857us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":94629,"threads_started":1,"wal-append.queue_time_us":234011}
W20260709 13:07:11.881590 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.870018 24991 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.887423 24991 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:11.888682 25234 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.898933 25318 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:11.899598 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:11.900501 25318 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:11.903442 22607 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:11.904582 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1390) took 1112 ms. Trace:
I20260709 13:07:11.905002 22019 rpcz_store.cc:276] 0709 13:07:10.783503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.783666 (+   163us) service_pool.cc:224] Handling call
0709 13:07:11.890261 (+1106595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:11.869037 25218 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:11.861439 24706 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.874347 25153 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.905164 25265 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.875911 25192 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:11.912644 22023 raft_consensus.cc:2368] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6.
I20260709 13:07:11.921478 22601 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:07:11.921967 25328 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:11.922605 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 536157us
I20260709 13:07:11.923483 25325 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.875475 25336 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:11.954295 25336 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:11.955204 25228 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.956856 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:11.957760 22604 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:11.926268 25334 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:11.966176 21838 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:11.968223 25176 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:12.004627 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 59950.7us
I20260709 13:07:11.961768 25328 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:11.970259 25319 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:12.052788 21943 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:12.053049 24706 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:12.055423 21866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1778) took 1757 ms (client timeout 2011 ms). Trace:
W20260709 13:07:12.055856 21866 rpcz_store.cc:269] 0709 13:07:10.297528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.297716 (+   188us) service_pool.cc:224] Handling call
0709 13:07:12.055030 (+1757314us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b5400219b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:12.055229 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91934464}
W20260709 13:07:12.081712 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.048216 25164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.053s	sys 0.153s
I20260709 13:07:12.096262 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:12.097429 25164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.053s	sys 0.154s
I20260709 13:07:12.098805 22021 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:12.100096 25325 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:12.101594 25192 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.104809 25153 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:12.125257 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 316999us
W20260709 13:07:12.109663 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 77859.3us
W20260709 13:07:12.129987 22018 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.014s	sys 0.022s
W20260709 13:07:12.130542 22018 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.014s	sys 0.022s
I20260709 13:07:12.126793 21916 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:12.134270 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:12.134971 25265 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:12.143026 22601 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.143991 25325 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:12.150035 25234 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.113927 25328 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.151815 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:12.158138 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:12.160880 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 804688us
I20260709 13:07:12.154040 25319 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:12.153728 25221 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:12.173707 25265 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:12.178982 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0634647930000938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:07:12.179353 25363 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:12.167335 25319 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.169229 25317 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:07:12.185323 25317 consensus_queue.cc:1243] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:12.186323 25336 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:12.187491 25303 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.184684 25319 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.188462 25317 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:12.189291 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:12.178982 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:12.194965 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 54916.5us
I20260709 13:07:12.197427 25146 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:12.197970 25146 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:12.198917 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:12.199223 25146 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.195665 25234 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.195760 25174 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:12.206583 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.207592 21948 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:12.209749 25363 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.209954 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.211172 21873 raft_consensus.cc:2410] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 8 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:12.212875 21945 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:12.222301 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.222821 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.223073 25218 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.223611 25218 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:12.225586 21943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1296) took 1451 ms (client timeout 1753 ms). Trace:
I20260709 13:07:12.224771 22604 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 2 to 6, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:12.226310 25364 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:12.226048 21943 rpcz_store.cc:269] 0709 13:07:10.773849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.773992 (+   143us) service_pool.cc:224] Handling call
0709 13:07:12.225340 (+1451348us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540032a354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:12.225517 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2722935680}
I20260709 13:07:12.227905 25153 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:12.228940 25218 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.230492 25218 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:12.231782 25347 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.394s	user 0.001s	sys 0.001s
I20260709 13:07:12.232138 22610 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:12.205758 25244 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:12.232976 25004 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.233521 25004 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.228574 25364 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:07:12.237982 25265 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.238538 21870 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
W20260709 13:07:12.238991 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.238575 25265 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.239674 25284 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:12.240662 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2525) took 1024 ms. Trace:
I20260709 13:07:12.241086 25179 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:12.241786 25179 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:12.242290 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:12.242805 25179 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.241091 25265 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.242630 25231 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index 2 to 6, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:12.180819 25283 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.244192 25336 consensus_queue.cc:1243] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:07:12.278718 22021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 380) took 2522 ms (client timeout 1942 ms). Trace:
I20260709 13:07:12.300415 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:12.218493 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1309) took 1255 ms. Trace:
I20260709 13:07:12.241065 22016 rpcz_store.cc:276] 0709 13:07:11.225422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.796129 (+570707us) service_pool.cc:224] Handling call
0709 13:07:11.873804 (+ 77675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.874699 (+   895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.240422 (+365723us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b540005da50. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:12.240568 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177776384}
I20260709 13:07:12.288697 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:12.301124 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:12.338105 22021 rpcz_store.cc:269] 0709 13:07:09.755883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.781132 (+ 25249us) service_pool.cc:224] Handling call
0709 13:07:12.278246 (+2497114us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b5400417dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:12.278574 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5229524736}
I20260709 13:07:12.291328 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:12.313167 22576 connection.cc:256] RPC call timeout handler was delayed by -1.5331622019999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 13:07:12.339600 21948 rpcz_store.cc:276] 0709 13:07:10.959786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.967058 (+  7272us) service_pool.cc:224] Handling call
0709 13:07:12.189015 (+1221957us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:07:12.214920 (+ 25905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48126720}
W20260709 13:07:12.344072 22576 connection.cc:256] RPC call timeout handler was delayed by -1.2554272810000384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:07:12.344731 22576 connection.cc:256] RPC call timeout handler was delayed by -1.10378399800004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:07:12.345121 22576 connection.cc:256] RPC call timeout handler was delayed by -1.0619272810000666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 13:07:12.345422 22576 connection.cc:256] RPC call timeout handler was delayed by -1.0003622020000194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2549s for a response
W20260709 13:07:12.303670 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.332487 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 133651us
I20260709 13:07:12.244258 25179 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.271770 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 1951) took 2311 ms. Trace:
I20260709 13:07:12.267786 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:12.336934 22601 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:12.299794 21950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1292) took 1529 ms (client timeout 1551 ms). Trace:
I20260709 13:07:12.292454 22022 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:12.254621 25356 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:07:12.346894 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2514) took 1210 ms. Trace:
I20260709 13:07:12.349512 22020 raft_consensus.cc:2410] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:12.246789 25146 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.385799 22019 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:12.385078 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.387689 21870 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:07:12.348043 21950 rpcz_store.cc:269] 0709 13:07:10.770468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.770651 (+   183us) service_pool.cc:224] Handling call
0709 13:07:12.299360 (+1528709us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b54000fc154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:12.299593 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67511680}
I20260709 13:07:12.271452 25234 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.342633 25126 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:12.347151 21941 rpcz_store.cc:276] 0709 13:07:09.959747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.959906 (+   159us) service_pool.cc:224] Handling call
0709 13:07:12.271284 (+2311378us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54001ac2d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:12.271545 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737843456}
I20260709 13:07:12.209210 25221 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:12.351747 21947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1307) took 1394 ms (client timeout 1660 ms). Trace:
W20260709 13:07:12.346030 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 162244us
I20260709 13:07:12.282006 25304 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.245085 25348 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:12.270965 25174 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.399564 21944 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.401948 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1387) took 2144 ms. Trace:
I20260709 13:07:12.395969 25234 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.406785 25175 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:12.408887 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.421726 25004 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:12.427801 22576 leader_election.cc:400] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
W20260709 13:07:12.397636 21947 rpcz_store.cc:269] 0709 13:07:10.958370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.967647 (+  9277us) service_pool.cc:224] Handling call
0709 13:07:12.300104 (+1332457us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:07:12.351674 (+ 51570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46877440}
I20260709 13:07:12.435073 22017 rpcz_store.cc:276] 0709 13:07:10.191709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.195606 (+  3897us) service_pool.cc:224] Handling call
0709 13:07:12.282308 (+2086702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.282600 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.282640 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.282695 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:12.282763 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.282859 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.335556 (+ 52697us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400417dd0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:12.335717 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4675575040}
W20260709 13:07:12.353041 22610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 554) took 2559 ms (client timeout 1715 ms). Trace:
I20260709 13:07:12.349638 22018 rpcz_store.cc:276] 0709 13:07:11.128018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.160700 (+ 32682us) service_pool.cc:224] Handling call
0709 13:07:11.161271 (+   571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.161709 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:12.132370 (+970661us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.336457 (+204087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.336509 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:12.336560 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.336676 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.338072 (+  1396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2585,"prepare.queue_time_us":976241,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1268,"raft.queue_time_us":9086,"thread_start_us":1150834,"threads_started":2}
I20260709 13:07:12.433251 25348 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:12.450233 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.451018 25361 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.451169 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.450917 25348 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.451494 25358 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:12.451758 25361 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:12.444705 22610 rpcz_store.cc:269] 0709 13:07:09.786111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.786232 (+   121us) service_pool.cc:224] Handling call
0709 13:07:12.302742 (+2516510us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b5400525654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:12.345531 (+ 42789us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5622204800}
I20260709 13:07:12.451982 25358 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:12.451911 21866 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:07:12.460014 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 273329us
I20260709 13:07:12.465710 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.401438 25304 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:12.491631 21870 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.493592 25228 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:12.493492 25319 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.494107 25228 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:12.495082 25228 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.495862 25319 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:12.496873 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.497685 22016 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:12.497874 22020 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:12.498030 21948 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:12.512871 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 85311.4us
I20260709 13:07:12.509274 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:12.512708 25164 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.508164 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:12.533131 22606 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:12.515905 25348 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.506987 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:12.508986 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:12.510437 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:12.505548 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:12.509279 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:12.538096 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.498889 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:12.458462 25174 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.539402 22019 raft_consensus.cc:2410] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:07:12.508713 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:12.498776 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.504679 25192 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:12.500057 25304 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.536154 22602 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:12.496466 25228 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.530898 25328 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.530969 25176 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:12.545751 22605 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.548516 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:12.555065 22576 leader_election.cc:400] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8.
I20260709 13:07:12.547451 22607 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:12.554144 25174 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:12.556900 21870 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:12.558041 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 162826us
I20260709 13:07:12.564113 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.559645 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:12.566449 21948 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.536217 25164 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.569867 25164 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.561111 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:12.570423 25164 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.552551 25304 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.600812 25336 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:12.601644 25336 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.605084 25366 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.605916 25366 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:12.607931 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64743us
I20260709 13:07:12.575276 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:12.608821 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:12.609177 21874 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:12.609817 25175 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.610239 25175 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.610706 25175 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.611999 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:12.612804 25164 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.614966 25164 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:12.617100 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.610718 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.610180 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:12.617930 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 56914.4us
I20260709 13:07:12.618124 25365 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:12.618731 21916 leader_election.cc:400] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6.
W20260709 13:07:12.587504 21838 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.712s (SENT)
I20260709 13:07:12.618984 21871 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:12.619215 21916 leader_election.cc:403] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.619385 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:12.620141 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.624616 21871 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:12.541069 25318 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:12.593657 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.594710 25029 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.594981 25126 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:12.633385 22606 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:12.596102 25234 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:12.559005 25328 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.618686 25365 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.552503 25283 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:12.618518 21874 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:12.590644 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:12.621699 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 384145us
I20260709 13:07:12.622618 21872 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:12.586696 21914 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:12.621481 25366 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.604369 25336 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.545318 25192 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.640141 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:12.642587 21875 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:12.645092 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.637796 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:12.652940 22016 raft_consensus.cc:2368] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11.
I20260709 13:07:12.631667 25164 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.637247 25004 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:12.638105 25126 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.668375 21871 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:12.671506 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.670038 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.673938 21874 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:12.683671 22016 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:07:12.565088 25176 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.643795 25365 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.684347 22016 pending_rounds.cc:85] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 10
I20260709 13:07:12.689447 22016 pending_rounds.cc:107] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:07:12.689998 22016 raft_consensus.cc:2889] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:12.633932 25318 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.693276 21872 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:12.701783 21870 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:12.582429 25358 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.704721 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:12.703454 22018 raft_consensus.cc:2376] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 5. Re-sending same reply.
I20260709 13:07:12.705209 21941 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:12.708884 21875 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:12.706113 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:12.708942 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 97056.1us
I20260709 13:07:12.710182 21871 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:12.682662 25283 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.710769 25283 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.710853 21772 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:12.713171 25283 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:12.713687 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:12.714201 21839 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:12.715049 25318 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.716104 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:12.717754 25363 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:07:12.717651 25175 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.718248 25363 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.719643 25176 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.719777 25192 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.714448 21869 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:12.692229 25336 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:12.687395 25179 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.719944 25175 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:12.727058 22605 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:12.728356 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:12.663170 25029 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.725729 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.735368 22608 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.730345 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:12.737130 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.737185 21942 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.741101 21872 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
W20260709 13:07:12.741415 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 121320us
I20260709 13:07:12.740252 25048 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:12.743227 25048 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.744488 25029 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.746995 25244 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:12.747807 25221 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.748311 21869 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:12.749114 25244 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:12.749949 21869 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:12.750213 25244 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:12.751247 21869 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:07:12.735131 25179 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.725418 25291 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:07:12.755627 21869 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:12.756810 25303 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.757087 21869 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:12.757444 25303 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.758155 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:12.759131 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:12.750497 25358 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:12.748195 21875 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 2 to 6, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:12.722659 25361 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:12.770810 24706 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:12.772068 24706 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:12.772912 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 186285us
I20260709 13:07:12.773329 22606 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:12.773851 25336 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:12.760313 21874 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:12.774343 25336 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.775272 22608 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:12.761197 22017 raft_consensus.cc:2410] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:12.777027 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:12.778025 21943 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:12.778807 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.779640 21946 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:12.780236 25291 raft_consensus.cc:3055] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:12.780710 25291 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:12.781519 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.782202 21874 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
W20260709 13:07:12.777019 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.762550 21947 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:12.766181 22605 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:12.766590 21944 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:12.767639 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:12.768357 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:12.774432 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:12.730199 25283 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:12.731822 25164 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:12.787341 21944 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1308) took 1828 ms (client timeout 1814 ms). Trace:
I20260709 13:07:12.790848 21945 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:12.791985 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 77841.4us
I20260709 13:07:12.793480 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:12.794253 21941 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:12.787935 21944 rpcz_store.cc:269] 0709 13:07:10.959170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.968946 (+  9776us) service_pool.cc:224] Handling call
0709 13:07:12.288422 (+1319476us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:07:12.787268 (+498846us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43489664}
I20260709 13:07:12.794277 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:12.797374 21874 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:12.799482 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.803490 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:12.809126 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:12.810158 21838 leader_election.cc:336] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.753s (SENT)
I20260709 13:07:12.810770 21838 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:12.814519 21871 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:12.815529 21872 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.816176 21866 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:12.765288 25325 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.782310 25004 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:12.828111 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:12.828227 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.832846 22020 raft_consensus.cc:2410] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:12.833459 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:12.821851 21772 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:12.794680 25328 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.829619 21869 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
W20260709 13:07:12.836397 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.836422 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 79500us
I20260709 13:07:12.843575 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.843739 22016 raft_consensus.cc:1217] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[5.5-9.7]   Dedup: 5.5->[7.6-9.7]
I20260709 13:07:12.844220 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:12.821996 25317 raft_consensus.cc:2764] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:12.845197 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.844374 22016 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: [5.5-9.7]
I20260709 13:07:12.811832 25283 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.827682 25318 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:12.854341 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:12.855288 21869 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:12.855494 22023 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.856559 25179 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:12.859695 22015 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:12.862048 25363 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:12.862704 25363 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:12.863641 25363 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.781632 25291 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.865306 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:12.865897 22022 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.828799 25004 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:12.866828 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:12.867322 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:12.867501 22021 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:12.869740 21948 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:12.864883 25048 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:12.869556 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:12.872566 21869 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 4: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:12.871244 25291 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:12.874367 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:12.874522 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.878947 22604 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:12.875207 22024 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:12.847234 25366 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:12.882084 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:12.890556 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 93163.8us
I20260709 13:07:12.839740 25231 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:07:12.831964 25325 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.893730 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.871891 25218 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6.
I20260709 13:07:12.897923 25379 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:12.898377 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.898540 25375 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:07:12.898758 25348 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:12.926671 22022 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:12.899758 25179 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.850272 25328 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:07:12.911180 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.882584 25318 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:12.899045 25029 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:12.874567 25303 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:12.931924 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.936622 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 90987.6us
I20260709 13:07:12.864885 25164 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:12.940783 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.941444 22023 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:12.911623 24706 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:12.958017 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 141565us
I20260709 13:07:12.964262 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:12.928350 25366 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:12.938568 22021 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 2 to 6, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:12.979557 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:12.980237 22023 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:12.945461 24706 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:12.981791 21987 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:12.955816 25360 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:12.979032 25383 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:07:12.944165 25126 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.943161 25348 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.943903 25179 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:12.986027 25303 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:13.013206 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 61878.8us
I20260709 13:07:13.013484 25283 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:13.016794 21947 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:13.017031 25231 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:13.017861 25231 consensus_queue.cc:1243] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:13.018389 25231 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:13.018734 25231 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:13.019443 25126 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:13.010941 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:13.020849 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 56032.7us
I20260709 13:07:13.021893 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:13.022171 21771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 274) took 21403 ms (client timeout 15000 ms). Trace:
I20260709 13:07:13.019675 25231 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:12.991921 24706 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.024219 25392 raft_consensus.cc:2764] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:13.033260 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:13.024808 21941 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
W20260709 13:07:13.022614 21771 rpcz_store.cc:269] 0709 13:06:51.577491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.577872 (+   381us) service_pool.cc:224] Handling call
0709 13:07:12.970121 (+21392249us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:02.599189 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:02.661273 (+ 62084us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:02.661329 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:07:02.661346 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:02.662635 (+  1289us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:02.662732 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:02.662763 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:07:02.664148 (+  1385us) tablet.cc:701] Row locks acquired
0709 13:07:02.664208 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:07:02.664433 (+   225us) write_op.cc:270] Start()
0709 13:07:02.678459 (+ 14026us) write_op.cc:276] Timestamp: P: 1783602422664340 usec, L: 0
0709 13:07:02.686051 (+  7592us) op_driver.cc:348] REPLICATION: starting
0709 13:07:02.851212 (+165161us) log.cc:844] Serialized 4760 byte log entry
0709 13:07:03.573238 (+722026us) op_driver.cc:464] REPLICATION: finished
0709 13:07:04.281106 (+707868us) write_op.cc:301] APPLY: starting
0709 13:07:04.281202 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:04.281487 (+   285us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:04.281612 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:04.343430 (+ 61818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:04.408948 (+ 65518us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:07:04.409008 (+    60us) write_op.cc:312] APPLY: finished
0709 13:07:04.409559 (+   551us) log.cc:844] Serialized 89 byte log entry
0709 13:07:04.429619 (+ 20060us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:04.464481 (+ 34862us) write_op.cc:454] Released schema lock
0709 13:07:04.464574 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:04.476689 (+ 12115us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:04.478454 (+  1765us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23053,"reported_tablets":43,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":671772,"apply.run_cpu_time_us":19542,"apply.run_wall_time_us":188485,"num_ops":12,"prepare.queue_time_us":160307,"prepare.run_cpu_time_us":112664,"prepare.run_wall_time_us":694711,"raft.queue_time_us":208173,"raft.run_cpu_time_us":35714,"raft.run_wall_time_us":749794,"replication_time_us":857930,"thread_start_us":1123290,"threads_started":4,"wal-append.queue_time_us":438392,"wal-append.run_cpu_time_us":23128,"wal-append.run_wall_time_us":2172221}]]}
I20260709 13:07:13.023646 25348 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:13.037175 25146 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:13.031961 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 115695us
I20260709 13:07:13.038352 25146 consensus_queue.cc:1243] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:12.955000 25029 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.016963 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:13.025218 22610 raft_consensus.cc:2410] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:13.042069 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:13.062834 21944 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:13.084635 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 91453.8us
I20260709 13:07:13.086028 21988 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:13.032037 25376 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:07:13.062750 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:13.088552 21872 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:13.091491 21873 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 13:07:12.964880 25004 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:13.093930 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51928.3us
I20260709 13:07:13.098244 21916 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:13.100052 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 107245us
I20260709 13:07:13.072016 25325 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:13.069669 25303 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:13.090931 25221 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.107596 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:13.112592 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:13.072377 25146 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:07:13.117120 21838 leader_election.cc:336] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.875s (SENT)
I20260709 13:07:13.002086 25360 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.095634 25283 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:13.101372 25175 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.078253 25358 consensus_queue.cc:1059] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:07:13.106855 25231 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.106802 25304 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.114179 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:13.088177 25228 consensus_queue.cc:1059] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:13.108304 25348 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:13.122496 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 100730us
I20260709 13:07:13.120159 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:13.108153 25221 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:13.125555 25175 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.124531 25004 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.132102 25393 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.133209 25381 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:07:13.134212 25387 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:07:13.135485 25303 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.073725 25318 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.140425 21942 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:13.125174 25126 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:13.152226 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 63241.8us
I20260709 13:07:13.153893 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:13.142704 25221 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.145118 25175 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.107162 25366 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:13.200301 25399 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.003s
I20260709 13:07:13.153236 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:13.209317 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 92232.1us
W20260709 13:07:13.211820 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 58635.5us
I20260709 13:07:13.153294 25317 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.152802 25348 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:13.155004 25304 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:13.209993 25291 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.209676 25146 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:13.232272 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:13.221760 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:13.222373 25398 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.222560 25395 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:13.223220 25390 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:13.225766 25403 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:13.226274 25360 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:13.228966 25029 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:13.216001 25317 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.218773 25402 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:13.229473 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 86677.6us
I20260709 13:07:13.213352 25365 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.229861 25348 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.235396 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:13.288360 21872 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.217578 25336 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.218731 25228 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:13.257822 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.264638 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44417.3us
W20260709 13:07:13.294155 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72440.2us
I20260709 13:07:13.241994 25265 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:13.215960 25126 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:13.241056 21874 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:13.290279 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 181203us
I20260709 13:07:13.282766 25317 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:13.306816 21838 leader_election.cc:336] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.008s (SENT)
I20260709 13:07:13.307327 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:13.231333 25146 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:13.264446 25179 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:13.264878 25381 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.318436 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:13.319129 21874 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.320677 25336 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:13.282706 25402 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:13.321638 25402 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.286396 25360 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.313928 22573 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:13.317260 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:13.314589 21872 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:13.242141 25291 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.236490 24706 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.317224 25126 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.322816 22607 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.334504 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:13.292166 25395 raft_consensus.cc:697] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:13.335597 21872 raft_consensus.cc:2368] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6.
I20260709 13:07:13.336790 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:13.338178 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:13.346242 21874 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:13.345595 25048 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.349462 21872 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.350378 25414 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:13.350567 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43808.5us
I20260709 13:07:13.351449 25400 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.351925 25400 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:13.352432 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 57280.2us
I20260709 13:07:13.352769 25228 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:13.353293 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:13.354326 25228 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.354523 25400 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:13.354720 25414 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.355041 25228 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.355463 25228 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.355782 25228 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.356716 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:13.322803 25304 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.357384 21868 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:13.358434 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:13.359006 21868 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:13.359902 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.354565 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:13.362068 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:13.348248 25048 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:13.364921 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 260591us
I20260709 13:07:13.365687 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:13.368435 21869 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:13.293283 25393 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:13.331805 25164 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.370754 21872 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
W20260709 13:07:13.385361 25386 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.484s	user 0.002s	sys 0.005s
I20260709 13:07:13.403842 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:13.404451 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.367743 25414 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.405491 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:13.393364 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 289723us
I20260709 13:07:13.362114 24706 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:13.407064 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:13.410620 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58896.1us
I20260709 13:07:13.415855 22015 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:13.419467 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:13.394784 25218 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.423514 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:13.424875 25029 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:13.425639 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:13.425873 25029 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:13.426236 25029 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:13.426599 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.427312 22605 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:13.427043 25029 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.427631 22604 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.428231 25029 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.429322 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:13.430027 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68057.5us
I20260709 13:07:13.446372 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:13.447213 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.411015 25414 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.449620 22016 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:13.445807 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.450842 22602 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 7: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:07:13.451376 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.415439 25381 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:13.418534 25387 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.451997 25414 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.464818 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.454674 25418 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:07:13.467664 25387 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.467887 25365 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:13.468250 25387 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.468717 25244 raft_consensus.cc:3055] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.469129 25244 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:13.469988 25244 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.430881 25218 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.458798 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 141628us
W20260709 13:07:13.492578 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:13.493404 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47120.3us
W20260709 13:07:13.461434 25410 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:07:13.500924 22576 leader_election.cc:400] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11.
I20260709 13:07:13.508350 22576 leader_election.cc:403] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.509694 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:13.510576 22020 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:13.413635 25146 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.455672 25381 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.458731 25392 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:13.414685 25364 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:07:13.458427 25179 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.468266 25319 raft_consensus.cc:3055] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:13.504510 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:13.491993 25218 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:13.523191 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 369812us
W20260709 13:07:13.526100 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 96489.7us
I20260709 13:07:13.528214 21987 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:13.529753 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 124346us
I20260709 13:07:13.530436 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:13.516942 25244 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.536092 22603 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:13.523612 25381 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.518128 25407 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:13.538691 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:13.522977 25392 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:13.543154 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.526826 25319 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:13.548256 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:13.551407 22019 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:13.523386 25358 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:13.554306 21987 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:13.547693 25179 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.551741 25385 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11.
I20260709 13:07:13.524344 25365 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:07:13.560480 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64835.1us
I20260709 13:07:13.540195 25418 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.563567 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:13.542186 25146 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.540071 25407 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:13.561313 25179 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.571347 25048 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:13.574955 25179 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.552011 25304 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:07:13.563990 25413 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.572284 25407 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.600015 25417 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:07:13.615078 25413 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.564174 25164 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:13.517418 25395 consensus_queue.cc:237] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.612888 25392 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.625905 25319 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.564234 25336 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.650877 21868 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:13.651755 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:13.679441 22020 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:13.637874 25360 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.569972 25414 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.684796 25174 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.684324 25365 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:13.652689 25048 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:13.700578 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 62314.5us
I20260709 13:07:13.684396 25336 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.704239 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.685793 25413 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.689827 25364 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:13.690099 25304 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.693632 25392 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.692771 25358 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.701880 25385 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:13.719221 22576 connection.cc:256] RPC call timeout handler was delayed by -2.3755260060000865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2389s for a response
I20260709 13:07:13.704790 25365 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:13.712093 25319 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:13.714205 25336 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:13.757253 25421 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:07:13.758988 25419 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:13.766220 25179 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:13.770433 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.759102 25402 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.766033 25419 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:13.770928 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.758625 25365 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.775338 25365 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.776454 25419 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:13.784780 25398 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.785477 25398 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.716099 25304 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:13.788045 25398 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:13.794727 25317 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.790593 25304 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:13.725831 25424 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.224s
I20260709 13:07:13.801164 25304 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.797923 25336 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:13.809118 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.832067 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.834528 22603 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
W20260709 13:07:13.839089 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.717180 25048 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:13.840675 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:13.840253 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 292056us
I20260709 13:07:13.724843 25364 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:13.844810 21839 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:13.707880 25174 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:13.850337 22576 connection.cc:256] RPC call timeout handler was delayed by -1.8382260060000135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29860000000000003s for a response
I20260709 13:07:13.849402 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.785499 25402 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:13.716300 25360 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:13.851679 22602 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
W20260709 13:07:13.848817 21838 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.906s (SENT) [suppressed 41 similar messages]
W20260709 13:07:13.853111 22576 connection.cc:256] RPC call timeout handler was delayed by -1.0728847400000632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 13:07:13.853295 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:13.855400 21874 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.856078 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.857326 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.858108 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:13.866869 22022 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:13.867069 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 362721us
I20260709 13:07:13.867785 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:13.869436 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:13.726030 25358 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:13.877185 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 322969us
I20260709 13:07:13.870146 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.879648 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:13.881014 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:13.881732 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 360973us
I20260709 13:07:13.881943 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:13.882541 21941 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:13.883651 21947 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:13.873564 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:13.887543 21872 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:13.874943 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:13.888671 22020 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:13.889863 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:13.890632 22020 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:13.890483 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:13.891055 21946 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:13.876403 22601 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:13.891980 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:13.891454 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:13.895412 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:13.890933 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:13.894083 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:13.892771 21941 raft_consensus.cc:2376] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9. Re-sending same reply.
I20260709 13:07:13.894177 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:13.851799 25400 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.894852 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:13.898517 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:13.899717 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:13.897861 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:13.895390 22020 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.849198 25179 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:13.908447 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:13.856835 25146 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:13.868485 25418 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:13.910475 25348 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:14.028180 25348 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.028839 25348 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:13.948412 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 99606.8us
W20260709 13:07:14.024322 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 156588us
I20260709 13:07:13.911264 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:14.021204 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:13.963080 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:14.042578 21868 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:13.978710 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:13.952168 21871 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:14.045240 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:13.902966 22609 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:13.949741 21875 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:14.047084 21875 pending_rounds.cc:85] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 7
I20260709 13:07:14.047452 21875 pending_rounds.cc:107] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:14.047787 21875 raft_consensus.cc:2889] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.034852 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:14.054219 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.950511 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:13.950542 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.061923 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.062315 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.062673 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.063669 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 150799us
I20260709 13:07:14.056109 21943 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:14.037004 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:13.963409 25231 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.001s
I20260709 13:07:14.067287 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:14.069485 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 209431us
W20260709 13:07:13.906095 25004 consensus_meta.cc:287] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
W20260709 13:07:14.030798 25410 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:07:13.967555 25228 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.008s
I20260709 13:07:14.071615 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 422) took 1109 ms. Trace:
I20260709 13:07:14.082286 21948 rpcz_store.cc:276] 0709 13:07:12.954458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.954601 (+   143us) service_pool.cc:224] Handling call
0709 13:07:12.979386 (+ 24785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.024183 (+ 44797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.024212 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.024252 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:13.024279 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.063227 (+1038948us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b5400140fd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:14.063297 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.063484 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102567296}
I20260709 13:07:13.952840 25417 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:14.064460 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:13.898561 25400 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.962759 25175 consensus_meta.cc:287] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.004s
I20260709 13:07:13.957563 25317 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:14.101962 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 67859.7us
I20260709 13:07:14.102790 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:14.104696 21944 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:13.950125 25029 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:14.114548 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.082974 25387 consensus_meta.cc:287] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.002s
I20260709 13:07:14.131947 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:14.134044 21948 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:14.131947 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:14.135318 21943 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:14.106436 22020 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:14.140158 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.130716 25221 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.913s	user 0.010s	sys 0.001s
I20260709 13:07:14.150210 25221 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.055382 25146 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.105729 25400 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.190455 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:14.105422 25414 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:14.111879 25433 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.150358 25418 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.192193 21946 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:14.054234 25048 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:14.201103 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.185940 25317 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:14.209831 22019 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.099538 25228 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.229311 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 614) took 1451 ms. Trace:
I20260709 13:07:14.188741 25379 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:14.066758 25364 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:14.228999 25433 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:14.210587 25429 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.476s	user 0.001s	sys 0.000s
I20260709 13:07:14.110445 25175 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.190747 25179 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:14.231980 25408 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:07:14.236819 25406 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.237511 25317 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:14.237748 21950 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.239283 25291 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:14.143673 25029 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:14.262130 25442 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:07:14.260650 25431 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:07:14.210359 25440 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:07:14.232463 25437 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.285648 22606 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:14.279549 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1794) took 1486 ms. Trace:
I20260709 13:07:14.281116 22608 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:14.168116 25387 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:14.299366 25319 consensus_meta.cc:287] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.003s
W20260709 13:07:14.300797 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 198074us
I20260709 13:07:14.280405 25221 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:14.731678 22017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.019s	sys 0.010s
W20260709 13:07:14.650564 21989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.017s	sys 0.035s
I20260709 13:07:14.708220 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:14.733248 21989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.025s	sys 0.035s
W20260709 13:07:14.307761 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.391623 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 328024us
I20260709 13:07:14.311007 21950 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:14.395100 21943 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:14.350560 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.304589 25392 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.005s
I20260709 13:07:14.316056 21871 rpcz_store.cc:276] 0709 13:07:12.793603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.847628 (+ 54025us) service_pool.cc:224] Handling call
0709 13:07:12.872025 (+ 24397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.053816 (+1181791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.279265 (+225449us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400317ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:14.279483 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483288960}
I20260709 13:07:14.733950 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:14.375061 21868 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:14.330976 22019 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:14.743677 21947 raft_consensus.cc:2410] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:07:14.744042 22016 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 4: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:14.737030 21867 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.016s	sys 0.041s
I20260709 13:07:14.230334 22610 rpcz_store.cc:276] 0709 13:07:12.758578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.767375 (+  8797us) service_pool.cc:224] Handling call
0709 13:07:14.210253 (+1442878us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54006d1d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:14.210439 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549379456}
W20260709 13:07:14.733497 21987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.010s	sys 0.005s
W20260709 13:07:14.653342 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 106784us
I20260709 13:07:14.732548 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:14.736624 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:14.520637 21949 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:14.235978 25379 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:14.733949 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:14.732431 22017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.019s	sys 0.010s
I20260709 13:07:14.751425 22023 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:14.391342 25407 consensus_meta.cc:287] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.009s
W20260709 13:07:14.751525 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 610713us
W20260709 13:07:14.410679 25434 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
W20260709 13:07:14.745606 21987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.010s	sys 0.005s
W20260709 13:07:14.757758 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 650560us
I20260709 13:07:14.315286 25265 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:14.738126 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.762990 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.412345 25445 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
W20260709 13:07:14.754637 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 46562us
W20260709 13:07:14.309592 25218 consensus_meta.cc:287] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.008s
I20260709 13:07:14.311208 25179 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:07:14.378050 21838 leader_election.cc:336] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.660s (SENT)
I20260709 13:07:14.443591 25146 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:14.760655 22022 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 4. Current term is 6. Ops: []
I20260709 13:07:14.779268 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:14.747334 25304 consensus_meta.cc:287] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.915s	user 0.008s	sys 0.016s
I20260709 13:07:14.312274 25029 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:14.378342 25336 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:14.309136 25406 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:14.789670 25406 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.791160 25406 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.346155 25360 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:14.324501 25228 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:14.411309 25164 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:14.795421 25164 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:14.796973 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 564) took 1372 ms. Trace:
I20260709 13:07:14.444259 25358 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:14.737254 25361 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:14.737515 25174 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:14.797461 22606 rpcz_store.cc:276] 0709 13:07:13.424313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.429065 (+  4752us) service_pool.cc:224] Handling call
0709 13:07:14.796730 (+1367665us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400662e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:14.796901 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936532224}
I20260709 13:07:14.798105 25361 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:14.799647 25164 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:14.800124 25361 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:14.806105 25381 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.246s	user 0.007s	sys 0.006s
I20260709 13:07:14.806695 25381 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.808920 21942 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:07:14.812285 25425 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.175s	user 0.014s	sys 0.005s
W20260709 13:07:14.822721 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 444694us
W20260709 13:07:14.737597 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.309862 25317 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.773599 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:14.780421 22610 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:14.837733 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 54075.2us
I20260709 13:07:14.521595 25427 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.243s
I20260709 13:07:14.757221 25392 raft_consensus.cc:2764] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:14.761595 25221 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:14.760867 25319 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:14.781728 25179 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:14.774271 25413 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.024s	user 0.000s	sys 0.024s
I20260709 13:07:14.818531 25378 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.821343 25387 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:14.768075 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:14.824951 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:14.876241 21869 raft_consensus.cc:2393] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 6: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:14.762647 25265 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:14.837831 22607 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:14.855839 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:14.758989 25407 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:14.856433 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 97569.6us
I20260709 13:07:14.853377 25029 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.857774 25319 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:14.866797 25175 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:14.844326 25433 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:14.774637 25218 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:14.891351 21987 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:14.879597 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:14.864704 21838 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.639s (SENT)
I20260709 13:07:14.877185 25365 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.876269 25378 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:14.932859 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:14.933291 21987 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:14.930408 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 50865.4us
W20260709 13:07:14.927026 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 62355.9us
I20260709 13:07:14.922621 21946 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:14.927855 25348 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.898s	user 0.006s	sys 0.014s
I20260709 13:07:14.900450 25462 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:14.861521 25146 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:07:14.877456 25221 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:14.878898 25336 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.936347 21838 leader_election.cc:336] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.814s (SENT)
I20260709 13:07:14.929316 25407 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:14.920861 25319 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.955315 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:14.917378 25029 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:14.876253 25413 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:14.872769 25379 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:14.946801 25328 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:14.946009 25462 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.953580 21944 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:14.990221 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1981) took 1080 ms. Trace:
I20260709 13:07:14.955004 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:15.069380 25420 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.049541 25361 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.077200 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.223946 25420 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:15.051955 22608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 561) took 1628 ms (client timeout 2119 ms). Trace:
W20260709 13:07:15.224972 22608 rpcz_store.cc:269] 0709 13:07:13.423349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.425371 (+  2022us) service_pool.cc:224] Handling call
0709 13:07:15.051671 (+1626300us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b5400525654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:15.051864 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917896448}
I20260709 13:07:14.990931 25427 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.226285 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 408) took 1349 ms. Trace:
I20260709 13:07:14.944128 25348 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.226933 22022 rpcz_store.cc:276] 0709 13:07:13.876560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.876809 (+   249us) service_pool.cc:224] Handling call
0709 13:07:13.956246 (+ 79437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.779682 (+823436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.226029 (+446347us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54001f13d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:15.226218 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849382272}
I20260709 13:07:15.228526 25348 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:15.029381 25460 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:07:15.230137 21948 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:14.952582 25452 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.232906 25452 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:15.233520 25452 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.237186 25348 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.237591 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.045256 22018 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:14.939584 25365 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:15.036815 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 100497us
I20260709 13:07:15.043303 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.013867 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1807) took 1151 ms. Trace:
I20260709 13:07:14.957643 25381 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:14.952704 25433 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.013661 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:15.079664 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1810) took 1216 ms. Trace:
I20260709 13:07:15.228392 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:15.075210 22573 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:15.086261 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 407) took 1220 ms. Trace:
I20260709 13:07:15.245333 22022 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.087152 21950 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:15.088496 25029 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.093798 22023 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:15.247892 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:15.248257 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 234660us
W20260709 13:07:15.124375 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 172729us
I20260709 13:07:15.237766 25348 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.120252 25462 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.121040 21941 rpcz_store.cc:276] 0709 13:07:13.909745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.909873 (+   128us) service_pool.cc:224] Handling call
0709 13:07:14.380895 (+471022us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:07:14.381122 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.381368 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:14.652823 (+271455us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.987370 (+334547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.987419 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:14.987461 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.987528 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.990157 (+  2629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48871,"prepare.queue_time_us":413106,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":3638,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":37949,"spinlock_wait_cycles":8582016,"thread_start_us":510307,"threads_started":2,"wal-append.queue_time_us":341049}
I20260709 13:07:15.249384 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:15.073043 25164 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:15.142107 21944 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:15.130069 25407 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:15.259094 25407 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.259613 25164 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:15.139038 25464 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:07:15.133230 25379 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.070294 25221 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.133740 25387 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:15.145915 25218 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.137215 25450 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.135908 25418 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:15.140906 25472 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.090950 25393 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:07:15.146977 25364 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.139700 25378 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:15.167536 25400 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.955s	user 0.007s	sys 0.007s
I20260709 13:07:15.173868 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:15.175716 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:15.278035 21868 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.161021 25392 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.185209 21949 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:15.143231 25265 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:15.183143 25463 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:07:15.192916 21870 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:15.182914 25413 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:15.216964 25228 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.271699 25387 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.284529 25228 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.287463 25228 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.287883 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 412) took 1334 ms. Trace:
I20260709 13:07:15.284683 25392 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.273609 25450 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.288493 22020 rpcz_store.cc:276] 0709 13:07:13.953464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.146264 (+192800us) service_pool.cc:224] Handling call
0709 13:07:14.158519 (+ 12255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.186301 (+ 27782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.186338 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.190431 (+  4093us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.758039 (+567608us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:14.758073 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.758225 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.287666 (+529441us) raft_consensus.cc:1685] finished
0709 13:07:15.287689 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.287822 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":949,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":472314,"threads_started":1,"wal-append.queue_time_us":714844}
I20260709 13:07:15.290249 25392 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:15.290320 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.290611 25450 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:15.273375 25433 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.291178 22020 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:15.291405 25433 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.271446 25418 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.291790 25433 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.292083 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.226176 25427 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.293609 25418 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:15.294859 25265 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.295341 25427 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:14.980278 25336 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.297806 25336 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.037668 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 410) took 1133 ms. Trace:
I20260709 13:07:15.090770 22015 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.089303 25432 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.298899 25432 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.291188 25450 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.300333 25450 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.301355 25432 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:15.248165 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:15.250862 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:15.302414 25387 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:15.302508 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51775.7us
I20260709 13:07:15.284354 25365 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.303157 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:15.299780 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:15.226379 25420 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.307835 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.253280 21946 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:15.313449 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 429) took 1901 ms. Trace:
I20260709 13:07:15.314011 21942 rpcz_store.cc:276] 0709 13:07:13.411933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.412117 (+   184us) service_pool.cc:224] Handling call
0709 13:07:13.429000 (+ 16883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.809414 (+1380414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.313087 (+503673us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540009bad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:15.313376 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3172803328}
W20260709 13:07:15.253677 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 178575us
I20260709 13:07:15.256022 25175 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.257364 25348 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.298535 22017 rpcz_store.cc:276] 0709 13:07:13.904917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.132561 (+227644us) service_pool.cc:224] Handling call
0709 13:07:14.184808 (+ 52247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.187782 (+  2974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.187820 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.190655 (+  2835us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.751397 (+560742us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:15.035540 (+284143us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.037290 (+  1750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.037375 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.037426 (+    51us) raft_consensus.cc:1685] finished
0709 13:07:15.037440 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.037603 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9581,"prepare.queue_time_us":177889,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":9555,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":40464,"thread_start_us":801264,"threads_started":2,"wal-append.queue_time_us":647478}
I20260709 13:07:15.258163 25319 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.254607 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:15.245692 22024 rpcz_store.cc:276] 0709 13:07:13.866279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.866412 (+   133us) service_pool.cc:224] Handling call
0709 13:07:13.876512 (+ 10100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.957085 (+ 80573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.957128 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.037735 (+ 80607us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.456412 (+418677us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.651284 (+194872us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.651552 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.651654 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.929120 (+277466us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18004b0c40. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:15.085968 (+156848us) raft_consensus.cc:1685] finished
0709 13:07:15.086063 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.086198 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14617,"prepare.queue_time_us":195191,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":156535,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":17232,"spinlock_wait_cycles":3067136,"thread_start_us":313340,"threads_started":1,"wal-append.queue_time_us":856191}
I20260709 13:07:15.240929 21874 rpcz_store.cc:276] 0709 13:07:13.861958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.863197 (+  1239us) service_pool.cc:224] Handling call
0709 13:07:13.863595 (+   398us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:13.878687 (+ 15092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.878732 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:13.879526 (+   794us) log.cc:844] Serialized 78 byte log entry
0709 13:07:14.047376 (+167850us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.088282 (+ 40906us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.088847 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.088952 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.411555 (+322603us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:14.986903 (+575348us) raft_consensus.cc:1685] finished
0709 13:07:15.013606 (+ 26703us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.013799 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4014,"prepare.queue_time_us":102213,"prepare.run_cpu_time_us":3579,"prepare.run_wall_time_us":38731,"raft.queue_time_us":5917,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":228,"spinlock_wait_cycles":48681216,"thread_start_us":178393,"threads_started":2,"wal-append.queue_time_us":249465}
I20260709 13:07:15.261272 21941 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.263345 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1989) took 1234 ms. Trace:
I20260709 13:07:15.322543 21950 rpcz_store.cc:276] 0709 13:07:14.028791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.786654 (+757863us) service_pool.cc:224] Handling call
0709 13:07:15.086940 (+300286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.249708 (+162768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.263280 (+ 13572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.261432 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:15.266597 21838 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.882s (SENT)
I20260709 13:07:15.267033 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.243765 21867 rpcz_store.cc:276] 0709 13:07:13.862815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.033980 (+171165us) service_pool.cc:224] Handling call
0709 13:07:14.077306 (+ 43326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.077614 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:14.745115 (+667501us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.079316 (+334201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.079363 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:15.079421 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.079488 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.079607 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27372,"prepare.queue_time_us":149975,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":70,"raft.queue_time_us":106,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"thread_start_us":936425,"threads_started":2,"wal-append.queue_time_us":395571}
I20260709 13:07:15.323702 21838 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:15.250474 25361 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:15.260550 25473 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:07:15.272420 21943 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:15.250128 25328 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:15.276532 22022 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:15.263422 25244 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:15.333257 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.335271 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.319593 25452 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.263593 25465 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:15.326292 25406 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
I20260709 13:07:15.278482 21875 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:15.282600 25378 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.346179 25328 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.348750 21871 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:15.349227 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.348745 25468 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.279120 25400 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.352197 25400 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:15.277415 25472 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.224522 21947 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:15.354470 25472 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.354557 25319 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.320149 25395 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:15.361239 25395 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.363406 25395 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.363906 25336 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:15.364504 25336 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:15.365412 25336 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.339249 25244 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:15.372074 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2562) took 1485 ms. Trace:
I20260709 13:07:15.372305 25244 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:15.373500 22019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 409) took 1469 ms (client timeout 1566 ms). Trace:
W20260709 13:07:15.373915 22019 rpcz_store.cc:269] 0709 13:07:13.904051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.949888 (+ 45837us) service_pool.cc:224] Handling call
0709 13:07:15.373332 (+1423444us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400417dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:15.373447 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398249856}
I20260709 13:07:15.375029 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:15.376222 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:15.306154 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.252045 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45818.8us
I20260709 13:07:15.395061 22019 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:15.306624 21868 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:15.395948 21987 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:15.403505 22016 raft_consensus.cc:2410] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:07:15.222054 21772 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 163) took 23468 ms (client timeout 15000 ms). Trace:
I20260709 13:07:15.307842 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.305254 21870 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 6.
I20260709 13:07:15.309834 22015 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:15.405786 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:15.406067 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:15.406549 22608 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.406684 22610 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:15.406924 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.407197 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:15.317488 25179 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.407704 22020 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:15.318629 25450 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:15.327564 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 73012.3us
I20260709 13:07:15.392238 25462 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.408572 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.410959 22574 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:15.276949 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 322039us
I20260709 13:07:15.336881 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.328285 24706 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:07:15.338663 25348 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:15.339888 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 90462.8us
I20260709 13:07:15.417929 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:15.418061 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1409) took 1008 ms. Trace:
I20260709 13:07:15.261291 25407 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:15.341944 21945 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.418864 22020 rpcz_store.cc:276] 0709 13:07:14.409509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.408329 (+998820us) service_pool.cc:224] Handling call
0709 13:07:15.418006 (+  9677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.343294 22024 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:15.322042 25427 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.334352 25424 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.424996 25424 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.279093 25364 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.425990 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1405) took 1017 ms. Trace:
I20260709 13:07:15.426496 22024 rpcz_store.cc:276] 0709 13:07:14.408287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.322008 (+913721us) service_pool.cc:224] Handling call
0709 13:07:15.425908 (+103900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.427610 25364 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:15.328998 25361 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.382732 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:15.383250 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 116681us
I20260709 13:07:15.433035 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.386040 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 1985) took 1363 ms. Trace:
I20260709 13:07:15.363441 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 403) took 1501 ms. Trace:
I20260709 13:07:15.433880 22020 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:15.434051 22021 rpcz_store.cc:276] 0709 13:07:13.862200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.862936 (+   736us) service_pool.cc:224] Handling call
0709 13:07:15.363247 (+1500311us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54001f18d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:15.363370 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980702080}
I20260709 13:07:15.433984 21948 rpcz_store.cc:276] 0709 13:07:14.022313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.145150 (+122837us) service_pool.cc:224] Handling call
0709 13:07:14.190063 (+ 44913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.230516 (+1040453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.385687 (+155171us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540012fa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:15.385949 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391412608}
I20260709 13:07:15.280387 25164 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.372501 22018 rpcz_store.cc:276] 0709 13:07:13.886511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.071514 (+185003us) service_pool.cc:224] Handling call
0709 13:07:14.100590 (+ 29076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.238703 (+1138113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.371810 (+133107us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54003c9bd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:15.372016 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169864448}
I20260709 13:07:15.414278 22022 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:15.407660 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:15.415261 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1403) took 1007 ms. Trace:
I20260709 13:07:15.436570 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.438741 22016 rpcz_store.cc:276] 0709 13:07:14.407664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.750336 (+342672us) service_pool.cc:224] Handling call
0709 13:07:15.410414 (+660078us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400419bd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:15.415199 (+  4785us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208138624}
I20260709 13:07:15.439714 22610 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:15.437331 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1414) took 1026 ms. Trace:
I20260709 13:07:15.440235 22022 rpcz_store.cc:276] 0709 13:07:14.411018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.336567 (+925549us) service_pool.cc:224] Handling call
0709 13:07:15.437272 (+100705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.440768 21914 leader_election.cc:400] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6.
W20260709 13:07:15.437978 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.438349 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:15.442109 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:15.414199 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:15.422925 25465 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.424113 25462 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:15.423986 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:15.445627 22608 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.427625 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:15.429550 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:15.409853 25179 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:15.458534 21838 leader_election.cc:336] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.854s (SENT)
I20260709 13:07:15.461642 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:15.462383 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:15.466688 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 52567.4us
I20260709 13:07:15.467689 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:15.470261 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:15.471539 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.430967 25192 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:15.437203 25424 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:15.473975 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.453007 25465 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.451184 25319 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:15.483274 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.454172 25265 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:15.483824 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:15.473943 25440 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:15.501479 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:15.485100 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.472175 25228 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.485397 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:15.471675 25364 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.488495 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:15.405009 21772 rpcz_store.cc:269] 0709 13:06:51.753216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.766967 (+ 13751us) service_pool.cc:224] Handling call
0709 13:07:15.221941 (+23454974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:13.018069 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:13.018735 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:13.018795 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:07:13.018829 (+    34us) tablet.cc:662] Decoding operations
0709 13:07:13.019564 (+   735us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:13.019641 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:13.019678 (+    37us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:07:13.020219 (+   541us) tablet.cc:701] Row locks acquired
0709 13:07:13.020260 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:07:13.020444 (+   184us) write_op.cc:270] Start()
0709 13:07:13.026098 (+  5654us) write_op.cc:276] Timestamp: P: 1783602433020380 usec, L: 0
0709 13:07:13.026136 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:07:13.132499 (+106363us) log.cc:844] Serialized 1658 byte log entry
0709 13:07:13.458718 (+326219us) op_driver.cc:464] REPLICATION: finished
0709 13:07:13.557183 (+ 98465us) write_op.cc:301] APPLY: starting
0709 13:07:13.557313 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:13.562413 (+  5100us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:13.563716 (+  1303us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:13.589197 (+ 25481us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:13.720340 (+131143us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:07:13.726116 (+  5776us) write_op.cc:312] APPLY: finished
0709 13:07:13.757354 (+ 31238us) log.cc:844] Serialized 41 byte log entry
0709 13:07:13.757568 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:13.757663 (+    95us) write_op.cc:454] Released schema lock
0709 13:07:13.757726 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:13.758123 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:13.758149 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6579592,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":83918,"apply.run_cpu_time_us":13966,"apply.run_wall_time_us":200949,"num_ops":4,"prepare.queue_time_us":159032,"prepare.run_cpu_time_us":43527,"prepare.run_wall_time_us":201494,"raft.queue_time_us":92494,"raft.run_cpu_time_us":29273,"raft.run_wall_time_us":65427,"replication_time_us":418216,"thread_start_us":260302,"threads_started":4,"wal-append.queue_time_us":150835,"wal-append.run_cpu_time_us":4821,"wal-append.run_wall_time_us":1467776}]]}
I20260709 13:07:15.432240 25379 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:07:15.460052 25348 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:15.504901 22017 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
I20260709 13:07:15.457435 25481 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:15.472543 25407 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:15.486434 25465 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.486990 25164 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:15.489099 25406 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.487499 25451 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:15.502125 25319 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:15.554293 22021 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:15.589378 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:15.555505 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 85346.1us
I20260709 13:07:15.589823 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1412) took 1179 ms. Trace:
I20260709 13:07:15.590247 22021 rpcz_store.cc:276] 0709 13:07:14.410411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.491324 (+1080913us) service_pool.cc:224] Handling call
0709 13:07:15.554033 (+ 62709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.589545 (+ 35512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.589765 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.591147 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:15.512776 25218 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.555589 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.491288 25462 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.457170 25395 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:07:15.558496 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 57565.1us
I20260709 13:07:15.596243 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.554989 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1402) took 1147 ms. Trace:
I20260709 13:07:15.560508 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.600664 22019 rpcz_store.cc:276] 0709 13:07:14.407313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.491243 (+1083930us) service_pool.cc:224] Handling call
0709 13:07:15.554477 (+ 63234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.554658 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.554680 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.554718 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:15.554749 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.554806 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.554915 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.600939 21946 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:15.601861 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.509078 25392 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 13:07:15.603266 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.592161 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 269620us
I20260709 13:07:15.593283 22020 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
I20260709 13:07:15.558127 25428 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.593755 22016 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.714133 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1416) took 1302 ms. Trace:
I20260709 13:07:15.714511 22016 rpcz_store.cc:276] 0709 13:07:14.411577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.529955 (+1118378us) service_pool.cc:224] Handling call
0709 13:07:15.593567 (+ 63612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.713873 (+120306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.714075 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.501958 25192 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.594278 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:15.491668 25029 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:07:15.514061 25418 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:07:15.768350 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.557821 25265 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:15.768460 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:15.776887 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 315481us
I20260709 13:07:15.602896 21947 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.609833 22024 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:15.509593 25146 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:07:15.556481 25317 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:15.713133 22018 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.770310 21946 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.563514 25358 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.769104 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:15.768170 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.767925 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.530995 25364 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.714583 22021 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.563256 25407 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:15.788053 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1419) took 1375 ms. Trace:
I20260709 13:07:15.774896 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:15.788473 22021 rpcz_store.cc:276] 0709 13:07:14.412550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.591085 (+1178535us) service_pool.cc:224] Handling call
0709 13:07:15.714350 (+123265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.787800 (+ 73450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.787997 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.789100 22607 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:15.775421 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 63571us
I20260709 13:07:15.767921 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.778591 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1415) took 1367 ms. Trace:
I20260709 13:07:15.598868 25218 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.600618 21941 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:15.781450 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:15.589598 25472 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:15.782785 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1418) took 1370 ms. Trace:
I20260709 13:07:15.799016 22018 rpcz_store.cc:276] 0709 13:07:14.412262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.562521 (+1150259us) service_pool.cc:224] Handling call
0709 13:07:15.710512 (+147991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.782534 (+ 72022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.782727 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.784644 21773 catalog_manager.cc:5697] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:15.784500 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.767844 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1420) took 1245 ms. Trace:
W20260709 13:07:15.786630 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.541882 25433 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.792516 22024 rpcz_store.cc:276] 0709 13:07:14.411272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.516060 (+1104788us) service_pool.cc:224] Handling call
0709 13:07:15.591293 (+ 75233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.778341 (+187048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.778536 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:15.596939 25432 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:15.593132 25400 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:15.592944 25480 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.232s
I20260709 13:07:15.783377 25175 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.566036 25424 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.211s
I20260709 13:07:15.545234 25228 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.858614 25228 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.713160 25468 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.859529 25468 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.861856 25468 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:15.514240 25411 consensus_queue.cc:1059] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.268s
I20260709 13:07:15.862674 25411 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:15.863013 25411 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:15.709792 25481 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:07:15.866964 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:15.867898 22604 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:15.870842 21839 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:15.877064 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.800794 22019 rpcz_store.cc:276] 0709 13:07:14.650876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.602123 (+951247us) service_pool.cc:224] Handling call
0709 13:07:15.712853 (+110730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.767465 (+ 54612us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:15.767503 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.767554 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:15.767586 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.767649 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.767783 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61352,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6817}
I20260709 13:07:15.605155 25451 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:15.794076 25317 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:15.909415 25317 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.910583 25433 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:15.796144 21916 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:15.812640 22607 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:15.812989 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.913786 25221 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:15.913981 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.914253 25221 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.914618 25221 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.915139 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.916311 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.917347 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.917847 21944 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.787982 25420 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.918947 25420 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.920495 25465 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.921133 25420 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.814678 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.921761 22610 raft_consensus.cc:2368] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
I20260709 13:07:15.922466 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.922796 25465 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.923694 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.815889 24706 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:15.798142 25218 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.816291 25452 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:15.799155 25319 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.803943 21773 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 8, now has a pending config: VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1), VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2), VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3), VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 8 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:15.817443 25400 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.770043 25328 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:07:15.819268 25192 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:15.940035 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 158641us
I20260709 13:07:15.833357 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.835213 25364 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:15.836514 25244 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.942034 21942 raft_consensus.cc:2410] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:15.943173 25244 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:15.840808 25348 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.804840 25472 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:15.843724 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 249539us
I20260709 13:07:15.837598 21946 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:15.953090 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:15.845189 25480 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:15.839525 22608 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:15.847040 21947 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:15.794409 25358 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.795199 25407 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.854408 25175 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.798542 25427 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:15.709991 25462 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:15.845669 25179 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:15.887399 22015 raft_consensus.cc:2368] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:07:15.836730 25265 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.863938 25411 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.808130 25432 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:15.890432 25468 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.016664 25468 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.017316 25468 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:15.912842 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 116760us
I20260709 13:07:15.812728 25164 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.021154 25164 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:15.962540 25452 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.938237 21773 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.024616 21773 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:15.946978 22606 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:15.943193 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:16.026784 21942 raft_consensus.cc:2376] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7. Re-sending same reply.
I20260709 13:07:15.953317 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:15.956686 21839 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:15.970023 21866 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:15.970911 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:15.970335 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.030176 21947 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:15.978816 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:15.978905 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:16.031142 21868 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:16.031311 21874 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:15.994704 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:16.032100 22607 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:15.995558 21871 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:15.996225 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:16.033762 21875 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.996979 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:15.952225 25328 consensus_queue.cc:1243] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:16.001441 21944 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:07:16.009837 22023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1407) took 1600 ms (client timeout 1881 ms). Trace:
I20260709 13:07:16.009397 25379 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.954464 25480 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:16.041133 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 84567.6us
I20260709 13:07:16.041663 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:16.036655 22023 rpcz_store.cc:269] 0709 13:07:14.408929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.248873 (+839944us) service_pool.cc:224] Handling call
0709 13:07:16.009568 (+760695us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b5400019d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:16.009758 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656979200}
I20260709 13:07:15.979882 25244 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.044716 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.074519 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.162210 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:16.168112 21942 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:15.972046 25364 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:07:16.161301 22017 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:16.038460 21773 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 8, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 8 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:16.158967 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:15.970465 25192 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:07:16.168419 22610 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:16.166558 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.166857 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:16.193619 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:16.201421 22608 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:16.201794 21949 raft_consensus.cc:2410] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:07:16.168506 22576 leader_election.cc:336] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.206s (SENT)
I20260709 13:07:16.174340 21773 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 9, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 9 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:16.233060 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:16.233771 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:16.074395 25378 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:16.233280 21944 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:16.234369 21773 catalog_manager.cc:5697] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 5, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 5 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.239255 21987 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:16.227344 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.040788 24706 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:16.235841 22608 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.238679 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:16.162119 25395 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:16.243182 21946 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.046590 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.045635 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:16.023393 25432 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.252220 21875 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:16.308732 21838 leader_election.cc:336] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 3.039s (SENT)
I20260709 13:07:16.284658 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:16.243232 21773 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 8, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 8 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.268240 22021 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:16.285004 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:16.322978 22610 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.253468 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.266268 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.254632 21941 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:16.271479 25477 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.350054 25462 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:16.350486 25048 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:16.350911 25048 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:16.351157 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:16.351758 22019 raft_consensus.cc:2376] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7. Re-sending same reply.
I20260709 13:07:16.347079 25395 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.352828 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:16.353394 22024 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.354206 25395 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.321205 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:16.163013 25451 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.263584 25424 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:16.356864 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:16.326352 21773 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 6, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 6 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.357610 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:16.284416 25358 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:16.142213 25379 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.358852 21773 catalog_manager.cc:5697] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 5, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 5 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:16.267880 25304 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.360682 25379 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.361178 25304 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.361403 25468 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:16.347402 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:16.355827 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.360589 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:16.371002 21947 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:16.253232 25433 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.323367 24706 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:16.253028 25164 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.174851 25244 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:16.074630 25427 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.273545 25392 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.403043 25427 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:16.264142 25480 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.325866 22023 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:16.403147 25392 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.363281 25304 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:16.372203 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.395421 25407 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.376017 22608 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:16.360536 21773 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 7 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.378022 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.380071 21916 leader_election.cc:400] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:07:16.432327 21916 leader_election.cc:403] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:16.426417 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:16.380525 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 74668.2us
I20260709 13:07:16.433161 21773 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 10, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 10 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:16.434026 21942 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
W20260709 13:07:16.389127 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 220639us
I20260709 13:07:16.171193 25179 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.158s
I20260709 13:07:16.394582 25361 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:16.395056 21946 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:16.396021 24706 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:16.399235 25492 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:07:16.401348 25478 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:16.400259 25283 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:16.428357 25192 consensus_queue.cc:1243] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:16.236503 25440 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:16.367964 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:16.409107 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.296145 25472 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.419502 22024 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:16.350869 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.387423 25221 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.348145 25400 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.436069 25493 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.426597 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.384716 25381 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.434746 21773 catalog_manager.cc:5697] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 7 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:16.494086 21773 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 8, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 8 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:16.433080 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 53203.9us
I20260709 13:07:16.384991 25477 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:16.438588 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 719) took 1036 ms. Trace:
I20260709 13:07:16.500689 22606 rpcz_store.cc:276] 0709 13:07:15.401931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.402161 (+   230us) service_pool.cc:224] Handling call
0709 13:07:15.405936 (+  3775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.026320 (+620384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.438326 (+412006us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54002f80d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:16.438527 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242647808}
I20260709 13:07:16.438971 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.501914 21947 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
W20260709 13:07:16.441542 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.443137 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.504645 21946 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:16.413892 25379 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.446014 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 137342us
I20260709 13:07:16.444236 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:16.507884 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.390053 25424 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:16.382439 25218 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.450573 22016 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:16.530153 21948 raft_consensus.cc:2368] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6.
I20260709 13:07:16.531082 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:16.531805 21947 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.451719 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:16.458333 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.534797 21942 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:16.351701 25175 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.426251 22019 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:16.460827 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:16.535674 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:16.536338 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 75658.2us
I20260709 13:07:16.539008 25175 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:16.541323 22024 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:16.461643 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:16.536369 21942 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:16.449877 25364 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:07:16.462868 25265 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.448890 25478 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:16.467550 25348 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.468909 25440 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:16.351761 25048 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.470221 24706 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.471783 25450 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:16.473937 25392 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:16.474890 25395 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:16.475309 25427 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:16.476696 25244 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.481516 25468 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:16.390220 25433 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.570215 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:16.529160 25317 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:16.443794 25336 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
W20260709 13:07:16.509420 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 65294.9us
I20260709 13:07:16.511644 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.544643 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:16.511444 25378 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:16.500727 25381 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.550412 21945 raft_consensus.cc:2368] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8.
I20260709 13:07:16.542843 25164 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:07:16.544375 25361 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:16.576785 25048 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.529186 25179 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.612972 25179 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:16.613998 25179 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:16.556280 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:16.616876 25440 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.617497 21867 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:16.556761 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:16.621591 21874 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:16.559136 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.559608 21947 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:16.623378 21950 raft_consensus.cc:2410] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:16.623466 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.624732 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.625403 21947 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:16.562067 25450 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:16.558945 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:16.626502 21871 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.508176 25409 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:16.627259 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.564420 25395 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:16.600512 25472 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.628171 21942 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:16.547603 25265 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:16.570937 21868 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:16.496343 21773 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 8, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 8 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:16.581269 21946 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:16.543032 25192 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:07:16.583113 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:16.591651 21841 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.513s (SENT)
I20260709 13:07:16.628398 25395 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.630327 25395 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.630162 25265 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.631695 25265 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.632853 25478 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.633496 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.634516 25478 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.635842 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:16.603612 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:16.607578 25381 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.608054 25413 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:16.626852 25378 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:16.564977 25328 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.510900 25379 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.635131 21773 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 8, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 8 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:16.634488 21946 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:16.639849 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56829.5us
I20260709 13:07:16.639021 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.641129 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.644698 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:16.685357 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.686208 21948 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:16.645757 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.686292 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:16.647373 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1312) took 1092 ms. Trace:
I20260709 13:07:16.687129 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:16.652773 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:16.688632 21866 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:16.557798 25348 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:16.662331 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 283495us
I20260709 13:07:16.689007 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:16.691022 21950 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:16.687394 21945 rpcz_store.cc:276] 0709 13:07:15.555128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.555270 (+   142us) service_pool.cc:224] Handling call
0709 13:07:16.647121 (+1091851us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b5400278dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:16.647297 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197467008}
I20260709 13:07:16.691175 22607 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:16.692337 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:16.661224 25424 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.696803 25364 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:16.697813 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.715461 21949 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:16.697917 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.665612 25361 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:16.698758 25494 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:07:16.699620 25379 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.679425 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.733932 21942 raft_consensus.cc:2376] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8. Re-sending same reply.
I20260709 13:07:16.735728 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:16.705307 25498 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:07:16.705587 25221 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:16.705706 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.706732 25413 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.706872 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 115294us
I20260709 13:07:16.707139 25325 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:16.707911 21838 leader_election.cc:336] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.703s (SENT)
I20260709 13:07:16.708415 25501 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:16.708894 25164 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:16.628189 25472 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.718449 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:16.719413 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.605526 25387 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:07:16.724016 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:16.732051 21773 catalog_manager.cc:5697] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 6, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 6 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.734115 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:16.640332 25477 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:17.131699 25048 consensus_meta.cc:287] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.002s
I20260709 13:07:16.648716 25392 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.894477 25500 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.813746 25192 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.149096 25500 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:16.720774 25218 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.147706 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:16.685029 25328 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:16.936138 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.919600 21839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.025s
I20260709 13:07:16.716794 21947 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:16.744061 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:17.171756 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:17.172019 21950 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:07:16.899384 22610 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:16.817214 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:16.743587 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51340.9us
I20260709 13:07:16.745420 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:17.173197 21942 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:16.856956 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:17.170245 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.001s	sys 0.025s
I20260709 13:07:17.173982 22608 raft_consensus.cc:2368] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:07:16.758562 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:16.899384 21871 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:17.174765 21946 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:17.173995 21945 raft_consensus.cc:2410] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:17.175872 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.149953 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:17.171379 22601 raft_consensus.cc:2410] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:07:17.175343 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.170213 21773 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 7 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:17.177129 21866 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:16.861585 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1313) took 1306 ms. Trace:
I20260709 13:07:17.178819 21943 rpcz_store.cc:276] 0709 13:07:15.555435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.555572 (+   137us) service_pool.cc:224] Handling call
0709 13:07:16.861315 (+1305743us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540032a354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:16.861509 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592214400}
I20260709 13:07:16.753384 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:17.004534 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.183588 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.180932 21773 catalog_manager.cc:5697] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:07:16.785981 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.170169 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:16.745348 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:17.187372 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.165014 21841 leader_election.cc:336] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.545s (SENT)
I20260709 13:07:17.185724 21773 catalog_manager.cc:5697] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 7 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:17.172083 22607 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:17.169775 21949 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:17.194543 21946 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:17.195184 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2010) took 1315 ms. Trace:
W20260709 13:07:17.195760 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 487845us
W20260709 13:07:17.196307 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 462218us
I20260709 13:07:17.197567 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:17.195494 21946 rpcz_store.cc:276] 0709 13:07:15.879754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.193957 (+1314203us) service_pool.cc:224] Handling call
0709 13:07:17.194246 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.194953 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.195131 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.197182 21987 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:17.201363 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:17.138736 25179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.003s
I20260709 13:07:16.719727 25407 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.237231 21946 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:17.237964 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1334) took 1161 ms. Trace:
I20260709 13:07:17.238332 21946 rpcz_store.cc:276] 0709 13:07:16.076288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.236714 (+1160426us) service_pool.cc:224] Handling call
0709 13:07:17.237065 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.237697 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.237905 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.206890 21773 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:07:17.241667 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 67302.4us
I20260709 13:07:17.245652 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:16.786937 25283 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:17.263201 22610 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:16.813344 25411 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.272419 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:17.273097 22603 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:17.276026 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:17.276592 22016 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.907605 25381 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:16.731072 25361 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:07:17.140796 25393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.022s
W20260709 13:07:17.279109 25393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.012s	sys 0.026s
I20260709 13:07:17.279222 21941 raft_consensus.cc:2368] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5.
I20260709 13:07:17.163471 25480 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.280788 21941 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.282140 21941 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:17.283830 25501 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.272437 21949 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.285006 22019 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:16.815770 25379 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.285354 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1335) took 1027 ms. Trace:
I20260709 13:07:17.285810 25509 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.285652 22574 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:17.286509 25509 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:17.287596 24706 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.193872 25413 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.285725 21949 rpcz_store.cc:276] 0709 13:07:16.257847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.237536 (+979689us) service_pool.cc:224] Handling call
0709 13:07:17.272277 (+ 34741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.285140 (+ 12863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.285305 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.239900 21946 pending_rounds.cc:85] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 2
I20260709 13:07:16.908531 25433 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:17.264194 21948 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:17.266215 21943 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.296844 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.300981 21872 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:17.165427 25378 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:17.202664 25400 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.279439 25361 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:17.256500 21874 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.336939 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:17.337532 21872 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.286818 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:17.202934 25424 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:17.339440 22609 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.257818 21987 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:17.240322 25468 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.288924 21946 pending_rounds.cc:107] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:07:17.345199 21946 raft_consensus.cc:2889] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.289793 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:17.175191 25325 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:17.291146 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:17.350402 21872 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:17.279984 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:17.260898 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.294828 22610 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:17.297263 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1320) took 1413 ms. Trace:
I20260709 13:07:17.353263 21943 rpcz_store.cc:276] 0709 13:07:15.884181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.198785 (+1314604us) service_pool.cc:224] Handling call
0709 13:07:17.264964 (+ 66179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.297055 (+ 32091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.297216 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:16.742720 25451 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:17.296881 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2012) took 1409 ms. Trace:
W20260709 13:07:17.302157 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 126108us
I20260709 13:07:17.316025 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:17.257757 25179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.015s	sys 0.006s
I20260709 13:07:17.318046 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.271070 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:17.321484 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:17.149395 25192 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:17.326225 21950 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:17.326094 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:17.203157 25048 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:17.326823 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 128853us
W20260709 13:07:17.408761 21838 leader_election.cc:336] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.906s (SENT)
I20260709 13:07:17.409299 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:16.721606 25432 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.414180 25432 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:17.414937 22020 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.417115 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2584) took 1394 ms. Trace:
I20260709 13:07:17.417537 22020 rpcz_store.cc:276] 0709 13:07:16.023062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.023533 (+   471us) service_pool.cc:224] Handling call
0709 13:07:16.023853 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.415456 (+1391603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.416849 (+  1393us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000df2d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:17.417053 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198713600}
I20260709 13:07:17.328727 21945 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:17.419636 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1344) took 1072 ms. Trace:
I20260709 13:07:17.329423 22016 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:17.236776 25440 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:17.288023 24706 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.421125 24706 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.341261 22607 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:17.343499 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 442) took 1012 ms. Trace:
I20260709 13:07:17.423738 21949 rpcz_store.cc:276] 0709 13:07:16.331143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.288910 (+957767us) service_pool.cc:224] Handling call
0709 13:07:17.342970 (+ 54060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.343153 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.343182 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.343229 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.343266 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.343321 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.343437 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.266018 25244 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.424906 25244 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.426008 25381 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.426949 25381 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:17.427343 25244 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.356058 22608 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:17.299551 25348 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.420012 21945 rpcz_store.cc:276] 0709 13:07:16.347696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.323171 (+975475us) service_pool.cc:224] Handling call
0709 13:07:17.323466 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.419353 (+ 95887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.419567 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.430939 21945 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:17.431315 21945 pending_rounds.cc:85] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 6
I20260709 13:07:17.431551 21945 pending_rounds.cc:107] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:17.431792 21945 raft_consensus.cc:2889] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.434821 24706 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.397109 25524 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.438400 25524 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.438763 25524 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.989813 25450 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:17.359365 21948 rpcz_store.cc:276] 0709 13:07:15.887132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.194717 (+1307585us) service_pool.cc:224] Handling call
0709 13:07:17.252621 (+ 57904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.296652 (+ 44031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.296830 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:17.393621 21914 connection.cc:256] RPC call timeout handler was delayed by -2.2816630629999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:07:17.445710 21914 connection.cc:256] RPC call timeout handler was delayed by -2.0305630629999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:07:17.446079 21914 connection.cc:256] RPC call timeout handler was delayed by -1.8298630629999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 13:07:17.446367 21914 connection.cc:256] RPC call timeout handler was delayed by -1.8208630629999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:07:17.446640 21914 connection.cc:256] RPC call timeout handler was delayed by -1.7776630629999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
I20260709 13:07:17.447592 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:17.393851 21869 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.448386 25365 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.392771 21875 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.193364 25164 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.454147 25218 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:17.395628 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2014) took 1083 ms. Trace:
I20260709 13:07:17.455333 21950 rpcz_store.cc:276] 0709 13:07:16.312630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.252964 (+940334us) service_pool.cc:224] Handling call
0709 13:07:17.326007 (+ 73043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.395353 (+ 69346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.395571 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.149979 25500 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:17.393216 21867 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:17.285629 25379 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.284392 25501 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:17.268324 25364 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
W20260709 13:07:17.359899 25395 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.729s	user 0.013s	sys 0.003s
I20260709 13:07:17.339032 25283 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:17.423179 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:17.574536 21868 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.437530 24706 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.443378 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:17.378360 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.576929 21948 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:17.577267 21872 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:17.461462 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 444) took 1107 ms. Trace:
I20260709 13:07:17.432528 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2020) took 1062 ms. Trace:
I20260709 13:07:17.489212 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:17.577836 21947 rpcz_store.cc:276] 0709 13:07:16.354174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.405435 (+1051261us) service_pool.cc:224] Handling call
0709 13:07:17.460965 (+ 55530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.461126 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.461151 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.461202 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:17.461232 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.461282 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.461386 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:17.578560 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 90098.6us
I20260709 13:07:17.579178 21870 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:17.579510 21870 pending_rounds.cc:85] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 5
I20260709 13:07:17.579595 21914 leader_election.cc:400] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:07:17.579756 21870 pending_rounds.cc:107] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:17.580049 21870 raft_consensus.cc:2889] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:17.492224 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 234212us
W20260709 13:07:17.526610 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 240685us
I20260709 13:07:17.581404 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:17.577951 21945 rpcz_store.cc:276] 0709 13:07:16.370302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.430112 (+1059810us) service_pool.cc:224] Handling call
0709 13:07:17.430595 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.432266 (+  1671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.432462 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:17.339681 25378 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.357371 25468 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.586174 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.528895 22609 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:17.529312 21869 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:07:17.546413 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.589490 25283 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:17.590224 25518 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
W20260709 13:07:17.591711 25517 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:07:17.593415 21868 raft_consensus.cc:2410] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:17.593348 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:17.593883 25192 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.594031 21869 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.594336 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.462762 25509 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.557688 21875 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:17.548836 21874 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:17.406472 25048 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.610638 25048 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:17.442034 25361 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.357059 25424 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.583714 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:17.584407 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:17.477593 25164 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:17.587385 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:17.528625 21841 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.603s (SENT)
I20260709 13:07:17.568707 25493 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.561125 25440 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:17.601958 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:17.397557 25451 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:17.606449 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 360881us
I20260709 13:07:17.553755 25392 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:17.601095 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 200844us
I20260709 13:07:17.440932 25265 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.575163 25480 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:17.576663 25393 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.722601 21868 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.721619 21872 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:17.723274 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 194707us
W20260709 13:07:17.757153 21841 leader_election.cc:336] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.881s (SENT)
I20260709 13:07:17.757591 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:17.758880 21841 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.928s (SENT)
I20260709 13:07:17.759370 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:17.727869 21869 raft_consensus.cc:2410] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:17.714461 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 112467us
I20260709 13:07:17.761888 25283 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:17.762883 21839 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:17.601766 25395 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:17.612792 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.663072 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:17.635195 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.586501 25348 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.581589 25500 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.654417 25526 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:17.761544 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 177202us
I20260709 13:07:17.733064 21867 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:17.764426 21841 leader_election.cc:336] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.027s (SENT)
W20260709 13:07:17.843096 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 399744us
I20260709 13:07:17.606437 25407 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:17.848318 21868 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:17.786561 24706 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.920849 24706 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.849820 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.921975 21872 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 4.
W20260709 13:07:17.852245 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.853251 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.863547 22021 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:17.885977 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 147437us
W20260709 13:07:17.887524 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 130392us
W20260709 13:07:17.889901 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 127099us
I20260709 13:07:17.924264 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:17.890203 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1831) took 1310 ms. Trace:
I20260709 13:07:17.713517 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.604384 25505 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:17.913853 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:17.916285 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 155688us
W20260709 13:07:17.947000 21841 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.253s (SENT)
I20260709 13:07:17.947456 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:17.754281 25265 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.919324 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.924494 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:17.736354 25164 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:17.611639 25506 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.303s
I20260709 13:07:17.925192 21875 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:17.925606 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:17.935611 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:17.924957 21870 rpcz_store.cc:276] 0709 13:07:16.579872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.580147 (+   275us) service_pool.cc:224] Handling call
0709 13:07:16.580551 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.580451 (+999900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.889972 (+309521us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b540044d254. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:17.890141 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295888640}
I20260709 13:07:17.950235 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.950966 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:17.999895 21872 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:17.753715 25413 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:17.603998 25432 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.296s
I20260709 13:07:17.952207 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:18.017268 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64182.1us
I20260709 13:07:18.001808 21945 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:18.018487 21944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.013s	sys 0.017s
I20260709 13:07:17.996701 24706 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:18.018877 21944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.013s	sys 0.018s
W20260709 13:07:17.966231 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.018091 21916 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:17.747877 25509 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.201s
I20260709 13:07:18.031890 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.006675 21866 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:17.580863 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:18.034601 21949 raft_consensus.cc:606] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:18.037781 22020 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:18.041862 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:17.919904 25511 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.762506 25283 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.775120 25480 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:17.922820 25365 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:17.843173 25521 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.306s
I20260709 13:07:18.056087 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.056869 21868 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
W20260709 13:07:18.051640 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 116904us
I20260709 13:07:17.600565 25325 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.106969 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2009) took 2254 ms. Trace:
I20260709 13:07:18.107436 25325 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.107381 21944 rpcz_store.cc:276] 0709 13:07:15.852817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.198397 (+1345580us) service_pool.cc:224] Handling call
0709 13:07:17.255153 (+ 56756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.255674 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.255728 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.296333 (+ 40605us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.020875 (+724542us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:18.020936 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.021740 (+   804us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.106774 (+ 85034us) raft_consensus.cc:1685] finished
0709 13:07:18.106793 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.106914 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17105,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"thread_start_us":578571,"threads_started":1,"wal-append.queue_time_us":721055}
I20260709 13:07:17.935101 25526 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:18.108676 25179 consensus_queue.cc:1175] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 10 status { last_received { term: 7 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.5-9.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:18.110932 25526 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:18.111514 25526 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.111862 25526 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.112191 25526 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:18.070051 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 145834us
I20260709 13:07:17.748467 25493 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.117321 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:18.021168 25265 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.080580 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:18.072252 25511 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:18.069744 25515 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.772s	user 0.000s	sys 0.001s
I20260709 13:07:17.915310 25524 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.099457 25365 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:18.100837 25522 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:07:18.104938 25543 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:18.105849 25541 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.115993 25537 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:18.141036 25511 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.938524 25472 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:17.952756 25364 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:18.125327 21869 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:18.128008 22022 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.088439 21875 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:07:18.129756 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 182783us
I20260709 13:07:18.116326 25164 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:18.189680 22017 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 10. Ops: []
W20260709 13:07:18.135244 22576 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.566s (SENT)
I20260709 13:07:18.205225 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:18.206072 24706 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:18.206269 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 71053.3us
I20260709 13:07:18.072023 25525 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:18.030049 25407 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
W20260709 13:07:18.145948 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 221524us
I20260709 13:07:18.142794 25506 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:17.997422 25505 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.068729 25413 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:07:18.162204 21868 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:18.164093 21870 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:18.169049 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 51825us
I20260709 13:07:18.134326 25348 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.169373 21872 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:18.170305 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 443) took 1816 ms. Trace:
I20260709 13:07:18.174649 25509 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:18.106163 25546 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:17.775552 25393 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:18.156971 25411 consensus_meta.cc:287] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.885s	user 0.005s	sys 0.005s
W20260709 13:07:18.204391 21841 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.329s (SENT)
W20260709 13:07:18.133782 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.179419 25379 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.209587 21869 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:18.153935 21866 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:18.215323 22021 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:18.226214 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:18.176771 25218 consensus_queue.cc:1243] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:18.171296 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 448) took 1024 ms. Trace:
I20260709 13:07:18.093806 25440 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.177007 25541 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.296027 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2592) took 1090 ms. Trace:
W20260709 13:07:18.217710 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 160732us
I20260709 13:07:18.470604 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:18.325083 22022 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:07:18.415899 21871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.009s	sys 0.023s
W20260709 13:07:18.310907 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.526602 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.527853 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2427) took 1232 ms. Trace:
I20260709 13:07:18.585181 21870 rpcz_store.cc:276] 0709 13:07:17.295256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.105313 (+810057us) service_pool.cc:224] Handling call
0709 13:07:18.163736 (+ 58423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.224897 (+ 61161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.527645 (+302748us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b54001d7ed0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:18.527792 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133635456}
I20260709 13:07:18.583489 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2441) took 1159 ms. Trace:
W20260709 13:07:18.587361 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 116884us
I20260709 13:07:18.545922 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2023) took 1290 ms. Trace:
W20260709 13:07:18.588032 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 361873us
I20260709 13:07:18.588441 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:18.246287 21943 rpcz_store.cc:276] 0709 13:07:16.353841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.358919 (+1005078us) service_pool.cc:224] Handling call
0709 13:07:17.403195 (+ 44276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.903989 (+500794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.904036 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.904101 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:17.904154 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.170033 (+265879us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540032a854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:18.170087 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.170235 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144226688}
W20260709 13:07:18.576985 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 362574us
W20260709 13:07:18.590334 21867 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.001s
I20260709 13:07:18.591012 21867 raft_consensus.cc:2410] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:18.577821 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2446) took 1143 ms. Trace:
I20260709 13:07:18.588110 21948 rpcz_store.cc:276] 0709 13:07:17.255158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.888812 (+633654us) service_pool.cc:224] Handling call
0709 13:07:17.889127 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.144514 (+255387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.144556 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.157317 (+ 12761us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.418054 (+260737us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:18.418092 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.418161 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.545640 (+127479us) raft_consensus.cc:1685] finished
0709 13:07:18.545666 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.545826 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136129,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":33597,"thread_start_us":456898,"threads_started":2,"wal-append.queue_time_us":367425}
W20260709 13:07:18.581442 21871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.013s	sys 0.028s
I20260709 13:07:18.606985 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 532) took 1389 ms. Trace:
I20260709 13:07:18.607427 21871 rpcz_store.cc:276] 0709 13:07:17.218038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.218261 (+   223us) service_pool.cc:224] Handling call
0709 13:07:17.283807 (+ 65546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.284000 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:17.459315 (+175315us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.606637 (+1147322us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.606691 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:18.606733 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.606803 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.606931 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":627943,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"thread_start_us":1321892,"threads_started":2,"wal-append.queue_time_us":1089882}
W20260709 13:07:18.577450 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 373070us
I20260709 13:07:18.587106 21866 rpcz_store.cc:276] 0709 13:07:17.425101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.153104 (+728003us) service_pool.cc:224] Handling call
0709 13:07:18.153502 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.582146 (+428644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.583428 (+  1282us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:18.416992 25530 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.505s	user 0.000s	sys 0.001s
I20260709 13:07:18.417270 25179 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:18.611279 25179 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:18.612438 25512 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:18.612907 25512 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:18.613094 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2011) took 2726 ms. Trace:
I20260709 13:07:18.613464 25540 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.613719 25512 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.613978 25540 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.613631 21942 rpcz_store.cc:276] 0709 13:07:15.886828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.196949 (+1310121us) service_pool.cc:224] Handling call
0709 13:07:17.253329 (+ 56380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.253663 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.253692 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.296040 (+ 42348us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.472767 (+176727us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.472805 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.472873 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.612896 (+1140023us) raft_consensus.cc:1685] finished
0709 13:07:18.612918 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.613041 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18767,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":70963,"threads_started":1,"wal-append.queue_time_us":260369}
I20260709 13:07:18.582911 25433 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.612179 25179 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.535009 25328 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:18.615816 25433 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.616381 25179 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.616746 25328 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.617054 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.617297 25328 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:18.541980 25516 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.593s	user 0.002s	sys 0.000s
I20260709 13:07:18.619383 25433 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:18.612432 25192 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.620769 25192 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.621671 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:18.622766 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 567) took 1958 ms. Trace:
I20260709 13:07:18.622885 25192 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:18.620983 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:18.498430 25533 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 13:07:18.624025 21874 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:18.623178 22606 rpcz_store.cc:276] 0709 13:07:16.664781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.664953 (+   172us) service_pool.cc:224] Handling call
0709 13:07:16.693526 (+ 28573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.693996 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.694041 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.694740 (+   699us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.975953 (+281213us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:16.976013 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.976108 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.541321 (+1565213us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:18.622493 (+ 81172us) raft_consensus.cc:1685] finished
0709 13:07:18.622513 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.622685 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":78802688,"thread_start_us":280715,"threads_started":1,"wal-append.queue_time_us":916896}
I20260709 13:07:18.625293 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:18.616312 25540 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:18.626636 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:18.627146 25379 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:18.626139 22601 raft_consensus.cc:2410] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:18.628890 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2015) took 2316 ms. Trace:
I20260709 13:07:18.622952 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:18.200717 25244 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:18.615689 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:18.594339 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.609386 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.628228 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:18.656899 22607 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:18.629240 21946 rpcz_store.cc:276] 0709 13:07:16.312977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.239229 (+926252us) service_pool.cc:224] Handling call
0709 13:07:17.239654 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:17.400264 (+160610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.400308 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:17.401052 (+   744us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.728681 (+327629us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:17.728722 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.728789 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.628663 (+899874us) raft_consensus.cc:1685] finished
0709 13:07:18.628685 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.628836 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26508,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":156013,"threads_started":1,"wal-append.queue_time_us":469396}
I20260709 13:07:18.605544 21869 rpcz_store.cc:276] 0709 13:07:17.435085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.203545 (+768460us) service_pool.cc:224] Handling call
0709 13:07:18.203933 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.577516 (+373583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.577743 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:18.660706 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:18.631850 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 43492.2us
W20260709 13:07:18.591722 21867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2434) took 1178 ms (client timeout 1501 ms). Trace:
W20260709 13:07:18.662521 21867 rpcz_store.cc:269] 0709 13:07:17.414000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.563113 (+149113us) service_pool.cc:224] Handling call
0709 13:07:18.591642 (+1028529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:18.662810 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:18.632740 21873 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.630307 21872 raft_consensus.cc:2376] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7. Re-sending same reply.
I20260709 13:07:18.577257 21950 rpcz_store.cc:276] 0709 13:07:17.146553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.887752 (+741199us) service_pool.cc:224] Handling call
0709 13:07:17.888092 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.952907 (+ 64815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.952938 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.952981 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:17.953013 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.171038 (+218025us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b54003d2054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:18.171091 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.171232 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148606208}
I20260709 13:07:18.660768 21839 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:18.644467 22021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2595) took 1413 ms (client timeout 1501 ms). Trace:
I20260709 13:07:18.590921 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:18.668342 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:18.325811 25535 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:07:18.615109 25512 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.216176 25550 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:18.661465 22020 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:18.670655 22603 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:18.668753 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:18.627828 25450 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:18.670769 22021 rpcz_store.cc:269] 0709 13:07:17.209010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.209922 (+   912us) service_pool.cc:224] Handling call
0709 13:07:18.622022 (+1412100us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54001f04d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:18.622128 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189799808}
I20260709 13:07:18.674690 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.255348 25413 consensus_queue.cc:1243] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:18.675850 22019 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:18.434688 25510 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.483s	user 0.000s	sys 0.001s
W20260709 13:07:18.687877 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.674844 21841 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.501s (SENT)
I20260709 13:07:18.266655 25164 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:18.495154 25554 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.484095 25521 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.539255 25531 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:07:18.628381 25379 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.543780 25480 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.553449 25378 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.538748 25501 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:18.688632 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 97751.4us
I20260709 13:07:18.688941 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:18.726327 22016 raft_consensus.cc:2368] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:07:18.682480 21944 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:18.726564 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:18.683189 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.687656 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:18.353881 25451 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.691583 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:18.523157 25493 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:18.212857 25364 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.434109 25468 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.436123 25529 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.619396 25328 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:18.663825 25478 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:18.737545 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:18.738371 22022 raft_consensus.cc:2368] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10.
I20260709 13:07:18.741921 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.742830 22020 raft_consensus.cc:2410] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:18.743438 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.744298 21944 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:18.744292 21838 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:18.708189 25524 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:18.704213 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:18.660255 25221 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.260681 25538 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:18.709590 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.750718 21948 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:18.715760 25393 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:18.716391 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.682461 25550 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:18.718045 25379 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.669670 25218 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:18.525233 25505 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.720225 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 441) took 2389 ms. Trace:
I20260709 13:07:18.625319 25542 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:18.492971 25283 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.680918 25433 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.578552 22023 rpcz_store.cc:276] 0709 13:07:17.205595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.206131 (+   536us) service_pool.cc:224] Handling call
0709 13:07:17.274707 (+ 68576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.275007 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.275036 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.275461 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.354935 (+ 79474us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.354992 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.355062 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.295710 (+940648us) raft_consensus.cc:1685] finished
0709 13:07:18.295745 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.295939 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3845,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":79146,"threads_started":1,"wal-append.queue_time_us":301817}
I20260709 13:07:18.732291 22018 raft_consensus.cc:2410] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:18.674240 25348 raft_consensus.cc:697] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:18.699443 25400 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.699679 25192 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.345059 25424 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.702612 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.724006 25381 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.751716 21871 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:18.751768 21838 leader_election.cc:400] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5.
I20260709 13:07:18.809636 21838 leader_election.cc:403] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:07:18.751904 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 60407.4us
I20260709 13:07:18.753296 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.811385 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:18.742861 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:18.756969 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.724103 25558 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:18.816036 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.816125 25558 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:18.816970 25558 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:18.817373 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.817553 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.818216 22018 raft_consensus.cc:2410] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:18.818786 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.818969 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.819502 22018 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:18.819913 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.670349 25244 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.821321 22020 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:18.768347 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.822572 21948 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:18.764062 21941 rpcz_store.cc:276] 0709 13:07:16.330782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.284344 (+953562us) service_pool.cc:224] Handling call
0709 13:07:17.284613 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.315808 (+ 31195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.315838 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.407274 (+ 91436us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b2c00010da8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:07:17.448960 (+ 41686us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.608660 (+159700us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:17.891089 (+282429us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.051446 (+160357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.052289 (+   843us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.719906 (+667617us) raft_consensus.cc:1685] finished
0709 13:07:18.720014 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.720169 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7426,"prepare.queue_time_us":531510,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":187972,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":56020,"spinlock_wait_cycles":9352448,"thread_start_us":535388,"threads_started":3,"wal-append.queue_time_us":810715}
I20260709 13:07:18.823635 25244 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:18.735736 25541 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:18.824291 25365 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:18.820289 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.786201 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.824862 25365 raft_consensus.cc:697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:18.825230 21944 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:18.772725 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.750355 25501 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:18.749864 25468 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.723829 25336 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:07:18.825742 25560 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:18.826156 25468 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:18.826591 25468 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.797907 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:18.829054 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 82514.3us
I20260709 13:07:18.719506 25521 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.831208 25521 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:18.831840 25538 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.832970 25555 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:18.814405 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.833861 25555 raft_consensus.cc:3055] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:18.833971 22023 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:18.834240 25555 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:18.759662 25451 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:18.834868 25451 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:18.835315 25451 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.835076 25555 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.836279 25555 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.816358 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:18.767475 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 135935us
I20260709 13:07:18.824414 25547 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:18.812989 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70204.2us
I20260709 13:07:18.841895 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:18.842518 25521 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:18.840265 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.843632 25364 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:18.761106 25393 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.852274 22603 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:18.859071 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.867511 22018 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:18.861536 22574 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:18.862704 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51417.6us
I20260709 13:07:18.870724 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:18.820497 22021 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:18.876187 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.880177 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:18.881132 21950 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:18.882424 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:18.884979 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 186755us
I20260709 13:07:18.775873 25221 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:18.886034 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.719763 25554 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:18.889055 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.620s (SENT) [suppressed 46 similar messages]
I20260709 13:07:18.876313 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:18.897534 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.898425 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:18.801972 25192 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.878109 21943 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:18.908708 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.917249 22021 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
W20260709 13:07:18.921438 21841 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.288s (SENT)
I20260709 13:07:18.923180 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:18.744644 25529 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.858932 25244 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.924504 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:18.921922 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:18.930663 21841 leader_election.cc:336] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.529s (SENT)
I20260709 13:07:18.931250 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:18.925442 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:18.933156 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 89647.1us
I20260709 13:07:18.862006 25521 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:18.940025 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:18.940219 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:18.940712 21872 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.941109 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:18.942749 21866 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:18.897305 25336 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.803071 25433 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.763007 25563 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
W20260709 13:07:18.935114 25361 consensus_meta.cc:287] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.189s	user 0.010s	sys 0.003s
W20260709 13:07:18.920054 25500 consensus_meta.cc:287] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.005s	user 0.012s	sys 0.000s
W20260709 13:07:18.957768 21841 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.873s (SENT)
I20260709 13:07:18.981109 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.918614 25218 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:18.919657 25192 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.966156 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:18.935705 25493 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:18.825804 25365 consensus_queue.cc:237] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.967259 25221 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.928756 25562 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:18.955245 25348 consensus_queue.cc:237] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:18.940757 21867 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:18.975875 21941 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:19.016932 21941 pending_rounds.cc:85] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 5
I20260709 13:07:19.017220 21941 pending_rounds.cc:107] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:19.017416 21942 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:19.017526 21941 raft_consensus.cc:2889] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:18.977259 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 101019us
I20260709 13:07:18.856357 25381 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.857460 25164 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.948560 25400 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.917850 25283 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:07:18.887472 25393 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:18.989470 25378 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.013087 22016 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:18.992178 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:18.948320 25537 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.011332 25493 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.018690 21873 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
W20260709 13:07:19.019114 21947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.006s	sys 0.007s
W20260709 13:07:19.033308 21947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.006s	sys 0.007s
I20260709 13:07:19.013672 25450 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:18.990348 25395 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.990123 22015 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:19.007477 21872 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:19.018697 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:18.981774 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:19.035291 25500 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:19.035441 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 77801.4us
W20260709 13:07:19.037040 21841 leader_election.cc:336] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.966s (SENT)
W20260709 13:07:19.013850 25048 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.240s	user 0.006s	sys 0.013s
I20260709 13:07:19.037964 25048 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:19.039780 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 115333us
I20260709 13:07:19.040396 25048 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:19.040891 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:18.989269 25480 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:19.030761 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 130150us
W20260709 13:07:19.020370 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 86389.4us
I20260709 13:07:19.041779 25480 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.034480 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 449) took 1005 ms. Trace:
I20260709 13:07:19.041085 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:19.042196 25480 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.042855 25500 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.042258 21947 rpcz_store.cc:276] 0709 13:07:18.028803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.045967 (+ 17164us) service_pool.cc:224] Handling call
0709 13:07:18.079787 (+ 33820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.080060 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:18.206782 (+126722us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.033902 (+827120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.033976 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.034051 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.034140 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.034398 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21922,"prepare.queue_time_us":128648,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":36,"raft.queue_time_us":117415,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":7010,"thread_start_us":892326,"threads_started":3,"wal-append.queue_time_us":474029}
W20260709 13:07:19.044552 25564 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:07:19.045217 21947 pending_rounds.cc:85] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 5
I20260709 13:07:19.045526 21947 pending_rounds.cc:107] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:07:19.045832 21947 raft_consensus.cc:2889] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.048328 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:19.053068 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.016345 25336 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:19.018368 25548 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.042348 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:19.033461 25325 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.925s	user 0.008s	sys 0.004s
I20260709 13:07:19.064073 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:18.946476 25244 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.076086 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:19.080549 22015 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.046082 25493 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.045747 25450 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:18.951781 25550 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.060348 25512 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:19.072620 25048 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:19.102021 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.073720 25179 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.083076 25336 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:19.110739 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.127045 22016 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:19.047761 25378 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.078743 25540 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.128937 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58692.6us
I20260709 13:07:19.129074 25179 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.102394 25512 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:19.106727 25500 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:07:19.055473 25395 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.106112 25407 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:19.131800 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.070170 25509 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:19.091188 25450 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.101948 25048 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.145303 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:19.167346 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:19.220635 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75389us
I20260709 13:07:19.074365 25548 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.144819 25179 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.241644 25451 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.228863 25544 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:19.252440 25544 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:19.253010 25568 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:07:19.253525 25544 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.254594 25544 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.237828 25550 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:19.242568 25536 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:07:19.243638 25512 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.222942 25336 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:19.109320 25379 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.144280 25540 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.222165 25048 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.317447 21949 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.367681 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:19.368259 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.369220 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:19.406168 21872 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:19.406462 22609 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:19.377698 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.370076 22603 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:19.409916 21873 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:19.399971 22015 raft_consensus.cc:2410] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:19.415668 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.416344 21874 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:19.419579 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:19.422678 25573 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
W20260709 13:07:19.423980 25577 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 13:07:19.424204 25558 consensus_meta.cc:287] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.607s	user 0.004s	sys 0.004s
W20260709 13:07:19.425464 25575 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.402s	user 0.001s	sys 0.001s
I20260709 13:07:19.364554 25393 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:19.426175 25393 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.427201 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:19.357451 25265 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.210s	user 0.011s	sys 0.000s
I20260709 13:07:19.437289 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:19.438519 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:19.362787 25572 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
W20260709 13:07:19.351696 25538 consensus_meta.cc:287] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.519s	user 0.002s	sys 0.005s
W20260709 13:07:19.343191 25581 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:07:19.359272 25585 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:07:19.432152 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 368160us
I20260709 13:07:19.519938 21914 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:19.434396 22024 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:19.521534 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:19.433215 21870 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:19.359732 25511 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.142s	user 0.007s	sys 0.002s
I20260709 13:07:19.439245 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:19.442548 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:19.527755 21943 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:19.442823 22021 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:19.312229 25578 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:19.450139 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:19.530750 22609 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 10: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:07:19.453761 25555 consensus_meta.cc:287] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.003s
I20260709 13:07:19.457233 25493 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.459049 25450 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.108001 25571 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.274479 22016 pending_rounds.cc:85] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 7
I20260709 13:07:19.553964 22016 pending_rounds.cc:107] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:19.554359 22016 raft_consensus.cc:2889] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.355955 25244 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:19.483397 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:19.316116 25433 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:19.255666 25381 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:19.516108 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:19.558038 22019 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:19.516710 21868 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:07:19.517278 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 53279.7us
I20260709 13:07:19.526598 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:19.528784 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:19.527297 22603 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:19.531152 21873 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:19.403409 25554 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:19.356300 25529 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:19.542097 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:19.544512 21871 raft_consensus.cc:2410] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:19.545019 21867 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:19.441035 25400 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:19.550959 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:19.539186 25547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.029s
I20260709 13:07:19.552769 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:19.553009 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.556684 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:19.580480 21875 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:19.536007 25562 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:19.571475 21873 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:19.431821 25393 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.576443 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:19.536739 25578 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.592897 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:19.593835 22015 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:19.585482 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:19.596174 22607 raft_consensus.cc:2410] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:19.474255 25265 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:19.589038 25547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.005s	sys 0.030s
I20260709 13:07:19.577283 25407 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:19.601296 25218 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:19.601649 25407 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:19.601931 25580 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:19.605568 25540 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:19.613758 25586 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:07:19.517899 25541 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:19.591754 22603 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:19.558264 25512 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.600615 25578 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:19.615058 22574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.012s
I20260709 13:07:19.600764 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2603) took 1001 ms. Trace:
W20260709 13:07:19.632266 22574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.005s	sys 0.012s
W20260709 13:07:19.632895 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 590751us
I20260709 13:07:19.436750 25558 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.529050 25538 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 4. Current term is 5.
W20260709 13:07:19.622601 21839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.008s
I20260709 13:07:19.559131 25571 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.641163 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.642297 21873 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:19.530246 25325 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:07:19.590104 25562 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:19.625789 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:19.632349 22017 rpcz_store.cc:276] 0709 13:07:18.599070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.640172 (+ 41102us) service_pool.cc:224] Handling call
0709 13:07:18.681167 (+ 40995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.681504 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.681532 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.681932 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.889570 (+207638us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:18.889630 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.889730 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.362076 (+472346us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:19.577668 (+215592us) raft_consensus.cc:1685] finished
0709 13:07:19.577698 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.600691 (+ 22993us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":11193,"spinlock_wait_cycles":7968640,"thread_start_us":152471,"threads_started":1,"wal-append.queue_time_us":269095}
I20260709 13:07:19.639580 22024 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:19.630179 21943 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:19.542960 25511 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:19.589282 25526 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.472s	user 0.007s	sys 0.007s
I20260709 13:07:19.648480 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:19.664367 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:19.665184 21875 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:19.640965 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.009s	sys 0.009s
I20260709 13:07:19.571151 21870 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:19.669102 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 611970us
I20260709 13:07:19.643424 22574 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:19.656546 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.670884 22574 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:19.672883 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:19.672765 22023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.010s	sys 0.012s
W20260709 13:07:19.668627 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.675464 22576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.015s
W20260709 13:07:19.675871 22576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.007s	sys 0.015s
W20260709 13:07:19.674713 22023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.010s	sys 0.012s
I20260709 13:07:19.682471 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.683890 21875 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:19.674422 22574 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:19.689926 21947 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:07:19.656762 25521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.003s	sys 0.017s
I20260709 13:07:19.645000 25571 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.632515 25529 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:07:19.655704 25562 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.695026 21945 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:19.655094 25574 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:19.701514 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.638778 25563 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 13:07:19.704787 22020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.016s	sys 0.013s
I20260709 13:07:19.692243 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:19.725828 22020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.016s	sys 0.013s
I20260709 13:07:19.726187 21875 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:19.727546 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.728415 21875 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:19.713192 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.640913 25381 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:19.685202 25567 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:19.685421 25244 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.721588 21870 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
W20260709 13:07:19.697178 25521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.003s	sys 0.017s
I20260709 13:07:19.684160 25218 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:19.741068 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.699115 25579 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:19.671396 25580 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:07:19.770607 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.832435 21875 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:19.833374 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.834190 21875 raft_consensus.cc:2410] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:19.834375 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.771039 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:19.834758 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.814333 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:19.835093 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.675115 25526 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:19.733103 25468 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.000s
I20260709 13:07:19.827134 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:19.644843 25336 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.714022 21869 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5.
W20260709 13:07:19.835439 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.836026 21870 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:19.841120 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.775835 25567 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.851707 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.776530 25244 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:19.857000 21988 connection.cc:256] RPC call timeout handler was delayed by -2.5953556040000194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 13:07:19.916029 21988 connection.cc:256] RPC call timeout handler was delayed by -1.9546457210000199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:07:19.916515 21988 connection.cc:256] RPC call timeout handler was delayed by -1.8799457210000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:07:19.916918 21988 connection.cc:256] RPC call timeout handler was delayed by -1.8187457210000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:07:19.917264 21988 connection.cc:256] RPC call timeout handler was delayed by -1.523545721000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 13:07:19.917613 21988 connection.cc:256] RPC call timeout handler was delayed by -1.4758457209999278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 13:07:19.919109 21988 leader_election.cc:400] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
I20260709 13:07:19.919582 21988 leader_election.cc:403] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.857300 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.887959 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:19.850149 25179 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.001s
I20260709 13:07:19.845551 25468 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.935804 22018 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:19.893397 25591 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:19.893802 25526 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:19.826058 25521 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:19.853888 25480 consensus_meta.cc:287] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.001s
I20260709 13:07:19.730216 25400 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:07:19.922499 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:19.930111 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.860903 25567 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:19.937810 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:19.929477 25164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.031s	sys 0.036s
I20260709 13:07:19.954022 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.963040 21943 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:19.838532 25218 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.969444 21947 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:19.971251 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.937481 25493 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:19.935241 25244 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.995932 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.997560 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:19.998250 25468 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:19.998973 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:20.000778 25521 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:20.001847 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:20.005321 25192 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.989s	user 0.011s	sys 0.000s
I20260709 13:07:20.005963 25192 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:19.976228 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:19.973273 25164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.031s	sys 0.036s
I20260709 13:07:19.981822 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:20.008997 21943 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:20.000234 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:19.972739 25393 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:19.984817 25540 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:19.985085 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:20.017213 25364 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:20.017660 25540 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:19.986418 25433 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.017722 25364 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.018319 25433 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:20.018445 25364 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.018795 25433 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:20.019017 25550 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.004s
I20260709 13:07:20.019691 21873 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:19.986788 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 64399.8us
I20260709 13:07:20.017889 21941 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:20.021154 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:20.022424 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:19.935690 25541 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7.
I20260709 13:07:19.979028 25542 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.990798 25407 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.978745 25555 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:20.040774 25555 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.041286 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:20.041934 22607 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.042508 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2030) took 1439 ms. Trace:
I20260709 13:07:20.023733 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:20.023675 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:20.042917 21945 rpcz_store.cc:276] 0709 13:07:18.603221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.603445 (+   224us) service_pool.cc:224] Handling call
0709 13:07:18.603892 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.716308 (+1112416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.042248 (+325940us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000fda54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:20.042446 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500787584}
I20260709 13:07:20.044857 25328 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.045357 25328 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:20.045746 25328 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.047114 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2450) took 1106 ms. Trace:
I20260709 13:07:20.047515 21869 rpcz_store.cc:276] 0709 13:07:18.940216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.940817 (+   601us) service_pool.cc:224] Handling call
0709 13:07:20.046948 (+1106131us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54003179d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:20.047056 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1651722624}
I20260709 13:07:20.048187 21948 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:20.048795 25542 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:20.051404 21945 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:20.051975 22607 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:19.930485 25450 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:20.053601 21839 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:20.052536 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:19.939281 25179 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:19.955159 25597 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:20.066347 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:20.078302 22603 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:19.965492 25480 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:20.125882 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 451479us
I20260709 13:07:20.040109 25192 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:20.159700 22603 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:20.190981 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:20.195013 21942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.000s	sys 0.014s
W20260709 13:07:20.197654 21942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.000s	sys 0.014s
I20260709 13:07:20.081439 25597 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:20.063556 25468 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.018707 25540 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.145412 25379 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:20.159363 25511 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:20.188913 25541 raft_consensus.cc:2764] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:20.028999 25524 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:20.219026 25579 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:20.207885 25555 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:20.231954 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 177008us
I20260709 13:07:20.194414 25432 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:20.215093 25265 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:20.194753 25542 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:20.247911 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:20.252063 21945 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:20.254068 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 350828us
W20260709 13:07:20.241007 25048 consensus_meta.cc:287] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.807s	user 0.012s	sys 0.001s
I20260709 13:07:20.231967 25558 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:20.383960 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.382042 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.384934 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.385334 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.379707 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 122446us
I20260709 13:07:20.390497 22608 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:20.398296 22016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.001s	sys 0.042s
W20260709 13:07:20.398892 22016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.002s	sys 0.042s
W20260709 13:07:20.400007 22576 leader_election.cc:336] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.871s (SENT)
I20260709 13:07:20.400776 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:20.403551 22576 leader_election.cc:336] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.953s (SENT)
I20260709 13:07:20.406224 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:20.400056 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1448) took 1420 ms. Trace:
I20260709 13:07:20.422045 22018 rpcz_store.cc:276] 0709 13:07:18.979831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.980759 (+   928us) service_pool.cc:224] Handling call
0709 13:07:20.399867 (+1419108us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000dd9d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:20.400004 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074328960}
W20260709 13:07:20.376809 25613 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:07:20.378173 25607 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:07:20.446130 25393 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:20.258991 25468 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:07:20.477240 25599 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
W20260709 13:07:20.479512 25602 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 13:07:20.479585 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1450) took 1412 ms. Trace:
I20260709 13:07:20.477942 25468 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:20.469770 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 73272.1us
I20260709 13:07:20.469846 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:20.398825 25192 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.446962 25048 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:20.417639 25544 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.163s	user 0.005s	sys 0.009s
W20260709 13:07:20.481223 25595 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.322s	user 0.000s	sys 0.000s
I20260709 13:07:20.488198 22606 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:20.489586 25179 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:20.480227 22020 rpcz_store.cc:276] 0709 13:07:19.066785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.072271 (+  5486us) service_pool.cc:224] Handling call
0709 13:07:19.072624 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.081712 (+  9088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.081757 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:19.105194 (+ 23437us) log.cc:844] Serialized 52 byte log entry
0709 13:07:19.726450 (+621256us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.775426 (+ 48976us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.775663 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.775753 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.479262 (+703509us) raft_consensus.cc:1685] finished
0709 13:07:20.479294 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.479503 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1427,"prepare.queue_time_us":87806,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":1153,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":37396,"thread_start_us":593713,"threads_started":1,"wal-append.queue_time_us":898080}
I20260709 13:07:20.414902 25493 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.415343 25541 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.378710 25432 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:07:20.498322 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:20.499574 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:20.500559 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:20.523185 21869 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:20.524574 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:20.450449 25614 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:20.511026 21875 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.399437 25524 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
W20260709 13:07:20.502614 25567 consensus_meta.cc:287] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:07:20.498253 25164 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:20.525009 25541 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:20.498555 25364 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:20.547802 25594 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.486s	user 0.002s	sys 0.000s
I20260709 13:07:20.575114 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:20.573398 22576 leader_election.cc:336] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.755s (SENT)
I20260709 13:07:20.581606 21948 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.581689 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:20.583811 25493 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:20.502378 25192 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:20.590067 22576 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.921s (SENT)
I20260709 13:07:20.594192 21948 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:07:20.595903 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 471858us
I20260709 13:07:20.596246 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:20.513450 25501 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:20.597685 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2608) took 1743 ms. Trace:
I20260709 13:07:20.598205 22023 rpcz_store.cc:276] 0709 13:07:18.854556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.854774 (+   218us) service_pool.cc:224] Handling call
0709 13:07:18.884187 (+ 29413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:18.906932 (+ 22745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:18.906975 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:18.949817 (+ 42842us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.679133 (+729316us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:19.679163 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.679213 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.597443 (+918230us) raft_consensus.cc:1685] finished
0709 13:07:20.597467 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.597614 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57854,"raft.queue_time_us":22389,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9813,"thread_start_us":704361,"threads_started":1,"wal-append.queue_time_us":1007757}
W20260709 13:07:20.600786 21988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.060s
W20260709 13:07:20.601286 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.012s	sys 0.060s
W20260709 13:07:20.602227 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 578339us
W20260709 13:07:20.606365 22576 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.049s (SENT)
I20260709 13:07:20.606930 21948 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:20.607036 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:20.608465 21945 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:20.577086 25480 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:20.610061 21869 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.589617 25624 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:20.615348 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:20.501646 25579 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:20.611763 22576 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.136s (SENT)
I20260709 13:07:20.619210 21987 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:20.600451 25544 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.552591 25567 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.620077 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:20.605342 25179 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.503589 25597 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.623955 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:20.621572 21869 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
W20260709 13:07:20.614250 25608 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:20.571818 25164 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.611275 25493 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.623660 25506 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.628561 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.629259 22023 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:20.629532 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.630748 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:20.631369 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.548424 25614 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.620055 25605 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.638276 22610 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:20.632475 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:20.632035 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.630722 25478 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:20.637619 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:20.618641 25624 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:20.622999 25480 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:07:20.645450 25433 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260709 13:07:20.624174 25606 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.646742 21948 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:20.627638 25603 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.386s	user 0.001s	sys 0.001s
I20260709 13:07:20.650447 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.677105 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.677893 22022 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
W20260709 13:07:20.680217 25616 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:20.680480 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2035) took 1976 ms. Trace:
I20260709 13:07:20.681051 21950 rpcz_store.cc:276] 0709 13:07:18.704692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.893232 (+188540us) service_pool.cc:224] Handling call
0709 13:07:18.893688 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.070732 (+177044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.070763 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.074634 (+  3871us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.344935 (+270301us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b4800002dd8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:07:19.483895 (+138960us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:19.483954 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.680080 (+1196126us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b5400299854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:20.680145 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.680208 (+    63us) raft_consensus.cc:1685] finished
0709 13:07:20.680227 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.680407 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41606,"raft.queue_time_us":94997,"raft.run_cpu_time_us":2580,"raft.run_wall_time_us":312467,"spinlock_wait_cycles":114802432,"thread_start_us":473023,"threads_started":2,"wal-append.queue_time_us":658086}
I20260709 13:07:20.682801 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2047) took 1199 ms. Trace:
I20260709 13:07:20.673547 25433 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.683286 21942 rpcz_store.cc:276] 0709 13:07:19.482929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.483194 (+   265us) service_pool.cc:224] Handling call
0709 13:07:19.536483 (+ 53289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.536871 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.536913 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.537471 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.204083 (+666612us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:20.204148 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.204251 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.682591 (+478340us) raft_consensus.cc:1685] finished
0709 13:07:20.682610 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.682742 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5021,"raft.queue_time_us":824,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10280,"thread_start_us":569037,"threads_started":1,"wal-append.queue_time_us":869663}
I20260709 13:07:20.686033 25433 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:20.678902 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.655961 25478 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:20.655288 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.692555 22023 raft_consensus.cc:2410] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:20.656440 21875 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:20.656708 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.630286 25179 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:20.642406 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.695492 22015 raft_consensus.cc:2376] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7. Re-sending same reply.
I20260709 13:07:20.661476 25624 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:20.663084 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1453) took 1435 ms. Trace:
I20260709 13:07:20.698060 22016 rpcz_store.cc:276] 0709 13:07:19.227430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.227577 (+   147us) service_pool.cc:224] Handling call
0709 13:07:19.274290 (+ 46713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.589338 (+315048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.589386 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.589946 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.399564 (+809618us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.399617 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.399706 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.662875 (+263169us) raft_consensus.cc:1685] finished
0709 13:07:20.662892 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.663024 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":758010,"threads_started":1,"wal-append.queue_time_us":1008407}
I20260709 13:07:20.698084 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:20.663204 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.641194 25506 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:20.704088 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.704329 25506 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:20.705339 25548 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:20.705339 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.626585 25544 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.619443 25541 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.725382 25541 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:20.733148 25617 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:07:20.735138 25265 consensus_queue.cc:1175] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:07:20.736003 25627 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:07:20.659205 25604 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:07:20.657338 25609 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 13:07:20.738823 21871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2447) took 1799 ms (client timeout 2031 ms). Trace:
W20260709 13:07:20.739037 25512 consensus_meta.cc:287] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.101s	user 0.008s	sys 0.002s
I20260709 13:07:20.701844 25048 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:20.739271 21871 rpcz_store.cc:269] 0709 13:07:18.939176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.958574 (+ 19398us) service_pool.cc:224] Handling call
0709 13:07:20.738582 (+1780008us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400316fd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:20.738739 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181116288}
I20260709 13:07:20.635766 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:20.671104 25601 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:07:20.702272 25622 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:07:20.693907 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:20.748884 21875 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.693980 25478 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.714047 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:20.741607 21946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2039) took 1984 ms (client timeout 2232 ms). Trace:
W20260709 13:07:20.754524 21946 rpcz_store.cc:269] 0709 13:07:18.757131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.817327 (+ 60196us) service_pool.cc:224] Handling call
0709 13:07:20.741434 (+1924107us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b540019b754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:20.741548 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070613248}
I20260709 13:07:20.738862 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1840) took 1325 ms. Trace:
I20260709 13:07:20.740388 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:20.756206 21871 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.691352 25395 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:20.744143 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:20.693442 22021 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
W20260709 13:07:20.694151 25571 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.968s	user 0.009s	sys 0.003s
W20260709 13:07:20.750910 25623 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:07:20.751062 25328 consensus_meta.cc:287] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.003s
W20260709 13:07:20.742111 25433 consensus_queue.cc:1175] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 11 status { last_received { term: 10 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:20.701073 25558 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.755982 21872 rpcz_store.cc:276] 0709 13:07:19.412992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.413139 (+   147us) service_pool.cc:224] Handling call
0709 13:07:19.413454 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.413847 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.413873 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:19.435161 (+ 21288us) log.cc:844] Serialized 52 byte log entry
0709 13:07:19.732285 (+297124us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:19.732343 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.732460 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.678585 (+946125us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b48000801d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:07:20.738582 (+ 59997us) raft_consensus.cc:1685] finished
0709 13:07:20.738604 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.738801 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":22613,"raft.run_wall_time_us":1255410,"spinlock_wait_cycles":9223424,"thread_start_us":277840,"threads_started":1,"wal-append.queue_time_us":775804}
I20260709 13:07:20.742005 25624 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:20.758826 22016 raft_consensus.cc:2376] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7. Re-sending same reply.
W20260709 13:07:20.742400 25413 consensus_queue.cc:1175] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.8-6.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:20.759903 25571 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.760293 25179 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:20.760802 22576 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.234s (SENT)
I20260709 13:07:20.763582 25164 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:20.753353 25218 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:20.747898 25244 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.000s
W20260709 13:07:20.724431 25578 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.069s	user 0.010s	sys 0.000s
I20260709 13:07:20.766345 21871 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:20.777572 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:20.767275 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:20.780661 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.803433 21872 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.771981 25364 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:20.808547 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 455) took 2115 ms. Trace:
I20260709 13:07:20.824100 21949 rpcz_store.cc:276] 0709 13:07:18.693213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.838663 (+145450us) service_pool.cc:224] Handling call
0709 13:07:18.838983 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.405273 (+566290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.808320 (+1403047us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54000fdf54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:20.808487 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099692928}
I20260709 13:07:20.809365 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:20.822911 22601 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:20.828186 22607 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:20.830353 22021 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.833319 22016 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:20.834609 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:20.835419 21875 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:20.835803 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.837327 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.838583 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:20.840994 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.842751 22017 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:20.843534 21875 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:20.844187 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.791565 25592 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.864755 25592 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.866055 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:20.867489 25592 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:20.868115 25592 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:20.822109 25244 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.874125 25544 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:20.874388 25606 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.875068 25606 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:20.876437 25571 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:20.848851 25567 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:20.786010 25558 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:20.878196 25606 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:20.879092 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.880154 25558 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:20.794472 25048 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.884989 25048 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:20.887790 25048 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:20.848572 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:20.851192 22015 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.854097 25548 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.891844 21871 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:20.854429 25630 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:07:20.793231 25512 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:20.779050 25328 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.821838 25192 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:20.898710 21872 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:20.890345 25562 consensus_meta.cc:287] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.156s	user 0.013s	sys 0.000s
I20260709 13:07:20.928707 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1838) took 1533 ms. Trace:
I20260709 13:07:20.929237 21871 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:20.929158 21867 rpcz_store.cc:276] 0709 13:07:19.395070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.395230 (+   160us) service_pool.cc:224] Handling call
0709 13:07:19.436195 (+ 40965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.579117 (+142922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.928457 (+1349340us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400219b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:20.928653 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249704704}
I20260709 13:07:20.824365 25578 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.918058 25562 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:21.064558 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.184872 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1847) took 1632 ms. Trace:
I20260709 13:07:21.131215 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1463) took 1769 ms. Trace:
W20260709 13:07:20.989508 22576 leader_election.cc:336] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.442s (SENT)
I20260709 13:07:21.223649 22024 rpcz_store.cc:276] 0709 13:07:19.361631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.541735 (+180104us) service_pool.cc:224] Handling call
0709 13:07:21.130961 (+1589226us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b540017c5d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:21.131140 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139613952}
W20260709 13:07:21.217819 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.973748 22020 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:21.222199 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 305457us
W20260709 13:07:21.227814 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.228046 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.893944 25164 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.224133 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 234671us
I20260709 13:07:20.931092 22607 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:21.232304 22576 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.457s (SENT)
I20260709 13:07:21.232824 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:20.975278 25582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.011s	sys 0.021s
I20260709 13:07:21.229791 22019 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:21.230465 25541 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 13:07:20.988154 25378 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.237023 25578 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.237627 25478 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.240724 25571 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.238384 25164 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.240125 22609 raft_consensus.cc:2368] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13.
I20260709 13:07:21.242415 21944 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.248481 22022 raft_consensus.cc:2410] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:07:20.903710 25592 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.218611 21868 rpcz_store.cc:276] 0709 13:07:19.555404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.559281 (+  3877us) service_pool.cc:224] Handling call
0709 13:07:19.559618 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:20.445456 (+885838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.445492 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:20.460113 (+ 14621us) log.cc:844] Serialized 52 byte log entry
0709 13:07:20.545090 (+ 84977us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:20.545131 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.729477 (+184346us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54003ad754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:20.729552 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.182573 (+453021us) raft_consensus.cc:1685] finished
0709 13:07:21.182596 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.184786 (+  2190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140872,"raft.queue_time_us":141001,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":37324,"spinlock_wait_cycles":1600763776,"thread_start_us":68235,"threads_started":1,"wal-append.queue_time_us":141366}
I20260709 13:07:20.906015 25548 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:20.915474 25512 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.245750 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1455) took 1931 ms. Trace:
I20260709 13:07:21.277653 22019 rpcz_store.cc:276] 0709 13:07:19.313953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.582131 (+268178us) service_pool.cc:224] Handling call
0709 13:07:19.582459 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.225645 (+1643186us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b54000a26a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fe9dc0 00007f63560741c0 00007f6356075231 00007f6356071d8f 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c
0709 13:07:21.245409 (+ 19764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.245670 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127314176}
W20260709 13:07:21.243937 25582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.029s	sys 0.054s
I20260709 13:07:21.255106 21947 raft_consensus.cc:606] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:21.285148 21947 raft_consensus.cc:614] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:21.243391 25451 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:21.291700 25633 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:07:21.292933 25562 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.293903 25407 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:21.294518 25407 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.295485 25548 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.302161 25521 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:21.304318 25478 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.310071 25164 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.310182 25512 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.321106 25548 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:21.339100 25548 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:21.367564 25548 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:21.391563 25640 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:07:21.389639 25592 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:21.396950 25624 consensus_meta.cc:287] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
W20260709 13:07:21.430773 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.449540 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 222822us
I20260709 13:07:21.364197 25328 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:21.482517 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 248186us
W20260709 13:07:21.483527 25440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.015s
W20260709 13:07:21.483716 21841 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.719s (SENT)
W20260709 13:07:21.484169 25440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.000s	sys 0.015s
I20260709 13:07:21.484380 25192 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.485751 25192 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.484426 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:21.494349 25164 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.508035 25192 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:21.509657 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 261361us
W20260709 13:07:21.514598 21841 connection.cc:256] RPC call timeout handler was delayed by -1.3589072860000897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:07:21.515268 21841 connection.cc:256] RPC call timeout handler was delayed by -1.0601072860000613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:07:21.515916 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1839) took 2114 ms. Trace:
I20260709 13:07:21.516044 25192 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.516726 25378 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.517251 25164 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.517719 25378 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.518131 25164 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.518750 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 548) took 1007 ms. Trace:
I20260709 13:07:21.519169 21869 rpcz_store.cc:276] 0709 13:07:20.510759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.524287 (+ 13528us) service_pool.cc:224] Handling call
0709 13:07:21.518297 (+994010us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b54001d7ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:21.518529 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194517888}
I20260709 13:07:21.520569 25378 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.524937 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:21.525004 25164 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.516546 21866 rpcz_store.cc:276] 0709 13:07:19.401897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.402110 (+   213us) service_pool.cc:224] Handling call
0709 13:07:19.402554 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:19.420112 (+ 17558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.420141 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:19.436218 (+ 16077us) log.cc:844] Serialized 52 byte log entry
0709 13:07:19.937614 (+501396us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:20.224192 (+286578us) log.cc:844] Serialized 14 byte log entry
0709 13:07:20.684587 (+460395us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b180042fb20. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f532a6 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fed733 00007f6356072dbf 00007f635607183e
0709 13:07:21.515043 (+830456us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5400294da0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fed733 00007f6356072dbf 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c
0709 13:07:21.515202 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.515375 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:21.515453 (+    78us) raft_consensus.cc:1685] finished
0709 13:07:21.515460 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.515728 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":533799,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":2632,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":18189,"spinlock_wait_cycles":35128064,"thread_start_us":604023,"threads_started":2,"wal-append.queue_time_us":467967}
I20260709 13:07:21.526401 25653 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:21.531191 25164 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.532096 25164 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.533068 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2046) took 2069 ms. Trace:
I20260709 13:07:21.523456 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 546) took 1022 ms. Trace:
I20260709 13:07:21.531373 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48038 (request call id 27) took 1691 ms. Trace:
I20260709 13:07:21.535746 21947 rpcz_store.cc:276] 0709 13:07:19.840234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.000097 (+159863us) service_pool.cc:224] Handling call
0709 13:07:21.530913 (+1530816us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400377654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635606c853 00007f635b03a60a 00007f63545c07d4 00007f63545c0762 00007f63545c0691 00007f63545c060c 00007f63545bf8c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:21.531111 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862903040}
I20260709 13:07:21.537523 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:21.538429 21869 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:21.520877 25395 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.521811 21873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1851) took 1865 ms (client timeout 1906 ms). Trace:
W20260709 13:07:21.540935 21873 rpcz_store.cc:269] 0709 13:07:19.656020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.656250 (+   230us) service_pool.cc:224] Handling call
0709 13:07:21.521409 (+1865159us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400217d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:21.521626 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803748096}
I20260709 13:07:21.534683 21944 rpcz_store.cc:276] 0709 13:07:19.463626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.463748 (+   122us) service_pool.cc:224] Handling call
0709 13:07:19.532127 (+ 68379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.254902 (+1722775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.532520 (+277618us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400377654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:21.532858 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3932680064}
I20260709 13:07:21.534991 21870 rpcz_store.cc:276] 0709 13:07:20.500508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.500651 (+   143us) service_pool.cc:224] Handling call
0709 13:07:20.500939 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.649671 (+148732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.649698 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.649740 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:20.649769 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.522962 (+873193us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400318dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:21.523032 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.523264 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341614336}
I20260709 13:07:21.539834 25395 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.545368 22021 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:21.546949 22609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 638) took 1996 ms (client timeout 1551 ms). Trace:
I20260709 13:07:21.549029 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:21.561460 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:21.587733 22016 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
W20260709 13:07:21.561781 22609 rpcz_store.cc:269] 0709 13:07:19.550562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.550700 (+   138us) service_pool.cc:224] Handling call
0709 13:07:21.546421 (+1995721us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54006504d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:21.546682 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3818238336}
I20260709 13:07:21.574236 21944 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.576531 25395 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.608953 21866 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:21.516903 25192 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.561107 25653 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.579811 25244 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:21.617493 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.620903 25653 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.621891 25629 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:21.622488 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.652992 25629 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:21.655018 25629 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.655568 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:21.623472 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:21.656443 25526 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:21.622514 25639 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.393s	user 0.004s	sys 0.000s
I20260709 13:07:21.625090 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.656569 25629 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.656958 21941 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:21.659795 25652 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260709 13:07:21.660921 25164 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.663261 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.667281 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.658939 21946 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:21.632539 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.669049 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.635465 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 735) took 1964 ms. Trace:
I20260709 13:07:21.670024 22603 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:21.670185 22601 rpcz_store.cc:276] 0709 13:07:19.670502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.670660 (+   158us) service_pool.cc:224] Handling call
0709 13:07:19.689253 (+ 18593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.827971 (+1138718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.634848 (+806877us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000b1b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:21.635264 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606360832}
I20260709 13:07:21.637466 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:21.657964 25558 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:07:21.672829 25328 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.634184 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 424) took 1004 ms. Trace:
I20260709 13:07:21.673790 25558 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:21.674471 25541 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.674958 25433 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.657320 25653 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.675526 25433 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:21.675400 25541 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:21.658062 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50287.5us
I20260709 13:07:21.676060 25433 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.673602 25328 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.677477 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.678619 25614 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.678989 25328 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:21.637902 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 585) took 1447 ms. Trace:
I20260709 13:07:21.640100 21948 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:21.657284 25526 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.679531 22610 rpcz_store.cc:276] 0709 13:07:20.190502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.192167 (+  1665us) service_pool.cc:224] Handling call
0709 13:07:20.192485 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:20.642025 (+449540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.637287 (+995262us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400525654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:21.637692 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024641792}
I20260709 13:07:21.681908 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.682161 25526 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.682722 21950 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:21.682902 21948 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.639801 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 441) took 1005 ms. Trace:
I20260709 13:07:21.683902 22022 rpcz_store.cc:276] 0709 13:07:20.634521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.678602 (+ 44081us) service_pool.cc:224] Handling call
0709 13:07:21.639227 (+960625us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54001f18d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:21.639581 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290398080}
I20260709 13:07:21.674050 25440 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:21.685750 25440 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.687304 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:21.688905 25526 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.689494 25526 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:21.690003 25526 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.684041 25541 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:21.695209 25548 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.697167 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.697784 21942 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:21.699230 25506 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:21.700296 21942 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:21.620172 25192 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.701517 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:21.673736 22018 rpcz_store.cc:276] 0709 13:07:20.629502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.629642 (+   140us) service_pool.cc:224] Handling call
0709 13:07:20.629926 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.685397 (+ 55471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.685430 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.685474 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:20.685511 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:21.633539 (+948028us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b5400366354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:21.633625 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:21.633902 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127072128}
I20260709 13:07:21.702816 25395 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.674553 25558 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:21.703033 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:21.704203 25558 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.704667 25361 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:21.705755 25378 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:21.706346 25378 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:21.706719 25048 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.707152 25048 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:21.705859 25558 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.707710 25378 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:21.707562 21838 connection.cc:256] RPC call timeout handler was delayed by -1.4981202799999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:07:21.709268 21838 connection.cc:256] RPC call timeout handler was delayed by -1.4783202800000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:07:21.709784 21838 connection.cc:256] RPC call timeout handler was delayed by -1.4088639039999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31880000000000003s for a response
I20260709 13:07:21.709824 25378 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:21.710525 21838 connection.cc:256] RPC call timeout handler was delayed by -1.1723202800000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:07:21.710922 21838 connection.cc:256] RPC call timeout handler was delayed by -1.0472202800000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 13:07:21.711575 25192 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.711856 25361 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.703298 25395 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.713040 25395 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.712589 25361 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.716325 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.717622 21948 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:21.717901 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:21.720441 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:21.707660 25048 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.695820 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:21.742848 21941 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:21.756198 21944 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:21.760463 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:21.712311 25192 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.764916 21946 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:21.688586 25440 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:21.765085 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:21.786700 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.757725 25164 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.795246 25521 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.796234 25521 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:21.798239 25407 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.012s
I20260709 13:07:21.798787 25407 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.800155 21945 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:21.804946 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:21.805655 21946 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.809798 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:21.815325 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.815912 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.786099 25361 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.817209 25164 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:21.817924 25164 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.820230 25164 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.820779 21870 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:21.822338 21873 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:21.823923 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:21.824707 22601 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.824985 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:21.825486 21874 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:07:21.826653 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 127446us
W20260709 13:07:21.845841 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 92610.4us
I20260709 13:07:21.849908 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:21.851600 25571 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:21.852246 25478 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.852409 25571 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.853039 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.853223 25541 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.853906 25541 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.855257 25571 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.855912 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:21.856189 25541 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.853091 25478 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.859038 25478 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.859064 22601 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:21.844935 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:21.859210 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:21.843657 21866 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.826335 25440 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:07:21.859922 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.859236 21946 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:21.859822 25283 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:21.869705 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.874774 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:21.876163 21867 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:21.879227 25192 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.881688 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.882567 22610 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:21.883351 25407 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:21.885667 25521 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.887084 21941 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:21.875479 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.888870 25440 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.890298 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.891501 25440 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:21.891719 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:21.891968 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.892871 21945 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:21.893234 25283 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:21.894857 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.895350 25478 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:21.895967 25478 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:21.896106 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:21.896668 25658 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 13:07:21.896826 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.897450 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:21.898874 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.901665 25653 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:21.904105 21873 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:21.905032 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.906070 21943 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:21.907230 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.904119 25218 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:21.907994 25218 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:21.909092 25218 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.910498 25218 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:21.913067 25587 consensus_queue.cc:1059] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:21.913842 25440 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:21.914582 25587 raft_consensus.cc:3055] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:21.915066 25587 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:21.915345 25440 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.915773 25440 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:21.917042 21950 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:21.916859 25440 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.918042 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.918164 25440 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.919327 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.919966 21944 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:21.897109 25478 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.924878 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.925082 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:21.925611 21945 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:21.926043 21948 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:21.927838 25433 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.933050 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.934608 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:21.934911 25395 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.936681 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:21.938458 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:22.008042 21948 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:21.940433 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:21.941207 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:21.942078 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:21.942198 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:21.943728 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:21.890298 25325 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.944727 25164 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.941203 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:21.946287 22015 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:21.945348 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:21.946777 21768 catalog_manager.cc:5697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 4 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 7 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:21.948246 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.948653 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.948292 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.950224 25614 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:21.914449 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:21.951506 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.957777 21773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 275) took 9544 ms. Trace:
I20260709 13:07:21.916126 25587 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:21.964775 22020 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:22.016712 22024 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:21.966163 25433 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:21.969146 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:21.973502 21866 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
W20260709 13:07:21.976188 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.978520 25597 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:21.986675 25048 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:21.992880 25548 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:21.995795 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:21.998065 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.034669 22610 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:21.956449 25526 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.036499 22022 raft_consensus.cc:2410] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 13:07:22.036964 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100435us
I20260709 13:07:22.037369 25244 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:22.037473 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:21.960443 22574 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:21.939563 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:22.037878 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:22.038739 21867 raft_consensus.cc:2376] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 5. Re-sending same reply.
I20260709 13:07:22.024187 21868 raft_consensus.cc:2410] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:22.027779 21873 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:07:22.009935 25325 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:22.028653 22018 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:22.031101 21874 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:22.025933 25629 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.044459 22603 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:21.945297 25440 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.015799 25164 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:22.044178 22608 raft_consensus.cc:2368] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10.
I20260709 13:07:22.037863 25526 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:22.045535 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:22.067171 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.068760 22017 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:22.069685 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 109629us
W20260709 13:07:22.069531 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 155281us
I20260709 13:07:22.072101 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:22.073321 21866 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:22.074936 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:22.075708 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:22.037904 25244 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:22.046418 25325 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:22.081211 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 85618.4us
I20260709 13:07:22.090607 21943 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:22.078341 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:22.077986 25192 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:22.082778 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45030.4us
I20260709 13:07:22.082993 25667 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.083395 25413 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:22.083910 25526 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.086565 21839 leader_election.cc:400] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10.
I20260709 13:07:22.096903 21839 leader_election.cc:403] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:22.088156 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:22.088977 21946 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:22.066710 25164 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.088893 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:22.094908 21868 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:22.098496 22023 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.048086 25440 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.102109 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:22.103338 21866 raft_consensus.cc:2410] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:22.078848 21768 catalog_manager.cc:5697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 6, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:22.096622 25413 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.096833 25526 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:22.108280 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:22.108247 25668 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.111828 25526 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.111955 24706 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:22.110126 21867 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:22.116215 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:22.117585 22019 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:22.098939 25218 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.118654 25218 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.121404 21866 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:22.122570 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 127980us
I20260709 13:07:22.105612 25440 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.108424 25413 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.172457 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:22.168049 21874 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:22.164033 25587 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.081792 21948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:22.196787 21948 raft_consensus.cc:606] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:22.192500 25629 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:22.198414 25629 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:22.196085 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.202015 21867 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:22.203986 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 86716.4us
W20260709 13:07:22.204339 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 379468us
I20260709 13:07:22.212040 21768 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.119304 25192 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:22.248855 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.257709 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.024019 21773 rpcz_store.cc:276] 0709 13:07:12.413542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.414017 (+   475us) service_pool.cc:224] Handling call
0709 13:07:21.957504 (+9543487us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:18.101463 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:18.102046 (+   583us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:18.102080 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:07:18.102096 (+    16us) tablet.cc:662] Decoding operations
0709 13:07:18.103865 (+  1769us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:18.103939 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:18.103972 (+    33us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:07:18.631038 (+527066us) tablet.cc:701] Row locks acquired
0709 13:07:18.656170 (+ 25132us) write_op.cc:260] PREPARE: finished
0709 13:07:18.680253 (+ 24083us) write_op.cc:270] Start()
0709 13:07:18.680393 (+   140us) write_op.cc:276] Timestamp: P: 1783602438675204 usec, L: 0
0709 13:07:18.680421 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:18.844359 (+163938us) log.cc:844] Serialized 8435 byte log entry
0709 13:07:19.973498 (+1129139us) op_driver.cc:464] REPLICATION: finished
0709 13:07:20.548015 (+574517us) write_op.cc:301] APPLY: starting
0709 13:07:20.567633 (+ 19618us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:20.640726 (+ 73093us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:20.663613 (+ 22887us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:20.883137 (+219524us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:20.883579 (+   442us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:07:20.883650 (+    71us) write_op.cc:312] APPLY: finished
0709 13:07:20.884221 (+   571us) log.cc:844] Serialized 145 byte log entry
0709 13:07:21.230115 (+345894us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:21.243089 (+ 12974us) write_op.cc:454] Released schema lock
0709 13:07:21.251551 (+  8462us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:21.280944 (+ 29393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:21.280981 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12566,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":511721,"apply.run_cpu_time_us":20804,"apply.run_wall_time_us":750600,"num_ops":21,"prepare.queue_time_us":512493,"prepare.run_cpu_time_us":31294,"prepare.run_wall_time_us":1002627,"raft.queue_time_us":272178,"raft.run_cpu_time_us":63385,"raft.run_wall_time_us":348502,"replication_time_us":1258681,"thread_start_us":1146781,"threads_started":5,"wal-append.queue_time_us":797475,"wal-append.run_cpu_time_us":15726,"wal-append.run_wall_time_us":1598595}]]}
I20260709 13:07:22.227105 21768 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:22.275101 21872 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:07:22.279433 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 161288us
W20260709 13:07:22.283815 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55188.9us
I20260709 13:07:22.285789 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:22.286899 21948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:22.287829 21948 raft_consensus.cc:606] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:22.288426 21948 raft_consensus.cc:614] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:22.289496 25378 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.291105 25328 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:22.292757 25328 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:22.294255 25328 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.295904 21948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:22.296574 21948 raft_consensus.cc:606] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:22.298390 25328 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:22.298702 25571 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:22.299351 25433 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:22.304383 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 216411us
I20260709 13:07:22.261458 25048 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:22.303953 25571 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:22.313588 25571 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.233891 25478 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:07:22.320140 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:22.321568 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 87780.4us
I20260709 13:07:22.318464 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:22.324221 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:22.327391 24706 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:22.321964 25629 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:22.339421 25048 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:22.340060 25048 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:22.345803 25642 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.349967 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:22.351393 25244 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.352039 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:22.352816 25669 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:22.356204 25218 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:22.356925 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:22.358741 25521 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:22.361145 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.343326 21768 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 8, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 8 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:22.364125 25642 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.389643 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:22.371677 25521 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.377861 25218 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.372274 25478 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:07:22.360435 25526 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.392968 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:22.397181 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.383663 25244 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.398294 21988 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.365711 24706 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:22.415514 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 181037us
I20260709 13:07:22.408533 25672 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.394456 25283 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.394361 25218 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.392092 25642 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.386421 25433 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:07:22.418524 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:22.421506 25218 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.420437 25283 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:22.429786 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:22.459586 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 114255us
W20260709 13:07:22.460394 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64265.9us
I20260709 13:07:22.462445 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:22.464749 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 128695us
I20260709 13:07:22.419553 25413 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:22.481887 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55492.5us
W20260709 13:07:22.479957 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.422586 25440 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.409143 25328 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.485181 25629 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:22.485356 25677 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:22.486109 25642 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.513820 25677 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:22.514694 25440 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:22.514843 25677 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:22.487893 25675 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:07:22.488830 21768 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:22.458338 25192 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:22.481093 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:22.491508 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:22.459672 25283 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.492723 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.494215 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:22.464841 25668 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10.
I20260709 13:07:22.523092 22601 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:22.562769 21871 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:22.483908 25681 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:07:22.508405 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:22.560269 21768 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 6, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 6 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:22.509477 25526 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:22.509670 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:22.510260 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:22.510579 25413 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:22.511188 22019 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:22.491350 25521 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.512735 25571 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:22.422302 25048 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.505951 25558 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:22.570788 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 68762.3us
I20260709 13:07:22.593453 25558 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.593986 25558 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.560240 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:22.566948 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:22.509052 25629 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:22.596215 21873 raft_consensus.cc:2410] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:07:22.596472 25629 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:22.599413 22576 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.791s (SENT)
I20260709 13:07:22.560987 25624 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.582881 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:22.585269 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 76989.9us
I20260709 13:07:22.587590 21768 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:22.589370 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 96717.4us
I20260709 13:07:22.589963 25672 raft_consensus.cc:2764] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:22.590480 25361 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.592833 22607 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:22.518509 25653 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:22.610834 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 229734us
W20260709 13:07:22.580430 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 167314us
I20260709 13:07:22.490795 25671 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.605201 21768 catalog_manager.cc:5697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 8, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 8 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:22.561054 25543 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.200s
I20260709 13:07:22.603611 25624 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.561293 25680 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
W20260709 13:07:22.614982 25682 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:07:22.636354 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.636713 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:22.617213 25521 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.645355 25688 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:22.646440 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 219293us
I20260709 13:07:22.657871 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:22.646750 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:22.662657 25683 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:07:22.661845 21768 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 2 to 5, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.664824 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:22.666561 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:22.628139 25164 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.674997 25164 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:22.675448 25672 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.630177 25624 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.664980 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:22.677640 22576 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.842s (SENT)
I20260709 13:07:22.681371 22576 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:22.664299 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51121.8us
I20260709 13:07:22.675833 25164 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.655032 21868 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:22.684803 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:22.635432 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.581849 25325 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.676842 25678 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.711017 22021 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.715188 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.688743 25686 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:22.692682 25571 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:22.721359 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43504.4us
W20260709 13:07:22.725721 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 62986.4us
I20260709 13:07:22.726348 21768 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:22.711875 25688 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:22.728113 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 205657us
I20260709 13:07:22.713308 25671 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.723276 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:22.733232 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 105509us
I20260709 13:07:22.735312 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.735374 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:22.736290 21942 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.721246 25164 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.754971 21872 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.711095 25218 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.759698 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:22.764570 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.733819 25686 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:22.770961 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 109940us
W20260709 13:07:22.778126 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.722798 25678 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:22.781908 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 46685.4us
I20260709 13:07:22.757085 25361 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.772295 25672 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.797254 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.801033 25686 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.815817 25678 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:22.800141 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 71128.2us
W20260709 13:07:22.804880 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 81665.5us
I20260709 13:07:22.817493 25361 raft_consensus.cc:2764] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:22.818115 25395 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:22.818780 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:22.819630 25218 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:22.821213 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:22.807994 25694 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:22.833961 25407 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.809329 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:22.835143 25218 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:22.835639 25218 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.837086 25642 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:22.836684 25218 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.837599 25642 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.838671 25407 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.811602 25325 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:22.838965 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:22.788826 25687 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.839331 25407 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.792268 21768 catalog_manager.cc:5697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 4 to 6, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.840085 25687 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.841470 21768 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 8, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 8 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.842666 25687 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:22.812197 25693 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:22.843739 25693 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:22.844206 25693 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.843844 21768 catalog_manager.cc:5697] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 6, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 6 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:22.845070 25681 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:22.845597 25681 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.845139 25693 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.845397 21768 catalog_manager.cc:5697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 3 to 4, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 4 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:22.846830 25693 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.846508 25681 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.848088 25681 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.823992 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:22.849673 25407 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:22.849884 21945 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:22.823943 25440 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:22.849879 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:22.850466 25440 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:22.831146 25597 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:22.851442 25597 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:22.851379 25440 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.852707 25597 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.854306 25597 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.854943 25218 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.855160 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:22.821851 22607 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.855847 21868 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.839732 25325 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.857507 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:22.857510 25325 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:22.858665 25325 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.858879 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:22.830515 25666 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.794s	user 0.001s	sys 0.007s
I20260709 13:07:22.859575 25407 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:22.839704 22608 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.860688 25407 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:22.838635 25642 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:22.862844 25407 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:22.863247 25407 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.863096 25642 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.864151 25614 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.864272 25543 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:22.864676 25614 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:22.865196 25614 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:22.866580 22576 leader_election.cc:336] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.224s (SENT)
I20260709 13:07:22.867076 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.868924 25680 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.864693 25543 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.874205 25543 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:22.876345 25543 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.879693 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:22.899186 21872 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.884024 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:22.906523 21942 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
W20260709 13:07:22.907356 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 48547.4us
I20260709 13:07:22.909286 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:22.912448 22017 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:22.913374 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60327.8us
W20260709 13:07:22.916553 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50013.7us
I20260709 13:07:22.926050 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:22.927199 22018 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:22.852543 25440 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.933954 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:22.938877 22023 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.907765 25395 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:22.944633 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.905181 25688 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:22.945312 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:22.953518 22016 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:22.939553 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:22.953397 22020 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:22.956812 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47614.6us
I20260709 13:07:22.967697 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:22.971462 21868 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:22.940135 25679 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:22.981370 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:22.984169 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.984622 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:22.949544 25395 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:22.987393 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.988933 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:22.984887 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:22.941250 25680 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:07:22.994423 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 56286.6us
I20260709 13:07:22.995558 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:22.986500 25679 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.993311 25395 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.994328 25686 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:22.995069 25671 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.021715 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:23.028724 25697 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.029347 25701 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.029467 25558 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.029887 25704 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:23.030974 25703 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:22.961962 25407 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:23.019629 25679 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.028793 25571 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:23.035538 25688 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:23.040944 25702 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:23.041975 25708 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:23.047766 25672 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.047675 21872 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:23.049292 22023 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:22.994443 25653 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:23.051290 25614 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.060506 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.120329 21868 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:23.060840 25686 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:23.061277 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:23.061714 22576 leader_election.cc:336] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.377s (SENT)
W20260709 13:07:23.071616 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49985.4us
I20260709 13:07:23.076300 22608 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
W20260709 13:07:23.080448 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 107046us
W20260709 13:07:23.098223 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.073678 25697 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:23.123302 21875 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:23.125921 21914 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.562s (SENT)
I20260709 13:07:23.079331 25192 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:23.237959 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.091643 25571 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:23.241956 21873 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:23.244958 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:23.247005 22603 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:23.247802 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 246235us
W20260709 13:07:23.234450 25283 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.006s
I20260709 13:07:23.248827 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:23.263440 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:23.084146 25624 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:23.111451 25701 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:23.266666 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.245848 25671 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.254248 25682 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:23.269865 21868 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:23.231312 25697 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.270048 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:23.262729 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:23.277832 21949 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:23.255365 25695 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:23.258330 25407 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.282891 22019 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:23.294128 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 232440us
I20260709 13:07:23.295742 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.296819 21942 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:23.278565 25680 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:23.278595 25720 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.313624 21868 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:23.304217 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.285851 25678 raft_consensus.cc:2764] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:23.262822 25283 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.332218 21947 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:23.317607 25614 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:23.338933 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.341029 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 59796.1us
I20260709 13:07:23.348680 21873 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:23.309441 25695 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:23.357403 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 55914.2us
I20260709 13:07:23.279232 25671 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.300220 25686 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:23.391791 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.346144 25702 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:23.402750 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 52109.4us
W20260709 13:07:23.405737 25597 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.551s	user 0.015s	sys 0.007s
W20260709 13:07:23.392560 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60218.7us
I20260709 13:07:23.347420 25708 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.406387 22608 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:23.406461 25597 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.407371 22576 leader_election.cc:336] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.595s (SENT)
I20260709 13:07:23.407192 25597 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.406586 25730 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.407938 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:23.408216 21875 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:23.408214 25730 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.312997 25653 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:23.410349 21873 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:23.413877 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:23.411095 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:23.411253 21841 connection.cc:256] RPC call timeout handler was delayed by -1.2424453930000254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:07:23.411881 22607 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.004s
W20260709 13:07:23.415470 21841 connection.cc:256] RPC call timeout handler was delayed by -1.2343453930000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 13:07:23.415663 22607 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
W20260709 13:07:23.416016 21841 connection.cc:256] RPC call timeout handler was delayed by -1.1929453930000591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 13:07:23.416481 21841 connection.cc:256] RPC call timeout handler was delayed by -1.184845393000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:07:23.416916 21841 connection.cc:256] RPC call timeout handler was delayed by -1.1803453930000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:07:23.417326 21841 connection.cc:256] RPC call timeout handler was delayed by -1.0102453929999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:07:23.417721 21841 connection.cc:256] RPC call timeout handler was delayed by -1.000345392999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
I20260709 13:07:23.311955 25571 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:23.424571 21988 connection.cc:256] RPC call timeout handler was delayed by -2.0776803029999655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:07:23.429322 21988 connection.cc:256] RPC call timeout handler was delayed by -2.0416803029999073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:07:23.351549 25678 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:07:23.389402 25558 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:23.432298 22607 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:23.435204 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.435343 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.446276 21871 raft_consensus.cc:2410] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:07:23.436264 25714 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:07:23.436568 25701 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:23.460753 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.442525 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.441802 21866 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:23.461759 21867 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 9: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:23.443378 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.441768 25283 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:23.449177 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:23.449398 25709 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:07:23.449915 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:23.450416 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.452131 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:23.453274 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:23.445147 21874 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:23.453300 22608 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:23.462919 22609 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 8: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:23.414780 25192 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:23.342504 25720 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:23.466861 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:23.467917 21870 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.469473 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:23.469533 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:23.455356 25642 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.003s
W20260709 13:07:23.470494 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 221729us
W20260709 13:07:23.471788 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.476087 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.480649 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.481158 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.481297 21841 leader_election.cc:336] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.560s (SENT)
I20260709 13:07:23.481971 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:23.483214 25723 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:23.485069 21841 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.606s (SENT)
I20260709 13:07:23.485541 21950 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:23.485695 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:23.487079 25723 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.488914 21950 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 13:07:23.489234 21841 leader_election.cc:336] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.620s (SENT)
I20260709 13:07:23.489507 21950 pending_rounds.cc:85] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 8
I20260709 13:07:23.489940 21950 pending_rounds.cc:107] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:23.490326 21950 raft_consensus.cc:2889] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.490640 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:23.491554 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:23.493271 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 83535.4us
I20260709 13:07:23.498636 21872 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:23.499114 21875 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:23.468829 25725 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:23.413728 25702 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:23.497267 24706 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:23.518430 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.519097 21872 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:23.430107 25597 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:23.515731 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.522430 21873 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:23.516166 21875 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:23.466326 25680 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:23.523192 21875 pending_rounds.cc:85] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 3
I20260709 13:07:23.523470 21875 pending_rounds.cc:107] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:23.523706 21875 raft_consensus.cc:2889] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.524740 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:23.471009 25624 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:23.523877 25680 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.520016 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.530042 22603 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:23.546257 25707 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:07:23.471077 25192 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.548979 21872 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:23.548070 21873 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:23.553257 25693 consensus_meta.cc:287] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.000s
I20260709 13:07:23.553663 25731 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.554111 25724 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:07:23.555322 25718 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:07:23.678511 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.565022 25325 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.706s	user 0.016s	sys 0.000s
I20260709 13:07:23.529997 25725 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:23.718381 21870 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:23.773705 25671 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:23.776873 25739 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:23.800429 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 311215us
I20260709 13:07:23.782491 21871 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:23.778424 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:23.778061 25440 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.000s
I20260709 13:07:23.832130 25729 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.783027 25704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.017s
I20260709 13:07:23.783416 25192 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:23.820986 25395 consensus_meta.cc:287] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 13:07:23.839534 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:23.840760 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.837975 25681 consensus_meta.cc:287] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.989s	user 0.014s	sys 0.002s
W20260709 13:07:23.848894 21914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.055s	sys 0.030s
W20260709 13:07:23.852072 21914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.056s	sys 0.030s
W20260709 13:07:23.845049 25704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.003s	sys 0.017s
W20260709 13:07:23.846166 25721 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.436s	user 0.000s	sys 0.001s
W20260709 13:07:23.854468 21841 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.820s (SENT)
W20260709 13:07:23.856154 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.851060 25521 consensus_meta.cc:287] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.195s	user 0.010s	sys 0.004s
I20260709 13:07:23.784211 25325 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.858440 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:23.861270 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2095) took 1141 ms. Trace:
W20260709 13:07:23.862627 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.859328 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:23.863509 21946 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 13:07:23.863797 25719 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:07:23.863860 21946 pending_rounds.cc:85] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 8
I20260709 13:07:23.866374 21946 pending_rounds.cc:107] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:23.866638 21946 raft_consensus.cc:2889] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.861604 21943 rpcz_store.cc:276] 0709 13:07:22.719672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.719807 (+   135us) service_pool.cc:224] Handling call
0709 13:07:22.721441 (+  1634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.940428 (+218987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.940517 (+    89us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.969096 (+ 28579us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.255071 (+285975us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:23.255170 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.255244 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:23.861073 (+605829us) raft_consensus.cc:1685] finished
0709 13:07:23.861098 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.861213 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1285,"raft.queue_time_us":80878,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"thread_start_us":426363,"threads_started":2,"wal-append.queue_time_us":324334}
I20260709 13:07:23.869642 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.870275 21873 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.871629 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.872254 21874 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.872900 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.873546 21870 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.873154 25725 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.857894 25704 consensus_queue.cc:1243] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:23.876858 25720 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:23.849664 25729 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.878059 25702 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:23.879158 25729 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:23.882586 21874 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:23.883606 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.883735 21870 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:23.884168 21874 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:23.872840 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.887271 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.859922 25739 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:23.890508 21870 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.852705 25395 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:23.896900 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 782794us
I20260709 13:07:23.890098 25361 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.913727 21874 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:23.916060 21869 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:07:23.916843 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.912115 21914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.739s (SENT) [suppressed 35 similar messages]
I20260709 13:07:23.872788 25737 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:07:23.939610 21870 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:23.941790 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:23.941941 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 87498.7us
I20260709 13:07:23.915701 25693 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.945400 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:23.946043 21874 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:23.952113 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.966627 21874 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:23.971699 25395 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:23.909039 25739 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.977887 21875 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:23.979128 25739 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:23.982685 25697 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.692s	user 0.002s	sys 0.007s
I20260709 13:07:23.983165 25697 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.984781 25433 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.985194 25325 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:23.985461 25433 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.948638 25693 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:23.988180 25433 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:23.989501 25693 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:23.990630 21841 leader_election.cc:336] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.101s (SENT)
W20260709 13:07:23.990842 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.966280 25543 consensus_meta.cc:287] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.060s	user 0.011s	sys 0.002s
I20260709 13:07:23.953835 25361 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.993083 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 690043us
W20260709 13:07:23.989512 25679 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.768s	user 0.004s	sys 0.004s
W20260709 13:07:23.993405 21988 connection.cc:256] RPC call timeout handler was delayed by -1.5493803029999071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:07:23.994544 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.994654 25624 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.017853 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:23.996801 21873 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:24.018452 22023 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:23.999754 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 87681us
I20260709 13:07:24.001444 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.000213 25677 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.005451 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.006486 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:24.026573 21948 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:24.009534 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.015928 22021 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:07:24.016671 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.016917 21943 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:24.028545 21943 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:24.027920 22021 pending_rounds.cc:85] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 7
I20260709 13:07:24.033946 22021 pending_rounds.cc:107] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:24.033870 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:24.034173 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.034338 22021 raft_consensus.cc:2889] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.037662 21945 raft_consensus.cc:2368] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:07:24.031708 25624 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.046655 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.065083 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.065610 25624 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:24.065855 22016 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:24.066723 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.033329 25395 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:24.031975 25543 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.067902 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.068008 25395 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.068980 22023 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:24.033464 25677 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.071172 25192 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:24.071818 25192 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:24.074123 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 83537.5us
I20260709 13:07:24.074745 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:24.075706 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2647) took 1138 ms. Trace:
W20260709 13:07:24.076383 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.077373 22023 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:24.035355 21943 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.083012 25395 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:24.083634 21841 leader_election.cc:336] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.377s (SENT)
I20260709 13:07:24.081856 21916 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:24.084105 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.093024 21948 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
W20260709 13:07:24.095686 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 74204.1us
I20260709 13:07:24.076084 22022 rpcz_store.cc:276] 0709 13:07:22.900731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.900876 (+   145us) service_pool.cc:224] Handling call
0709 13:07:22.936343 (+ 35467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.936544 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:23.091862 (+155318us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.235684 (+143822us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.974721 (+739037us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b18003efc80. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:07:24.037087 (+ 62366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:24.037140 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:24.037185 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.038762 (+  1577us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.038878 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":882718,"prepare.queue_time_us":423690,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3931,"raft.queue_time_us":908666,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":9196,"spinlock_wait_cycles":4926720,"thread_start_us":200619,"threads_started":2}
I20260709 13:07:24.100925 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.094589 25739 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.102676 25395 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.004429 25361 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:24.103150 21841 leader_election.cc:336] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.456s (SENT)
I20260709 13:07:24.103646 21841 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.104437 25740 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:24.104890 21841 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.481s (SENT)
I20260709 13:07:24.105042 25361 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.074111 25192 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:24.106211 21841 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.934s (SENT)
I20260709 13:07:24.106602 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.068632 25543 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.096639 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:24.115387 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.025938 25679 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.109591 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.096639 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.098519 21950 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:24.125594 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.128847 22015 raft_consensus.cc:2410] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:24.126856 22023 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:24.130434 22016 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:24.097366 25725 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.097141 25702 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:07:24.144230 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:24.150663 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44497.7us
I20260709 13:07:24.127844 25192 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.154460 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.155251 22016 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:24.155355 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.161118 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:24.161486 22016 pending_rounds.cc:85] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 6
I20260709 13:07:24.162410 22016 pending_rounds.cc:107] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:24.163363 22016 raft_consensus.cc:2889] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.165100 22015 raft_consensus.cc:2410] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:24.123687 25653 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:07:24.166194 22576 leader_election.cc:336] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.125s (SENT)
I20260709 13:07:24.178364 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.150065 25697 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:24.180615 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.186743 21873 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:24.175789 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.175109 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.183964 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.149494 25725 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:24.184854 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:24.191283 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.191872 21944 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:24.195201 22021 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:24.197559 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:24.198817 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:24.199111 25720 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:24.199433 21947 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:24.200773 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:24.202030 25697 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.204784 22017 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.208740 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.209648 22016 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.217567 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.213953 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.221144 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.154356 25629 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:07:24.225965 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.226719 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.226006 21875 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.202530 25697 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.228124 22021 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:24.236457 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.251289 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:24.253621 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 49676.7us
I20260709 13:07:24.255657 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.256867 21874 raft_consensus.cc:2410] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:24.259039 22016 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:24.260890 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.261255 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:24.265547 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.261763 22021 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:24.268998 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.270002 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.272073 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.273568 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:24.275473 25756 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:07:24.277057 21941 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:24.279376 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:24.268134 25754 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:24.288524 22015 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:24.285452 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.269191 25653 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.300988 25677 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:24.301291 25653 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:24.301838 25543 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.301920 25653 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.290758 25687 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:24.290944 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.314029 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.294878 25697 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.290963 25192 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:24.297878 25440 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.298512 25725 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.292172 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:24.289566 25413 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:24.317749 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.322137 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.324857 21988 leader_election.cc:400] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13.
I20260709 13:07:24.324399 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.325223 21988 leader_election.cc:403] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:24.325374 22015 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:24.328045 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.323055 25730 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.327255 25192 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.316937 25543 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.393466 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 478) took 1454 ms. Trace:
I20260709 13:07:24.372574 22017 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:24.418519 22021 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:24.333556 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.417240 21946 rpcz_store.cc:276] 0709 13:07:22.938880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.939253 (+   373us) service_pool.cc:224] Handling call
0709 13:07:22.959985 (+ 20732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.885831 (+925846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.393141 (+507310us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540009c9d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:24.393376 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077125376}
W20260709 13:07:24.420318 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 96036.6us
I20260709 13:07:24.392472 22573 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:24.421108 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 99312.5us
I20260709 13:07:24.421334 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.422010 22015 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:24.326152 25697 raft_consensus.cc:2764] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:24.424678 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.427131 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.432138 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 605) took 1473 ms. Trace:
I20260709 13:07:24.432564 25624 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.355888 25614 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:24.432780 22603 rpcz_store.cc:276] 0709 13:07:22.958601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.958805 (+   204us) service_pool.cc:224] Handling call
0709 13:07:24.431962 (+1473157us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54005d02d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:24.432073 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589828992}
I20260709 13:07:24.433385 25624 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:24.432929 25328 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:24.433401 25614 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.434258 25328 consensus_queue.cc:1243] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:24.435443 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.436060 22022 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:24.438719 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.440263 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:24.432233 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.432344 25413 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.442876 25413 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:24.369264 25283 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:24.445516 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:24.446197 22601 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.438251 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:24.332885 25704 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:24.448385 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.325066 25440 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.454049 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1396) took 1467 ms. Trace:
I20260709 13:07:24.449936 22022 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:24.456818 22602 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:24.449081 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:24.451184 22605 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:24.457751 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.448479 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.425120 25730 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.450734 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:24.456768 21942 rpcz_store.cc:276] 0709 13:07:22.980294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.980414 (+   120us) service_pool.cc:224] Handling call
0709 13:07:24.447712 (+1467298us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400140ad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:24.447826 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712304384}
I20260709 13:07:24.457782 22604 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 6.
I20260709 13:07:24.461038 22609 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:24.462984 21875 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
W20260709 13:07:24.464979 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.466711 22601 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:24.445554 25672 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.467934 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:24.463356 21875 pending_rounds.cc:85] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 6
I20260709 13:07:24.473129 21875 pending_rounds.cc:107] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:07:24.473402 21875 raft_consensus.cc:2889] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.450479 25743 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.475047 22020 raft_consensus.cc:2393] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:24.449316 25614 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.476505 25743 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:24.467373 25730 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.476954 25743 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.477289 25730 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.471640 25629 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.468848 25687 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.443814 25413 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.475904 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.480662 25672 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.481205 21874 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:24.482908 25672 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:24.471951 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.484684 21866 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:24.452658 25704 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:24.445626 25729 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:24.421892 25543 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.498667 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.448861 25677 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:24.500718 22020 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:24.494122 25704 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.530081 25724 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.530853 25724 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.533267 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.534183 22020 raft_consensus.cc:2410] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:24.534963 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.535733 22020 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:24.536984 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.536479 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.537992 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.538793 22016 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:24.539009 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.539559 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.541643 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.483922 25723 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:24.543303 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.549160 22016 raft_consensus.cc:2368] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:24.543543 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.536536 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.556424 22020 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:24.554303 22576 leader_election.cc:336] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.970s (SENT)
I20260709 13:07:24.557603 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.560094 22015 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:24.560665 22015 pending_rounds.cc:85] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 8
I20260709 13:07:24.560943 22015 pending_rounds.cc:107] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:24.561249 22015 raft_consensus.cc:2889] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.532548 25704 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.571211 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.571476 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.573004 22023 raft_consensus.cc:2368] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:24.574357 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.577773 22016 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:24.499086 25653 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.579998 25702 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.582757 25737 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.563074 25723 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.594611 25782 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:07:24.647615 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.648689 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:24.649720 21839 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:24.601060 22019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2642) took 1696 ms (client timeout 1689 ms). Trace:
I20260709 13:07:24.627413 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.647281 25704 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:24.649668 25672 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:24.658492 25440 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:24.657547 22016 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:24.659032 25283 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13.
W20260709 13:07:24.645514 25779 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:07:24.656425 22019 rpcz_store.cc:269] 0709 13:07:22.896534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.896681 (+   147us) service_pool.cc:224] Handling call
0709 13:07:24.592969 (+1696288us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400365954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:24.593114 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818608000}
W20260709 13:07:24.646056 25780 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:24.661444 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.645169 25743 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.625753 25192 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:24.669245 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 93718.3us
I20260709 13:07:24.664265 22023 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:24.716444 21873 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:07:24.717324 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:24.717567 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.718190 21873 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:24.719084 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.677063 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:24.675429 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:24.598165 25715 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:24.681756 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.697479 22022 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:24.696959 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.677105 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.713757 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:24.660970 25740 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:24.694480 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:24.723480 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.724027 22606 raft_consensus.cc:2368] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:07:24.724520 22604 raft_consensus.cc:2368] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11.
I20260709 13:07:24.672281 25695 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.720769 22608 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:24.726774 21866 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:24.743228 22603 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:24.726933 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:24.727281 21868 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:24.744273 25717 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.744745 25717 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:24.727569 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.727764 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.745131 25717 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.746260 25723 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.727736 21873 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:24.734797 25743 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:24.735772 25781 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:07:24.737493 21870 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:24.749871 25730 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:24.745000 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.733057 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:24.746618 22019 raft_consensus.cc:2368] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:24.752187 25730 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:24.752892 25543 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.747187 25723 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.754007 25653 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.720590 25785 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:07:24.752121 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.756728 25785 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.753687 25723 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:24.769476 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 72658.7us
I20260709 13:07:24.726552 21874 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.783061 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:24.784797 22020 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:24.738319 25740 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:24.790766 25740 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.796007 25748 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:24.797098 22610 pending_rounds.cc:85] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 9
I20260709 13:07:24.797538 22610 pending_rounds.cc:107] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:07:24.726308 25715 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:24.798492 22576 leader_election.cc:400] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:24.797885 22610 raft_consensus.cc:2889] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:24.803457 22576 leader_election.cc:403] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:24.802157 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.805428 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:24.805781 22020 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:24.800800 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 131608us
I20260709 13:07:24.815227 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.815778 22023 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:24.819288 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:24.822338 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:24.822818 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:24.822949 22607 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:24.797719 25653 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.826191 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:24.831691 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:24.832293 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:24.833081 21873 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.801193 25048 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:24.839315 25679 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:24.840026 25679 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:24.840943 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:24.841562 21870 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:24.833454 25478 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.842741 25478 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.807168 25407 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.840380 25679 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.852666 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:24.853351 21944 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:24.849447 21873 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:24.835191 21839 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:24.785450 25737 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:24.855383 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.856366 25478 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:24.857044 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:24.856806 25715 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.857764 21945 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:24.859376 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:24.859519 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:24.860083 21942 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:24.860314 21947 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.860985 25688 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:24.801748 25730 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:24.829977 25680 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.853652 25048 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:24.871482 25048 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:24.829571 25283 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:24.872637 25783 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:24.872860 25283 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:24.873136 25783 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:24.873311 25283 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.873584 25783 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.823980 25677 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:24.854789 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:24.876745 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51175.2us
I20260709 13:07:24.884227 21874 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:24.892227 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.898032 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.851066 25407 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.853754 25679 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.903374 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:24.900553 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.902490 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:24.907861 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.880134 25739 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.910650 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.912039 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.888345 25672 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:24.902391 25743 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:24.938501 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.953094 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.982756 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 84828.9us
I20260709 13:07:24.985564 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:24.987488 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:24.990387 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1882) took 1090 ms. Trace:
I20260709 13:07:24.990994 21869 rpcz_store.cc:276] 0709 13:07:23.836125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.836510 (+   385us) service_pool.cc:224] Handling call
0709 13:07:23.836898 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.916571 (+ 79673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.926535 (+1009964us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b54001b8854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:24.926840 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181499648}
W20260709 13:07:24.993891 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 312203us
I20260709 13:07:24.881165 25720 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:24.883489 25048 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:25.006261 21947 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:25.008276 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:24.906455 25440 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.008901 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:24.907449 25407 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.021989 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:25.030508 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 206858us
I20260709 13:07:24.913560 25624 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:24.889014 25478 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:07:24.979687 25614 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.035267 24706 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:25.035720 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.022280 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:24.924995 25328 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.055537 25328 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:25.044405 22574 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:25.057369 21838 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:24.925401 25629 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.909741 25413 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 13:07:25.014693 25743 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:25.036640 25693 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.055833 25793 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.036640 25361 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.914361 25739 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:25.048097 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:25.003964 25697 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:25.004067 25218 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.009395 25543 raft_consensus.cc:2764] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:07:25.058862 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 146882us
I20260709 13:07:25.057370 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:25.069303 25737 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.906237 25695 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 13:07:25.029954 25688 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.037034 25164 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.039961 25624 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.043920 25725 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:25.079223 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.056056 25328 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.082399 25697 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.047009 25788 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:25.081538 25693 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.088183 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:25.019645 25704 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.064668 25629 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:25.073228 25785 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:25.092517 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:25.093148 25723 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:25.045998 25440 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.096894 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.098809 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:25.082623 25739 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:25.102159 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 44860.8us
I20260709 13:07:25.091701 25737 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.096467 25361 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.102234 25748 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:25.121771 25723 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.122053 21869 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:25.122965 25680 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.123534 25680 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.109342 25791 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:25.127261 25680 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.127662 25791 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.109088 25629 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.075237 25787 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.109939 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.102514 25697 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:25.115594 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.117120 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.105890 25244 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.133647 25787 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:25.145123 25787 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.145864 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2651) took 1141 ms. Trace:
I20260709 13:07:25.146260 22018 rpcz_store.cc:276] 0709 13:07:24.004236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.004386 (+   150us) service_pool.cc:224] Handling call
0709 13:07:24.017874 (+ 13488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.074522 (+ 56648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.074550 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.079750 (+  5200us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.794326 (+714576us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b180003f280. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:07:24.882460 (+ 88134us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:24.882517 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.882611 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.145564 (+262953us) raft_consensus.cc:1685] finished
0709 13:07:25.145585 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.145790 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":391,"raft.queue_time_us":42429,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":13624,"spinlock_wait_cycles":3043584,"thread_start_us":87917,"threads_started":1,"wal-append.queue_time_us":1005319}
I20260709 13:07:25.135198 25743 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.150496 25693 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:25.120810 25164 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.098270 25793 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.121320 25361 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:25.105232 25725 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.152060 25361 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.153635 25725 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:25.134550 25797 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.101105 25688 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.158560 25688 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:25.160650 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 50741.4us
I20260709 13:07:25.161391 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.162209 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:25.140278 25653 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.096117 25672 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.166008 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:25.169317 22607 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:25.170279 25244 raft_consensus.cc:697] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:25.171222 25244 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.173267 22606 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 9: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:25.173830 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.174646 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:25.175772 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.117182 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:25.110922 25717 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.182297 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:25.129195 25737 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.184283 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.121918 25748 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.191203 25328 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.191956 25624 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:25.192139 25440 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:25.183924 25325 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.192529 25801 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.181843 25797 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:25.173035 25723 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:25.192070 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 74953.2us
I20260709 13:07:25.212944 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:25.198228 25791 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.198495 22602 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:25.206545 25413 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.204173 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:25.187134 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.210700 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.198825 25798 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.206652 25164 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.228686 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:25.231667 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:25.232887 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:25.234501 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:25.234987 22608 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:25.144467 25407 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.214460 25801 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.248459 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:25.249496 22607 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:25.251809 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:25.217149 25624 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:25.255821 21941 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:25.260272 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:25.230072 25797 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:25.216286 25653 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:25.265424 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78382.6us
W20260709 13:07:25.266443 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 55860.8us
I20260709 13:07:25.270226 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:25.272897 21870 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:25.250964 25723 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:25.248656 25695 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.274766 21949 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:25.275781 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:25.232913 25725 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:07:25.230348 25688 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:25.279471 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1480) took 1134 ms. Trace:
I20260709 13:07:25.250468 25413 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.262954 25693 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.254891 25801 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:25.282860 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 70025.2us
I20260709 13:07:25.283190 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:25.257727 25192 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.261667 25702 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.259402 25798 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:25.290496 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:25.286695 22021 rpcz_store.cc:276] 0709 13:07:24.145080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.286426 (+141346us) service_pool.cc:224] Handling call
0709 13:07:24.418217 (+131791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.419085 (+   868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.279280 (+860195us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400417dd0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:25.279417 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302397312}
I20260709 13:07:25.293875 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:25.294147 21949 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:25.300909 21868 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:25.231789 25740 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.277666 25723 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.296860 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:25.301955 25325 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:25.302163 25809 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:25.303269 25407 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.280646 25361 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.304093 25797 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.296370 21871 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:25.357854 25325 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.355427 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:25.360102 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:25.361819 25614 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:25.362355 25614 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.363523 25361 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:25.306285 25793 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.366312 21950 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:25.330503 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:25.316584 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:25.370587 22021 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:25.300163 21866 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:25.380810 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.291751 25724 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:25.385406 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:25.278127 25653 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:25.390594 25784 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:25.336310 25723 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.386498 25793 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:25.395102 25804 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:25.312500 25702 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.382918 25739 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.310498 25413 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:25.403286 25748 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.406068 21950 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:25.406883 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:25.408316 21947 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:25.409938 25629 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.411504 21944 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:25.300874 25672 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:25.354547 25743 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:25.298398 25693 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.382961 25361 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.412582 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.414465 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:25.289438 25695 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.325528 25328 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:25.415676 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:25.466635 21871 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 9: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:07:25.416829 25783 consensus_meta.cc:287] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.005s
I20260709 13:07:25.461127 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:25.466161 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.470582 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:25.467973 21875 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:25.471487 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:25.471967 21869 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:25.472141 21871 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:25.473001 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:25.474692 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:25.426635 25791 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.328225 25679 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.482136 25809 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:25.485535 25809 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.488411 25809 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.489179 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:25.490008 25695 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.491075 25791 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.491536 25697 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.492664 25693 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.425024 25787 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.493239 25791 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.482633 25407 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.474460 25783 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.497102 21946 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:25.499653 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:25.500455 21869 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.329253 25624 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.466156 25717 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.507655 21916 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:25.523409 21916 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:25.329495 25798 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.537197 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:25.515740 25787 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:25.467172 25672 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.538746 21950 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:25.512953 25809 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.470764 25361 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.538102 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:25.547497 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 117069us
I20260709 13:07:25.474756 25743 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.534885 25695 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.507000 25688 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:07:25.540303 25704 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:25.555872 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:25.558252 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 279393us
I20260709 13:07:25.559020 21871 raft_consensus.cc:2410] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:25.540306 25218 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:07:25.569705 21950 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:25.581660 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:25.589251 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 574) took 1151 ms. Trace:
I20260709 13:07:25.556160 25695 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.542596 25614 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.548491 25740 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:25.550534 25653 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.589772 21872 rpcz_store.cc:276] 0709 13:07:24.438207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.438384 (+   177us) service_pool.cc:224] Handling call
0709 13:07:24.452807 (+ 14423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.482198 (+ 29391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.482225 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.482813 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 13:07:24.551669 (+ 68856us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:24.551728 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.582943 (+1031215us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b540002b554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:25.582989 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.583034 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:25.583045 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.589187 (+  6142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1223,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":66766720,"thread_start_us":68401,"threads_started":1,"wal-append.queue_time_us":87210}
I20260709 13:07:25.604789 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:25.606236 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:25.553951 25725 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.599547 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 444) took 1066 ms. Trace:
I20260709 13:07:25.613193 22022 rpcz_store.cc:276] 0709 13:07:24.533278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.536713 (+  3435us) service_pool.cc:224] Handling call
0709 13:07:25.599377 (+1062664us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001ee6d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:25.599486 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367289216}
W20260709 13:07:25.602662 22576 leader_election.cc:336] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.563s (SENT)
I20260709 13:07:25.583093 25704 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.589649 25783 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.551594 25809 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.552901 25413 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.584736 25801 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.599238 25328 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.740006 22022 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:25.799315 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:25.662488 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.806799 22019 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:25.703272 25816 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:07:25.589030 25325 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.198s
W20260709 13:07:25.707442 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 94540us
I20260709 13:07:25.743482 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:25.805541 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.752297 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:25.751814 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:25.790443 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:25.600847 25695 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.746625 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:25.628199 25283 consensus_meta.cc:287] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.754s	user 0.013s	sys 0.000s
I20260709 13:07:25.837247 21988 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:25.799686 25821 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:25.841822 22017 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:25.843382 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:25.609390 25803 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.800968 25629 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:25.836473 21950 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:25.702391 25361 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.691964 25739 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:25.845345 25433 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:25.810354 25704 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.857195 22018 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:25.837168 25671 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.810192 25697 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.863543 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:25.839427 25813 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:25.627327 25048 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.227s
I20260709 13:07:25.847172 25803 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.611801 25478 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.239s
I20260709 13:07:25.805667 25723 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.713032 25737 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:25.810667 25328 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.611680 25810 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.251s
I20260709 13:07:25.874986 21943 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.701951 25797 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:07:25.866148 25679 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:25.893582 21869 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:25.703219 25785 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.855193 25743 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.871119 25783 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:07:25.888132 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:25.888722 25817 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:25.876158 25803 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.871716 25671 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.897953 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:25.912110 21942 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.870436 25433 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:25.907315 25785 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.913296 25433 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.852139 25827 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:07:25.851181 25283 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:25.907518 22601 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:25.891793 25809 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:25.910482 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 66014.5us
I20260709 13:07:25.870077 25629 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:07:25.975214 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.875152 25653 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:07:25.894794 25328 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:25.914892 25788 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.010s	sys 0.010s
I20260709 13:07:25.915200 25672 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:25.882181 25813 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.012434 25571 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.103493 21943 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:07:26.104108 21943 pending_rounds.cc:85] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 6
I20260709 13:07:26.104391 21943 pending_rounds.cc:107] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:26.104697 21943 raft_consensus.cc:2889] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.019867 25757 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:26.111914 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:26.081065 21942 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
W20260709 13:07:26.027660 25788 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.010s	sys 0.011s
I20260709 13:07:26.013648 25809 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.112493 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:26.123292 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 127459us
I20260709 13:07:26.124701 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.123965 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:26.124135 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:26.127081 25548 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:26.112911 25672 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:07:26.127476 21941 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.128289 22602 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:26.125638 22607 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:26.130159 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.137228 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2111) took 2107 ms. Trace:
I20260709 13:07:26.121688 25757 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:26.129769 25809 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:26.136025 25828 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:07:26.133746 25671 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.146024 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:26.146412 21943 rpcz_store.cc:276] 0709 13:07:24.015480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.016520 (+  1040us) service_pool.cc:224] Handling call
0709 13:07:24.016804 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.874468 (+1857664us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b58004c82d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fce0aa 00007f6356050447 00007f6356068fe7 00007f635606a7de 00007f6356074b49 00007f6356075416 00007f6356071d8f 00007f635607183e 00007f635b036419 00007f63545adbd4
0709 13:07:26.121552 (+247084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.122329 (+   777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190316416}
W20260709 13:07:26.146908 21841 leader_election.cc:336] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.615s (SENT)
I20260709 13:07:26.163604 21872 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:26.164063 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:26.122401 22018 raft_consensus.cc:2376] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8. Re-sending same reply.
I20260709 13:07:26.141785 25801 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.173525 25807 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.151690 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:26.181355 25807 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.182631 25813 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.183593 25807 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.183737 25571 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.184677 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:26.185249 22024 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.188912 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.183746 25283 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:26.173614 25831 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.189980 25831 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.194905 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.195554 21869 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.195904 25737 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:26.197778 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:26.159994 25785 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.198429 21870 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:07:26.175742 25693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.016s	sys 0.010s
I20260709 13:07:26.202541 21869 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:26.209188 21870 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:26.179816 25671 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:26.211017 21869 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:26.166353 25724 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:26.201745 25716 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.206554 25693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.017s	sys 0.010s
I20260709 13:07:26.201365 25831 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.217614 25704 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.205538 25723 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.224210 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:26.228952 21869 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:26.229871 25328 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.362339 25328 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:26.213722 25757 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.363495 25757 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:26.365626 21841 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.809s (SENT)
I20260709 13:07:26.367362 22019 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:26.364666 25803 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.236361 25702 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.372470 25704 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.373718 25723 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:26.374297 25723 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.374887 22024 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
W20260709 13:07:26.376237 25695 consensus_meta.cc:287] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.013s
I20260709 13:07:26.376402 25723 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.376693 25695 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:26.378333 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 226752us
I20260709 13:07:26.378710 25695 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.379221 22576 leader_election.cc:400] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10.
I20260709 13:07:26.380937 21943 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.381850 25671 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.382437 25671 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.385097 25671 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.385097 25838 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:26.385906 25838 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.379969 25716 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.372341 25809 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.453181 21943 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:26.432089 25822 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:26.462481 25822 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:26.463441 25822 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.419148 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:26.464963 22602 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:26.420035 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:26.466814 21841 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.937s (SENT)
I20260709 13:07:26.467190 22606 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.423202 25729 consensus_queue.cc:1059] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:26.469827 25729 raft_consensus.cc:3055] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:26.470321 25729 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:26.471194 25729 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.472234 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:26.472906 22602 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.473716 25715 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.479245 25614 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.481272 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:26.483132 25822 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.487442 22602 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:26.491789 25740 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.492281 25740 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.492702 25740 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.493767 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 589) took 1378 ms. Trace:
I20260709 13:07:26.494071 22602 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:26.396646 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 661) took 1610 ms. Trace:
I20260709 13:07:26.472364 25729 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.418722 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:26.425266 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 771) took 1333 ms. Trace:
I20260709 13:07:26.414578 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2504) took 1134 ms. Trace:
I20260709 13:07:26.418386 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2128) took 1008 ms. Trace:
I20260709 13:07:26.416694 25793 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.428828 21866 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:07:26.403862 25440 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:26.439175 25671 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.406586 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 590) took 1290 ms. Trace:
I20260709 13:07:26.444790 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:26.447793 25838 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.448485 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:26.502043 25702 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:26.506050 25827 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.506551 25702 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.506556 25827 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.507452 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:26.449960 21867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 1900) took 1755 ms (client timeout 1594 ms). Trace:
I20260709 13:07:26.450785 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2123) took 1069 ms. Trace:
W20260709 13:07:26.508049 21867 rpcz_store.cc:269] 0709 13:07:24.694741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.694894 (+   153us) service_pool.cc:224] Handling call
0709 13:07:26.449715 (+1754821us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400217d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:26.449858 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245793280}
I20260709 13:07:26.508816 25827 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.509042 21871 rpcz_store.cc:276] 0709 13:07:25.280660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.472747 (+192087us) service_pool.cc:224] Handling call
0709 13:07:26.414383 (+941636us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54003764d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:26.414516 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195778432}
I20260709 13:07:26.509660 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.509840 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.510182 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.510258 21867 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.510453 21942 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:26.510815 21871 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.512027 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.508148 21946 rpcz_store.cc:276] 0709 13:07:25.381856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.382204 (+   348us) service_pool.cc:224] Handling call
0709 13:07:25.382631 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.497594 (+114963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.450585 (+952991us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54000fb254. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:26.450732 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262690560}
I20260709 13:07:26.512980 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:26.513197 25671 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.513690 21944 raft_consensus.cc:2368] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:26.417999 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:26.514058 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.514686 22607 raft_consensus.cc:2368] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:26.488669 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2120) took 1175 ms. Trace:
I20260709 13:07:26.505343 25543 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:26.515697 22604 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:26.512316 21873 rpcz_store.cc:276] 0709 13:07:25.115989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.116124 (+   135us) service_pool.cc:224] Handling call
0709 13:07:25.116470 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.167821 (+ 51351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.167864 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.168326 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.236396 (+ 68070us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:25.533946 (+297550us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.534348 (+   402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.803515 (+269167us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b1800374980. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:26.406201 (+602686us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b540022bd54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:26.406270 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.406331 (+    61us) raft_consensus.cc:1685] finished
0709 13:07:26.406349 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.406511 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32724,"prepare.queue_time_us":270091,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":41755,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":166,"spinlock_wait_cycles":47419136,"thread_start_us":330544,"threads_started":2,"wal-append.queue_time_us":134305}
I20260709 13:07:26.507202 25702 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.516680 25440 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.517187 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.517800 21873 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.518605 25440 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.518837 25702 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.514075 22608 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.395979 25803 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.515646 25543 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.521538 25793 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:26.501771 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 98216.8us
I20260709 13:07:26.522390 25543 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.522490 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2511) took 1237 ms. Trace:
I20260709 13:07:26.515048 21948 rpcz_store.cc:276] 0709 13:07:25.314413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.315588 (+  1175us) service_pool.cc:224] Handling call
0709 13:07:25.315929 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:25.316299 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.316328 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:25.356447 (+ 40119us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.561571 (+205124us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:25.582701 (+ 21130us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.488095 (+905394us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b1800367ea0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287
0709 13:07:26.488225 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.488303 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.488345 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:26.488430 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.488581 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3127,"prepare.queue_time_us":19989,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":30281,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":7988,"spinlock_wait_cycles":5740928,"thread_start_us":157577,"threads_started":2,"wal-append.queue_time_us":406451}
I20260709 13:07:26.522962 21870 rpcz_store.cc:276] 0709 13:07:25.285192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.202583 (+917391us) service_pool.cc:224] Handling call
0709 13:07:26.205803 (+  3220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.211725 (+  5922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.522306 (+310581us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b5400218750. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:26.522434 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6501248}
I20260709 13:07:26.524020 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.524151 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:26.528246 21870 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:26.529881 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:26.508683 22601 rpcz_store.cc:276] 0709 13:07:25.091954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.092157 (+   203us) service_pool.cc:224] Handling call
0709 13:07:26.425059 (+1332902us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400522e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:26.425206 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832940416}
I20260709 13:07:26.530534 21948 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.530805 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.531453 21870 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.494194 21874 rpcz_store.cc:276] 0709 13:07:25.115667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.116211 (+   544us) service_pool.cc:224] Handling call
0709 13:07:25.121452 (+  5241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.151655 (+ 30203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.151695 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.151742 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:25.151773 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.493547 (+1341774us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5400025154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:26.493590 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.493714 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68973952}
I20260709 13:07:26.531832 25543 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:26.524618 21866 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.513756 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.533366 21946 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:26.526434 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.515336 25671 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.525878 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:26.540376 25679 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.532505 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.540833 25679 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.541349 25679 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.542006 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:26.537086 25815 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.956s	user 0.002s	sys 0.009s
I20260709 13:07:26.540710 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:26.543891 25677 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:26.544371 25677 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:26.544487 24706 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:26.545279 25677 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.546273 25803 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.546729 25803 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:26.548833 25844 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:26.550174 25803 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.528307 21947 rpcz_store.cc:276] 0709 13:07:25.409689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.490211 (+ 80522us) service_pool.cc:224] Handling call
0709 13:07:25.490527 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.554431 (+ 63904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.554461 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:25.554505 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:25.554536 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.418159 (+863623us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b540029ac54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:26.418206 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.418323 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146445184}
I20260709 13:07:26.550230 25844 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:26.552052 25844 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.527292 21839 leader_election.cc:400] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:26.394301 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2497) took 1121 ms. Trace:
I20260709 13:07:26.671536 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.583328 25679 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.585906 21871 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:26.587213 21873 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:26.459184 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.457988 21868 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:26.581013 25844 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.673206 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.689704 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:26.589675 21867 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:26.588562 21950 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:26.589454 22606 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:26.628144 25717 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:26.592104 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:26.591495 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.588562 21866 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:26.598906 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:26.693593 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.694711 21944 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:26.607388 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:26.611313 25716 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:26.683357 25813 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:26.629580 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:26.637584 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:26.615130 25478 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:26.615902 22022 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 7. Current term is 8. Ops: [4.6-7.8]
I20260709 13:07:26.617306 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:26.619012 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.702446 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:26.619313 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.619613 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.703186 21866 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:26.620281 22024 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:26.645347 25695 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.622221 21988 leader_election.cc:400] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11.
I20260709 13:07:26.623747 22021 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:26.592232 22573 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:26.703984 21988 leader_election.cc:403] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.647017 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:26.704417 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 112272us
I20260709 13:07:26.705341 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:26.705890 22017 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.592468 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.596331 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.706959 21942 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:26.593432 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:26.602394 25693 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:26.606769 25842 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.218s	user 0.002s	sys 0.003s
I20260709 13:07:26.613368 22608 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:26.713210 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.607789 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.713929 21944 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:26.659101 21948 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:26.495723 22610 rpcz_store.cc:276] 0709 13:07:24.786235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.786423 (+   188us) service_pool.cc:224] Handling call
0709 13:07:24.786923 (+   500us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:24.821713 (+ 34790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.821745 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:24.844332 (+ 22587us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.004035 (+159703us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:25.045740 (+ 41705us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.049082 (+  3342us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.049329 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.396236 (+1346907us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b540062a7d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:26.396279 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.396403 (+   124us) raft_consensus.cc:1685] finished
0709 13:07:26.396422 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.396573 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4703,"prepare.queue_time_us":42765,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":9586,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":16771,"spinlock_wait_cycles":22636928,"thread_start_us":144942,"threads_started":1,"wal-append.queue_time_us":217289,"wal-append.run_cpu_time_us":2823,"wal-append.run_wall_time_us":1041339}
I20260709 13:07:26.582278 25827 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:26.690536 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.715801 21871 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.590472 21874 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:26.692009 21873 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:26.671548 21839 leader_election.cc:403] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.671799 21875 rpcz_store.cc:276] 0709 13:07:25.272435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.275550 (+  3115us) service_pool.cc:224] Handling call
0709 13:07:26.394108 (+1118558us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003769d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:26.394239 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426922240}
I20260709 13:07:26.694756 21869 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.695611 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:26.696655 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.698122 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.722374 21943 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:26.699150 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.702512 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:26.723975 21867 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:26.731503 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:26.713769 25748 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.732420 21866 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.788542 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.789337 21947 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:26.790591 21941 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:26.759377 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.792083 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 162625us
I20260709 13:07:26.803489 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:26.804287 21942 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:26.805459 25740 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.806152 21869 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:26.806823 25679 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:26.806895 25809 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:26.807490 25740 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.809993 21869 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:07:26.811663 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:26.812780 21946 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:26.732800 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 205645us
I20260709 13:07:26.813967 21839 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:26.814177 25548 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:26.815965 21839 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:26.622416 21987 leader_election.cc:400] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:07:26.819060 21987 leader_election.cc:403] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.706547 22015 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:26.709196 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:26.709566 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 87488us
I20260709 13:07:26.820665 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:26.820803 22573 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:26.722287 21950 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:26.821309 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:26.635553 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:26.821991 21946 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:26.822530 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 187056us
I20260709 13:07:26.723105 21949 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:26.701838 21870 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:26.819656 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:26.732461 21868 raft_consensus.cc:2410] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:07:26.755331 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.817341 22017 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:26.816937 25748 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:26.832906 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:26.828449 22610 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:26.834790 21871 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:26.829126 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:26.836796 22608 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.830004 21866 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:26.845911 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:26.845780 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 223549us
I20260709 13:07:26.830921 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:26.832069 21988 leader_election.cc:400] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:07:26.856459 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:26.713641 25808 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11.
I20260709 13:07:26.849635 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:26.824663 25720 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.713084 25693 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:26.845414 25723 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:26.832401 25788 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:26.831735 25671 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.855818 25697 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.825235 25740 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.733598 25803 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.832144 25793 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:26.842362 25679 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.875258 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.870270 22608 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:26.878396 21946 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:26.882470 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:26.884766 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:26.978430 22021 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:26.890535 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.733830 25827 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:26.901695 22016 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:26.902356 22019 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:26.857188 25526 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:26.702709 25813 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.849611 25841 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.859315 25702 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.732558 25695 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:26.909749 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 70138us
I20260709 13:07:26.732694 25478 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.847502 25433 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:07:26.907823 25847 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:07:26.961007 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 104623us
I20260709 13:07:26.908258 25740 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.874527 25548 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:26.978439 22024 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:26.976655 25679 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.003443 21768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 252) took 18955 ms (client timeout 15000 ms). Trace:
I20260709 13:07:26.908370 25788 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.010413 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:27.015954 25788 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.968035 25748 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:26.987973 25693 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.020438 25693 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.021255 25871 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.021816 25871 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.023933 25871 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:27.025601 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 177316us
I20260709 13:07:27.025972 25695 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:27.027978 25813 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:26.986737 25526 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:27.036377 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.029706 22023 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:27.030440 22016 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:27.033347 22024 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:26.991741 25702 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:27.006934 25740 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.983937 25671 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:27.044080 25798 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:27.055514 25798 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:27.041837 25526 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.984997 25793 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.008334 25679 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:27.008694 21768 rpcz_store.cc:269] 0709 13:07:08.037356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.088492 (+ 51136us) service_pool.cc:224] Handling call
0709 13:07:26.992326 (+18903834us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:23.473409 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:23.475511 (+  2102us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:23.475583 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:07:23.475611 (+    28us) tablet.cc:662] Decoding operations
0709 13:07:23.478737 (+  3126us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:23.478844 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:23.478871 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:23.480311 (+  1440us) tablet.cc:701] Row locks acquired
0709 13:07:23.480387 (+    76us) write_op.cc:260] PREPARE: finished
0709 13:07:23.513582 (+ 33195us) write_op.cc:270] Start()
0709 13:07:23.537658 (+ 24076us) write_op.cc:276] Timestamp: P: 1783602443497885 usec, L: 0
0709 13:07:23.545031 (+  7373us) op_driver.cc:348] REPLICATION: starting
0709 13:07:23.889310 (+344279us) log.cc:844] Serialized 5859 byte log entry
0709 13:07:24.293223 (+403913us) op_driver.cc:464] REPLICATION: finished
0709 13:07:24.430829 (+137606us) write_op.cc:301] APPLY: starting
0709 13:07:24.430926 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:24.435817 (+  4891us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:24.435990 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:24.625544 (+189554us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:24.626035 (+   491us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:07:24.626087 (+    52us) write_op.cc:312] APPLY: finished
0709 13:07:24.626538 (+   451us) log.cc:844] Serialized 107 byte log entry
0709 13:07:24.626760 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:24.626928 (+   168us) write_op.cc:454] Released schema lock
0709 13:07:24.626996 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:24.668853 (+ 41857us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:24.680715 (+ 11862us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3880737,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":137323,"apply.run_cpu_time_us":6144,"apply.run_wall_time_us":228861,"num_ops":15,"prepare.queue_time_us":186412,"prepare.run_cpu_time_us":23113,"prepare.run_wall_time_us":486546,"raft.queue_time_us":139727,"raft.run_cpu_time_us":14237,"raft.run_wall_time_us":90613,"replication_time_us":748006,"thread_start_us":365139,"threads_started":4,"wal-append.queue_time_us":140287,"wal-append.run_cpu_time_us":62664,"wal-append.run_wall_time_us":1666817}]]}
I20260709 13:07:27.044931 25702 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.051925 25723 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:27.052902 25697 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.057317 25695 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:27.086788 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 109767us
I20260709 13:07:27.075778 21771 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.057803 25440 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:07:27.137032 25440 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:27.137435 25440 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:27.138538 25440 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.140059 25440 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.141846 25793 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:27.145265 25864 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:07:27.109830 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73512.9us
I20260709 13:07:27.058156 25048 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:27.097465 25695 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.043753 25827 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.043880 25687 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:07:27.120739 25865 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 13:07:27.120877 21771 catalog_manager.cc:5697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 4 to 9, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 9 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.123870 25543 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:27.129806 25478 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:27.131562 25813 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:27.132989 25723 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.133854 21946 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:27.148080 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:27.148988 21914 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.159049 22021 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:07:27.149411 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 299827us
I20260709 13:07:27.153098 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.150343 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:27.169102 22024 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:27.177664 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.179759 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.181041 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:27.162346 25695 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.179677 21771 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 7 to 8, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 8 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.190888 25875 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.182176 25884 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:27.164286 25793 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:27.175727 25328 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:27.183207 25827 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.164784 25543 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:27.173557 25798 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.190888 21873 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:27.187500 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:27.137431 25526 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.192132 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.170934 25687 consensus_queue.cc:1243] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:27.214201 21866 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:27.229333 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.168744 25813 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:27.188158 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:27.194927 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:27.196779 21771 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 5 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 7 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.180145 25748 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:27.184557 25720 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.198845 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:27.239327 22606 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:27.212561 25548 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:27.231513 25687 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:27.242714 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:27.197012 25884 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:27.196797 25875 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:27.194001 25878 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:27.197908 25704 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.249130 22021 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:27.235221 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.172267 25803 consensus_queue.cc:1059] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:07:27.185061 25244 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:07:27.250667 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:27.199138 25793 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.254338 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:27.199136 25328 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:27.243300 21771 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 4 to 8, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 8 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:27.226182 25841 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:27.228209 25870 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:27.246083 22606 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:27.246490 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:27.248528 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:27.251420 21866 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
W20260709 13:07:27.240620 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 212506us
I20260709 13:07:27.242488 25810 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9.
I20260709 13:07:27.193359 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:27.256479 25882 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:27.256068 25813 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.280260 21987 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:27.245481 25720 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:27.213286 25543 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.213613 25798 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:27.273885 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.244354 25748 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:27.254482 25697 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:27.329140 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49001.1us
I20260709 13:07:27.335628 25888 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.336242 25888 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:27.336632 25888 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.339120 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:27.339943 25677 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:27.340780 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:27.340791 25677 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:27.342607 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:27.342959 25677 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.343868 25677 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:27.346995 21988 connection.cc:256] RPC call timeout handler was delayed by -1.0731208149999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 13:07:27.347582 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:27.344223 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:27.357818 25729 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:27.358458 25729 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:27.358935 25729 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.361591 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:27.369410 25677 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:27.370126 25677 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:27.371280 25677 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.386991 25890 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.388024 25890 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:27.277562 25870 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:27.393280 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:27.397392 21867 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.281811 25882 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:27.382520 21771 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:27.331558 25813 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.278388 25757 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.109s
W20260709 13:07:27.404646 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 195100us
I20260709 13:07:27.332181 25697 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.253268 25878 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:27.423633 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.410442 25880 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.413421 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 220005us
I20260709 13:07:27.328235 25717 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:07:27.355880 25888 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.401127 25870 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.474931 21867 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:27.405184 25882 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.422178 25697 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.424741 21839 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:27.489912 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 65260.2us
I20260709 13:07:27.490669 25886 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.493189 25881 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:07:27.412909 25875 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.403939 25884 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.479646 25880 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.401605 25548 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.412637 25328 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.495911 25526 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:27.477603 25720 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:27.501386 25717 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:27.505810 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:27.504521 25871 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:27.557063 21771 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 7 to 11, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 11 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.489516 25679 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.551596 25867 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:27.616701 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.588765 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 334473us
I20260709 13:07:27.625856 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:27.502089 25748 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:27.675673 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 298912us
I20260709 13:07:27.680377 22023 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:27.687892 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:27.669104 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.660509 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.698597 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.663110 21771 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:27.694878 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.699580 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:27.700758 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.701917 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:27.573065 25704 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:27.626511 25895 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.703310 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 514304us
I20260709 13:07:27.718503 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.719746 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:27.720032 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.515389 25886 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.720939 22018 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:27.710366 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.665638 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:27.919981 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:27.920841 22021 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.560359 25897 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:27.712930 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:27.712277 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:27.705049 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 44612.1us
I20260709 13:07:27.725394 21866 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:27.724792 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.589576 21867 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:27.947046 22015 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:27.703323 25861 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:07:27.954509 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.734645 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.559259 25871 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:27.736719 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 404009us
I20260709 13:07:27.557796 25822 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.156s
I20260709 13:07:27.673283 25793 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:27.985774 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 407150us
W20260709 13:07:27.787405 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 300574us
I20260709 13:07:27.695502 25887 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:27.694160 25841 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:27.810997 25729 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.805449 22024 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:27.903513 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.933099 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:27.811759 25827 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:27.945977 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:27.972987 22021 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:27.986730 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:27.574190 25892 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.927088 25902 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:28.032186 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 86317.8us
I20260709 13:07:27.801738 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.030519 21867 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:27.730545 25895 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:27.989929 25888 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.046727 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:28.021099 25723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.012s	sys 0.062s
W20260709 13:07:28.052412 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 250758us
W20260709 13:07:28.030997 25876 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:27.997169 25908 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.058127 22608 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:28.058295 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 338644us
I20260709 13:07:28.069435 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:28.060400 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.030583 25892 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:28.078498 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:28.059443 25723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.013s	sys 0.062s
I20260709 13:07:28.062798 25912 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.094384 25912 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:28.068655 25902 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:28.094826 25899 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:07:28.095709 25543 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.096907 25910 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:28.097088 25891 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
W20260709 13:07:28.093840 25896 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:07:28.076534 25740 consensus_meta.cc:287] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.999s	user 0.006s	sys 0.005s
I20260709 13:07:28.104486 25878 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:28.101245 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.977826 25704 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:28.073822 25440 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.933s	user 0.014s	sys 0.000s
I20260709 13:07:28.088174 25888 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:28.119362 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:28.148415 22017 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:28.012481 25887 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.098933 25911 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.142971 25880 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.094843 25912 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.086853 25892 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.042107 25897 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.101047 25867 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:28.152997 25679 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:28.144733 21946 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.014s	sys 0.019s
W20260709 13:07:28.168951 21946 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.014s	sys 0.019s
W20260709 13:07:28.164439 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 174057us
I20260709 13:07:28.123428 25723 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:28.118163 25909 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:28.157130 25911 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:28.152644 25888 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:28.120566 25740 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.147200 25904 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:07:28.208561 25904 consensus_queue.cc:1243] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:28.176367 25808 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:28.209192 25808 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:28.210063 25808 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.211261 25808 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.211745 25695 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.009s	user 0.008s	sys 0.002s
W20260709 13:07:28.208034 25813 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.796s	user 0.007s	sys 0.002s
I20260709 13:07:28.156076 25440 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:28.183991 25867 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:28.220798 21870 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:28.196319 25716 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:28.224687 25895 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.226425 25897 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:28.227633 25866 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.167s	user 0.008s	sys 0.007s
W20260709 13:07:28.229434 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 267208us
I20260709 13:07:28.231246 25808 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:28.234390 25844 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.095709 25902 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.123840 25841 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.247761 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1921) took 1063 ms. Trace:
I20260709 13:07:28.249552 25887 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:28.254083 25822 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:28.193749 25911 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.289033 25697 consensus_meta.cc:287] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.002s
W20260709 13:07:28.199780 25893 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.474s	user 0.001s	sys 0.001s
I20260709 13:07:28.261843 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:28.314554 21941 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:28.281409 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.187889 25723 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:28.261523 25922 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:28.260537 25873 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.259558 25798 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:28.288646 25729 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.256395 25886 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:28.300971 21872 rpcz_store.cc:276] 0709 13:07:27.184790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.184919 (+   129us) service_pool.cc:224] Handling call
0709 13:07:27.185233 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.185595 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.185625 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.195049 (+  9424us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.553279 (+358230us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:27.553336 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.553589 (+   253us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.247466 (+693877us) raft_consensus.cc:1685] finished
0709 13:07:28.247495 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.247678 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8736,"thread_start_us":312727,"threads_started":1,"wal-append.queue_time_us":974674}
I20260709 13:07:28.274223 25871 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.223022 25695 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:28.214583 25702 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.122s	user 0.006s	sys 0.006s
I20260709 13:07:28.283653 25808 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:28.289579 25895 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.296305 25844 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.346107 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 606) took 1515 ms. Trace:
W20260709 13:07:28.313427 25906 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:07:28.313692 25919 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.347936 25909 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.356194 25868 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:28.321247 25887 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:07:28.350741 25798 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:07:28.353740 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1920) took 1169 ms. Trace:
I20260709 13:07:28.310565 25897 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:28.312419 25822 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.361637 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2698) took 1743 ms. Trace:
I20260709 13:07:28.366015 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:28.378799 22021 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
W20260709 13:07:28.365250 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 299254us
I20260709 13:07:28.380666 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:28.378455 22022 rpcz_store.cc:276] 0709 13:07:26.617988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.713679 (+ 95691us) service_pool.cc:224] Handling call
0709 13:07:26.730907 (+ 17228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.731258 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.731285 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.731741 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.906228 (+174487us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:26.906271 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.906335 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.227060 (+1320725us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:28.351953 (+124893us) raft_consensus.cc:1685] finished
0709 13:07:28.351984 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.361562 (+  9578us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2658,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":2881408,"thread_start_us":174075,"threads_started":1,"wal-append.queue_time_us":263124}
I20260709 13:07:28.366866 21870 rpcz_store.cc:276] 0709 13:07:26.830213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.830611 (+   398us) service_pool.cc:224] Handling call
0709 13:07:28.345828 (+1515217us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003ad254. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:28.346039 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3154234624}
I20260709 13:07:28.368930 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:28.354866 25723 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.373766 21869 rpcz_store.cc:276] 0709 13:07:27.184423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.184539 (+   116us) service_pool.cc:224] Handling call
0709 13:07:27.191186 (+  6647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.194162 (+  2976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.194192 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.198430 (+  4238us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.413150 (+214720us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:27.413192 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.413263 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.261492 (+848229us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b48000801d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:07:28.353485 (+ 91993us) raft_consensus.cc:1685] finished
0709 13:07:28.353506 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.353682 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2616,"raft.queue_time_us":4539,"raft.run_cpu_time_us":5074,"raft.run_wall_time_us":1065593,"spinlock_wait_cycles":27202304,"thread_start_us":214343,"threads_started":1,"wal-append.queue_time_us":424904}
I20260709 13:07:28.321282 25697 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.310109 25888 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.417070 21941 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:28.382961 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:28.382318 21914 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:28.398062 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 313083us
I20260709 13:07:28.359103 25702 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.461282 21868 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:28.462882 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:28.464397 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 81529.2us
W20260709 13:07:28.452327 25870 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.944s	user 0.009s	sys 0.003s
W20260709 13:07:28.466674 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 84438.9us
W20260709 13:07:28.467502 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.426193 25717 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:28.370447 25895 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.453992 25910 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:28.398663 25897 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.469260 25548 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:28.488168 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 203244us
I20260709 13:07:28.490787 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.478709 25916 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.378477 25903 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:07:28.495945 22573 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:28.500406 21945 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:07:28.492919 25803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.237s	user 0.002s	sys 0.013s
I20260709 13:07:28.489754 25548 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.372164 25919 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.377902 25868 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.491461 25748 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:28.320672 25867 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.347524 25873 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.479074 25870 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.534776 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.583520 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:28.506486 25803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.002s	sys 0.014s
I20260709 13:07:28.372581 25909 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:28.625277 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 97283.8us
W20260709 13:07:28.624416 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 131134us
I20260709 13:07:28.503407 25929 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:28.507843 25548 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.629340 25844 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:28.631546 22575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.013s	sys 0.031s
W20260709 13:07:28.636245 22575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.013s	sys 0.032s
I20260709 13:07:28.632071 25927 raft_consensus.cc:2764] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:28.632485 25930 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.161s
I20260709 13:07:28.633147 25947 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:28.623857 25695 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.634671 25909 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:28.640575 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 166374us
I20260709 13:07:28.508157 25907 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:07:28.656513 21838 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.653918 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:28.676056 22606 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:28.498791 25916 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.664635 21942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:28.514935 25910 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:28.678498 25935 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:07:28.652412 25930 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:07:28.680781 25941 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:07:28.681913 25931 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:28.682096 25916 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.665026 25704 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.683617 25938 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:28.683382 25704 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.649261 25822 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.685699 25895 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.668433 25697 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.686590 25702 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.688773 25930 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:28.689352 25930 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:28.689993 25873 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.689924 25798 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:28.690261 25930 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:28.693755 25892 consensus_meta.cc:287] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.004s
I20260709 13:07:28.667908 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.694621 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.668787 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.668946 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.666723 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.696694 21941 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:28.697014 21949 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:28.666723 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:28.601017 25932 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 13:07:28.671243 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.671303 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.646780 25929 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:28.681605 25945 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:28.693928 25940 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:07:28.690161 25543 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 13:07:28.697899 22608 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:28.601528 25748 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.694658 21944 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:28.694335 25808 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:28.705677 25934 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.223s	user 0.001s	sys 0.001s
W20260709 13:07:28.711109 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 129256us
I20260709 13:07:28.714500 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:28.715112 21948 raft_consensus.cc:2410] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:28.666582 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:28.722674 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66251.3us
I20260709 13:07:28.726503 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.731774 21944 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:28.731868 25808 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.732661 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.732700 25945 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:28.733377 21944 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:28.734279 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:28.734509 25945 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:28.734812 21944 raft_consensus.cc:2376] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9. Re-sending same reply.
I20260709 13:07:28.725100 25788 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.735688 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.735877 25788 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.736244 25788 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.736347 25942 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:07:28.737373 25942 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:28.737768 25942 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:28.715783 25716 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:28.738433 25716 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.738555 25942 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.739938 25942 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.694329 25892 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:28.740293 25948 consensus_queue.cc:1175] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 8 status { last_received { term: 7 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:28.741269 25868 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:28.721539 25912 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.002s
I20260709 13:07:28.742841 25892 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:28.742790 25912 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.737347 21944 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:28.745231 25912 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:28.745888 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:28.746644 21944 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:28.739455 25929 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.685732 25704 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.747637 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.726768 21943 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:28.730952 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.697976 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:28.750401 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:28.751401 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.756364 21948 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
W20260709 13:07:28.756471 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 58575.7us
I20260709 13:07:28.759039 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.761296 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.762790 21944 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:28.761548 22608 pending_rounds.cc:85] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 6
I20260709 13:07:28.764441 22608 pending_rounds.cc:107] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:28.764904 22608 raft_consensus.cc:2889] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.767294 21942 raft_consensus.cc:606] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:28.733173 25897 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.747918 25932 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:28.768787 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.752591 25939 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.777421 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.778539 25809 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.779031 25809 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.779436 25809 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:28.780467 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 49374.1us
W20260709 13:07:28.782068 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 117123us
I20260709 13:07:28.764175 25892 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.764616 25868 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:28.765733 25704 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.772686 25671 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.787196 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.783272 25897 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:28.775575 25478 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:28.791595 21838 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:28.775053 25932 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:28.788256 25892 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.788456 25704 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.785601 25939 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.798203 25704 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.800882 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:28.805460 25748 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.794687 25478 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:28.789717 25671 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:28.792213 25868 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:28.829169 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:28.829735 21872 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:28.823911 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:28.872934 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:28.841198 25898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.114s	user 0.002s	sys 0.028s
I20260709 13:07:28.827139 22606 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.794487 25871 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.793164 25897 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:28.873602 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49763.1us
I20260709 13:07:28.844180 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:28.873737 22603 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:28.875171 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:28.899515 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:28.875010 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:28.875687 22609 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:28.930220 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:28.929685 22020 raft_consensus.cc:2410] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:28.934922 22605 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.929584 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:28.825392 25723 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:28.935927 25723 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.898164 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:28.906188 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:28.938216 25868 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.932845 25478 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.942670 25478 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.944005 25809 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.946352 25809 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.946887 25548 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:28.948362 25882 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.440s	user 0.009s	sys 0.005s
W20260709 13:07:28.948808 25960 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:07:28.948905 25882 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.951275 25882 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:28.952097 22023 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:28.957026 21872 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:28.815450 25875 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:28.814451 25892 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.815126 25870 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.962118 22605 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:28.962213 21867 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.897491 25671 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:28.968538 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 144747us
I20260709 13:07:28.974531 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:28.931037 25897 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:28.928970 25898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.005s	sys 0.035s
W20260709 13:07:28.963131 25911 consensus_meta.cc:287] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.609s	user 0.003s	sys 0.007s
I20260709 13:07:28.983355 25911 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.983711 25788 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:28.984954 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:28.985802 25911 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:28.986222 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:28.986807 25788 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:28.975595 25740 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:28.987375 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:28.989158 25953 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.874773 25932 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:28.978623 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.933651 25871 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:28.989701 25953 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:28.990979 22017 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:28.898327 25961 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:28.976477 25875 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:28.987211 25911 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.004223 25048 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:29.004370 25911 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.005005 25956 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.005422 21867 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:29.005517 25956 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.005982 25956 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.988147 25716 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.001453 25942 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:29.000625 25910 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.999806 25961 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:29.016551 25716 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.016717 25961 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.015268 25548 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.002140 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:29.021867 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 92358.5us
I20260709 13:07:28.999341 25871 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.024669 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.025697 21947 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:29.006721 25911 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.026989 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:29.029129 22605 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.027767 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.015255 25942 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.036335 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:29.036911 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.038282 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.035799 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:29.040300 21945 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:29.031615 25948 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:29.041571 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:29.042409 21947 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:29.047781 22605 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:29.049629 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:29.050320 21948 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.030337 25953 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.051834 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.052887 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:29.049166 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:29.055676 21950 raft_consensus.cc:2410] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:29.034564 25942 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.058210 25870 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.058521 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:29.063745 25944 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:29.039801 25947 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.091991 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:29.097744 22021 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:29.063999 21948 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:29.066572 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:29.049605 25883 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:07:29.164042 21945 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.162562 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:29.161795 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.115696 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:29.166128 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:29.177000 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:29.177594 22608 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.163493 21946 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.163169 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:29.151006 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:29.150585 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:29.179694 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:29.179915 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:29.180305 21868 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.181443 22605 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:29.166143 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:29.157641 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1926) took 1913 ms. Trace:
I20260709 13:07:29.181528 21867 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.182968 21873 rpcz_store.cc:276] 0709 13:07:27.243918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.506891 (+262973us) service_pool.cc:224] Handling call
0709 13:07:27.507315 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.005950 (+498635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.005979 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.006019 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.006052 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.157393 (+1151341us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54000e10d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:29.157437 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.157580 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146239232}
I20260709 13:07:29.115469 25944 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.188118 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:29.118397 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.210695 21946 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:29.215070 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 149145us
I20260709 13:07:29.215886 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:29.217737 21873 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:07:29.156242 25967 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:07:29.230533 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:29.231416 21873 raft_consensus.cc:2410] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:29.225224 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.225979 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:29.232292 22605 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:29.228945 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:29.227838 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.233099 21950 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.137530 25882 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:29.235687 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:29.162510 25903 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.240075 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:29.242195 22608 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:29.055820 25930 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 13:07:29.244926 21869 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:29.162628 25841 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.219115 25548 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:29.251447 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:29.261698 22020 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.133126 25716 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 13:07:29.137552 25870 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:29.218981 25543 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:29.227218 25902 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:29.229292 25868 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.225648 25679 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:29.253860 25809 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.159040 25704 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.155845 25956 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.240588 25723 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.239055 25883 consensus_queue.cc:1243] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:29.238145 25788 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.246613 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:29.255986 25903 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:29.341621 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 151438us
W20260709 13:07:29.341676 21987 connection.cc:256] RPC call timeout handler was delayed by -1.6728072670000529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:07:29.351791 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:29.352865 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:29.353724 22608 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:29.065218 25875 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:29.378269 25894 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 1.589s	user 0.005s	sys 0.015s
I20260709 13:07:29.353818 25951 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:29.378854 25956 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.267881 25841 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.280526 25548 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.332716 25882 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:29.382953 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 124151us
I20260709 13:07:29.335158 25809 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:29.350409 25890 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.275812 21868 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:29.306210 25868 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.364995 22605 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:29.399189 21839 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:29.307425 25898 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:07:29.385823 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:29.389775 22020 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:29.302456 25902 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.325583 25679 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.403311 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:29.302693 25543 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.354863 25478 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:29.388514 25723 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.354293 25788 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.441747 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1922) took 2253 ms. Trace:
I20260709 13:07:29.394230 25953 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.394500 25946 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.442380 21871 rpcz_store.cc:276] 0709 13:07:27.188214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.188334 (+   120us) service_pool.cc:224] Handling call
0709 13:07:27.188652 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.199213 (+ 10561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.199253 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.199713 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.418016 (+218303us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:27.418056 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.420106 (+  2050us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.682228 (+1262122us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b48000801d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:07:29.377620 (+695392us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:29.441422 (+ 63802us) raft_consensus.cc:1685] finished
0709 13:07:29.441455 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.441655 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3588,"raft.queue_time_us":3767,"raft.run_cpu_time_us":23865,"raft.run_wall_time_us":1488311,"spinlock_wait_cycles":45650944,"thread_start_us":217908,"threads_started":1,"wal-append.queue_time_us":464616}
W20260709 13:07:29.447471 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.447477 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:29.464808 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.467180 22605 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:29.468253 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.439548 25951 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:29.404253 25965 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.493201 21838 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:29.401964 25890 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.476122 25948 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.474973 25883 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:07:29.450598 25723 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.520022 22605 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:29.499734 25948 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.503160 25951 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:29.405205 25870 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.514067 25911 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:07:29.555598 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 156500us
I20260709 13:07:29.562022 21839 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:29.569046 25951 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.529178 25948 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:29.574888 22576 connection.cc:256] RPC call timeout handler was delayed by -1.2466934480000873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:07:29.565546 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 72445.8us
I20260709 13:07:29.532250 25883 consensus_queue.cc:1243] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:29.568547 21839 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:29.569039 25986 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:29.586031 25971 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:07:29.589036 25868 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.589808 25543 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.590183 25723 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.516089 25809 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.591480 25704 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.593025 25890 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:29.593139 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:29.597205 25892 consensus_meta.cc:287] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
I20260709 13:07:29.599012 25942 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.589838 25679 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:29.603058 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.603991 22020 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.603834 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:29.605334 25897 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.004s
W20260709 13:07:29.607681 25671 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.000s
I20260709 13:07:29.667068 25897 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.667268 25671 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.668248 21867 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:29.608098 25903 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.513005 25882 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.609051 25898 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.609325 25788 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.610213 25548 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.617148 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:29.623624 22017 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:29.651602 25841 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.628057 22021 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:07:29.673697 25871 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.000s
W20260709 13:07:29.603137 25961 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.003s
I20260709 13:07:29.645656 22022 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:29.646224 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 77759.9us
I20260709 13:07:29.683207 22022 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:29.647707 25986 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:29.687800 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:29.651351 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.654647 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.694981 21948 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:29.631971 25895 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.675832 25898 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:29.567324 25911 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.651844 25695 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:29.661345 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.650455 25982 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:29.671569 22015 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:29.671722 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:29.626334 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:29.678645 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 61593.3us
I20260709 13:07:29.589028 25965 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:29.685585 25961 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.657878 25942 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.696137 25903 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:29.686794 25902 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.715560 25898 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.718508 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:29.671093 25892 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.681715 25679 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:29.729405 22018 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:29.716668 22022 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:29.755985 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 66493.1us
I20260709 13:07:29.762570 22022 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.756883 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:29.757220 21950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "105015b2b463442ab34e0509af7105fb"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:29.687294 25871 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.696830 25548 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:29.723807 25965 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:29.762774 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:29.763847 21950 raft_consensus.cc:606] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:29.718680 21946 raft_consensus.cc:2410] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:29.775394 21950 raft_consensus.cc:614] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:29.766420 21948 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:29.727224 25695 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.767436 25723 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:29.768065 25961 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.768731 25788 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.772344 22608 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:07:29.774528 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.622s (SENT) [suppressed 17 similar messages]
I20260709 13:07:29.714615 25895 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.776979 21870 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:29.798175 25895 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.777724 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:29.799307 25883 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:29.799860 25883 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:29.759253 25986 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:29.801388 25720 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.800951 25883 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.801206 25986 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.801872 25720 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:29.758661 25897 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.763496 25936 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.802806 25720 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.803932 25720 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.805230 22609 raft_consensus.cc:1217] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Deduplicated request from leader. Original: 7.7->[8.8-9.9]   Dedup: 8.8->[9.9-9.9]
I20260709 13:07:29.805886 22609 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:07:29.806319 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:29.807096 22606 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:29.807170 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:29.778512 25981 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:29.807839 22610 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:29.782130 25990 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:07:29.809955 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:29.784418 25723 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.778903 25890 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.786005 25871 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.777156 25965 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:29.787510 25919 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.789831 25911 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.790364 25695 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:29.793836 25948 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.794494 25939 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.726248 25982 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:29.761637 25671 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.809186 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:29.864336 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:29.864663 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:29.810793 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:29.865648 22017 raft_consensus.cc:2410] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:29.811770 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:29.807982 25981 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.783841 25892 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:29.817693 25897 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:29.818053 22021 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:29.820767 22022 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:29.877506 22022 pending_rounds.cc:85] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 5
I20260709 13:07:29.877775 22022 pending_rounds.cc:107] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:29.878007 22022 raft_consensus.cc:2889] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.880944 22610 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:29.797820 25788 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:29.837553 25723 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:29.944003 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.837749 25548 consensus_queue.cc:1059] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:07:29.947563 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 173045us
I20260709 13:07:29.950093 22019 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:29.957414 21841 connection.cc:256] RPC call timeout handler was delayed by -1.5161474230000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:07:29.957850 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:29.958112 21841 connection.cc:256] RPC call timeout handler was delayed by -1.4783474230000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:07:29.958788 21841 connection.cc:256] RPC call timeout handler was delayed by -1.3334474230000524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:07:29.959481 22020 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:29.962316 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 131052us
I20260709 13:07:29.963913 22608 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:29.980121 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:29.982048 21841 connection.cc:256] RPC call timeout handler was delayed by -1.2217504809999582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:07:29.982649 21841 connection.cc:256] RPC call timeout handler was delayed by -1.1984474230000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2383s for a response
W20260709 13:07:29.983031 21841 connection.cc:256] RPC call timeout handler was delayed by -1.0751474229999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.252s for a response
W20260709 13:07:29.983445 21841 connection.cc:256] RPC call timeout handler was delayed by -1.0643474229999583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25320000000000004s for a response
I20260709 13:07:29.973219 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:29.998821 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:29.999239 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.946839 25898 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.004724 25919 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.005300 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.005671 25871 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.006042 22020 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:30.007534 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:30.009095 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:29.959070 25827 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:07:30.073525 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.035316 25895 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:29.967132 25888 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:07:30.033946 25961 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.971882 25548 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:07:30.089915 25887 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.037271 25995 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.076692 25827 consensus_queue.cc:1243] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:30.070185 25981 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:30.005373 25919 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.072208 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:30.036350 25875 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:07:30.100706 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.088665 25895 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:30.103654 22020 raft_consensus.cc:2368] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10.
W20260709 13:07:30.104986 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 105675us
I20260709 13:07:30.106616 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:30.110136 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:30.105624 25895 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:30.115195 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.111268 25995 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.107381 25897 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.115456 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.128139 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.114229 25936 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:07:30.120682 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.098477 25887 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.131196 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.131809 21874 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:30.121841 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.132581 25887 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:30.133229 21873 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:30.133594 25788 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:30.116137 25868 raft_consensus.cc:2764] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:30.135358 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:30.125936 25948 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:30.137986 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.139547 25965 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.136482 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:30.112152 25898 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:30.141340 25997 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:07:30.142187 25902 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:30.146880 25895 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.139878 21874 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
W20260709 13:07:30.161137 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 246745us
I20260709 13:07:30.166733 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:30.168143 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:30.168358 25895 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:30.168782 22020 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.160632 25902 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:30.171698 25902 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.150393 25730 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:30.180560 22020 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:30.182600 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:30.173209 25996 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:30.173085 25730 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.161226 25868 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:07:30.189841 22020 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:30.173079 25902 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:30.203994 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 95052.6us
W20260709 13:07:30.212309 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.211700 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:30.206633 25898 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.215408 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.217773 21950 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:30.224071 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.227798 21950 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:07:30.217491 25898 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:30.231416 25898 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.233412 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.233700 25965 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:30.234170 21868 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:30.235328 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:30.238364 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.238992 21875 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:30.246011 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:30.250624 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.251614 21868 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:30.253182 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:30.254889 21868 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:30.256767 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:30.258508 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.259331 21875 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:30.260486 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:30.282155 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:30.239763 25693 raft_consensus.cc:3055] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:30.286629 25693 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:30.287508 25693 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.288704 25693 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.221271 25924 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.221115 25548 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:30.295485 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.304111 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.305060 21875 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:30.304365 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.306679 21868 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:30.309157 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.309428 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:30.302774 25548 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.321404 25548 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.305280 25871 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:30.327016 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.303049 25898 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:30.351895 25952 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.551s	user 0.003s	sys 0.000s
I20260709 13:07:30.373528 25944 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:30.379081 25929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.567s	user 0.015s	sys 0.018s
W20260709 13:07:30.398471 26008 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:07:30.348580 25887 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.388648 25993 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:30.305308 25924 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.402983 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.403859 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.512140 22601 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.494050 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:30.526384 22021 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.511425 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:30.496316 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:30.442584 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2716) took 2093 ms. Trace:
I20260709 13:07:30.510509 22603 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:30.443590 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.463680 21874 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:30.441960 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1937) took 1562 ms. Trace:
I20260709 13:07:30.510462 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:30.494169 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.529258 21872 rpcz_store.cc:276] 0709 13:07:28.879379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.879537 (+   158us) service_pool.cc:224] Handling call
0709 13:07:28.879992 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.957558 (+ 77566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.441627 (+1484069us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54001d83d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:30.441878 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176524544}
I20260709 13:07:30.406780 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:30.493605 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.530637 21948 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.530704 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:30.531390 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.531546 21872 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:30.501675 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.532502 21946 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.532979 21872 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.494889 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:30.405442 21873 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.527490 22023 rpcz_store.cc:276] 0709 13:07:28.349162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.349812 (+   650us) service_pool.cc:224] Handling call
0709 13:07:28.350131 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.952566 (+602435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.442307 (+1489741us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54000df2d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:30.442515 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383828224}
I20260709 13:07:30.535928 21947 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:30.434870 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1946) took 1206 ms. Trace:
I20260709 13:07:30.540011 21872 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:30.539963 21867 rpcz_store.cc:276] 0709 13:07:29.228226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.228348 (+   122us) service_pool.cc:224] Handling call
0709 13:07:29.228662 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.668699 (+440037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.434531 (+765832us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b540022bad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:30.434782 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010508672}
I20260709 13:07:30.539397 21947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
W20260709 13:07:30.452165 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.542780 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.544059 21867 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:30.541604 21872 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:30.540722 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:30.545825 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.550680 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.550976 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:30.518631 25966 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 1.515s	user 0.003s	sys 0.000s
I20260709 13:07:30.549820 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.555735 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:30.556161 22023 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:30.556456 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.557137 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.557667 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.553367 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:30.526238 25929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.715s	user 0.016s	sys 0.025s
I20260709 13:07:30.555455 22610 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:30.558095 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.560756 22023 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:30.605132 22018 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:30.586825 21948 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:30.431965 25950 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:30.500905 25328 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.605291 21867 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:07:30.606359 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 50695.6us
I20260709 13:07:30.559379 21872 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:30.615535 21946 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:30.608032 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.561165 21873 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:30.606588 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:30.619854 21948 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:30.620920 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.621335 21948 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.549700 25904 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.616115 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:30.616828 25841 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.499989 25730 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:30.616394 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.634140 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:30.634464 21867 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:30.635579 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:30.636097 21944 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.637636 25904 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.639846 25904 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:30.554839 25944 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.648474 21950 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:30.620424 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.625950 22018 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:30.649749 22018 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:30.545214 25888 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.616042 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.545228 25902 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.555276 25945 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.549564 25954 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:30.506129 25982 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:30.604748 25827 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.641891 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:30.642676 21873 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:30.637281 21867 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:30.667272 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.651600 21942 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:30.668277 25924 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:30.669865 21942 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:07:30.670375 21942 pending_rounds.cc:85] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 6
I20260709 13:07:30.670646 21942 pending_rounds.cc:107] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:07:30.670889 21942 raft_consensus.cc:2889] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.519765 25912 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:30.647254 25944 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.652227 25841 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.613461 25909 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.544901 25887 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.654379 21872 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
W20260709 13:07:30.654911 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.615105 25950 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:30.658012 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:30.650664 22018 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.690759 22018 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.640674 25798 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.649221 25988 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.663668 25945 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.688104 25944 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.694470 25798 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:30.685143 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:30.687382 21872 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.689222 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 623) took 1003 ms. Trace:
W20260709 13:07:30.734200 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.734025 21869 rpcz_store.cc:276] 0709 13:07:29.686012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.686155 (+   143us) service_pool.cc:224] Handling call
0709 13:07:30.688408 (+1002253us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:07:30.688590 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.688791 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.688828 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.688884 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:30.688930 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.689004 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.689151 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3292544}
I20260709 13:07:30.697974 25988 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.739308 21869 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:30.616307 22021 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:30.683950 21942 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.742693 21941 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.746862 21873 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.748301 21942 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:07:30.748931 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 63865.5us
I20260709 13:07:30.745791 21941 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:30.749676 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:30.659302 25888 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.752768 22021 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:30.753013 22020 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:30.753509 21942 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:30.755059 21869 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:30.755105 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:30.751049 21941 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:30.757694 21941 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:30.761251 21869 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.758699 21941 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.665756 25954 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.771518 21869 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.772881 21941 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.773134 21950 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:30.763619 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:30.698201 25902 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.682789 25912 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.683066 25827 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.775892 25902 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:30.752589 25841 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.746626 25988 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.779829 25904 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.771597 25870 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:30.772578 25543 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:30.793017 26013 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:30.793830 25954 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:30.788062 25902 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.872341 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:30.873281 22603 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:30.874039 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:30.878693 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:30.879526 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:30.802757 21941 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:30.810462 22020 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.811743 25548 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.812793 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 539) took 1243 ms. Trace:
I20260709 13:07:30.894716 21943 rpcz_store.cc:276] 0709 13:07:29.569717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.811953 (+1242236us) service_pool.cc:224] Handling call
0709 13:07:30.812239 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.812412 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:30.812443 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.812483 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:30.812526 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.812583 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.812717 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.814664 25827 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:30.818219 25883 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:30.821511 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.822489 25887 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:30.823675 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.826435 22018 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:30.829828 26018 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:30.831535 25888 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:30.834070 22016 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:30.834412 25912 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:30.840420 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.923326 22604 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:07:30.791425 25798 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:30.842190 22609 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:30.782859 25950 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.846010 25919 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:30.821555 25945 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:30.893762 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:30.897567 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:30.897895 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.925149 22610 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:30.925534 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.903255 22018 pending_rounds.cc:85] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 8
W20260709 13:07:30.927011 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 167502us
I20260709 13:07:30.927625 22018 pending_rounds.cc:107] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:30.927960 22018 raft_consensus.cc:2889] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.928699 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 491) took 1109 ms. Trace:
I20260709 13:07:30.929056 22018 rpcz_store.cc:276] 0709 13:07:29.819230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.625559 (+806329us) service_pool.cc:224] Handling call
0709 13:07:30.625805 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.928431 (+302626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.928641 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.929981 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.931026 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:30.931540 22018 raft_consensus.cc:2376] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12. Re-sending same reply.
W20260709 13:07:30.905731 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.915592 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:30.934159 21947 raft_consensus.cc:606] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:30.934599 21947 raft_consensus.cc:614] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:30.791867 25870 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.926048 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.902801 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1536) took 1093 ms. Trace:
I20260709 13:07:30.936446 22601 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:30.937029 22022 rpcz_store.cc:276] 0709 13:07:29.809208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.823407 (+1014199us) service_pool.cc:224] Handling call
0709 13:07:30.902706 (+ 79299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.926996 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:30.934796 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.935503 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:30.901800 25697 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:07:30.937639 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 488) took 1121 ms. Trace:
I20260709 13:07:30.941609 22017 rpcz_store.cc:276] 0709 13:07:29.818401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.840115 (+1021714us) service_pool.cc:224] Handling call
0709 13:07:30.937581 (+ 97466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:30.942786 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.943555 22017 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:30.938463 22608 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.939905 25870 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.949116 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.950681 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:30.939003 22606 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:30.902460 25975 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.925850 25757 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.936621 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:30.940160 22020 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:30.958491 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:30.970183 22017 raft_consensus.cc:2376] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12. Re-sending same reply.
I20260709 13:07:30.932294 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:30.959831 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.961161 22610 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.971210 22018 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:30.935892 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:30.940133 25910 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:30.927206 25953 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.972345 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:30.972731 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 209207us
I20260709 13:07:30.934929 25928 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.976176 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:30.954406 25950 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.975147 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:30.927069 25936 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:30.924500 25883 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.978809 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:30.960943 25975 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:30.995792 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:30.974259 25757 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:31.004532 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.980240 26019 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.986946 25888 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.972429 25328 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:31.015560 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:31.016920 21872 raft_consensus.cc:2410] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:07:31.018595 26020 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:07:31.019003 25757 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:31.022194 25944 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.023346 21948 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:30.978245 25887 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:07:30.978686 25953 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:30.989019 25945 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:31.030993 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:31.028147 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 47587.7us
I20260709 13:07:31.034021 25757 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:31.035002 25944 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:31.032066 21872 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:07:31.036947 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.037545 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.036655 21987 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:31.004993 26024 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:31.041419 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:31.039856 25912 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.043323 25548 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:31.043910 25328 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.047274 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:31.044333 25328 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.025012 26019 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.043344 25912 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.059056 25328 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.069080 25328 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.069018 25912 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.070401 25912 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.048789 26024 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:31.072587 26024 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.073513 26024 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.074744 26024 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.075910 26019 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:31.061353 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2731) took 1733 ms. Trace:
W20260709 13:07:31.062521 26017 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:07:31.062376 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 624) took 1344 ms. Trace:
I20260709 13:07:31.063395 26023 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.077193 26023 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.077816 26023 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.076939 21866 rpcz_store.cc:276] 0709 13:07:29.717915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.718065 (+   150us) service_pool.cc:224] Handling call
0709 13:07:29.756916 (+ 38851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.883940 (+127024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.883971 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.884013 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:29.884047 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.062057 (+1178010us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540044dc54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:31.062120 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.062287 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292182016}
I20260709 13:07:31.078794 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:31.079337 21866 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:31.081480 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.063527 25757 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.064165 25945 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:31.063436 25887 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:07:31.065478 25994 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.969s	user 0.004s	sys 0.000s
I20260709 13:07:31.077638 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 799) took 1308 ms. Trace:
I20260709 13:07:31.085273 25892 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:31.086473 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:31.076745 22015 rpcz_store.cc:276] 0709 13:07:29.328345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.331311 (+  2966us) service_pool.cc:224] Handling call
0709 13:07:29.357955 (+ 26644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.723638 (+365683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.060966 (+1337328us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400199e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:31.061237 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691632512}
I20260709 13:07:31.089704 22605 rpcz_store.cc:276] 0709 13:07:29.769691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.769832 (+   141us) service_pool.cc:224] Handling call
0709 13:07:29.770100 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.779888 (+  9788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.779931 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.779974 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:29.780005 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.077420 (+1297415us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b54006c2854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:31.077468 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.077585 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22047488}
I20260709 13:07:31.090121 21839 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:31.111303 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:31.122961 21866 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:31.123991 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:31.124203 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.028126 25988 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.036130 25975 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.094486 26019 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.134310 21866 raft_consensus.cc:1217] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 13:07:31.092247 25868 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:07:31.092571 25809 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:07:31.110683 25892 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.139003 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1936) took 2304 ms. Trace:
I20260709 13:07:31.238201 21870 rpcz_store.cc:276] 0709 13:07:28.834269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.834418 (+   149us) service_pool.cc:224] Handling call
0709 13:07:28.931175 (+ 96757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.796849 (+865674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.138721 (+1341872us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54003188d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:31.138936 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1944566016}
W20260709 13:07:31.137693 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.247370 22020 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:31.139430 21866 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:07:31.148837 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.251406 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.165544 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 186778us
I20260709 13:07:31.255010 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:31.165822 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2148) took 2112 ms. Trace:
I20260709 13:07:31.257612 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:31.258713 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:31.176911 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2534) took 1027 ms. Trace:
I20260709 13:07:31.259634 21874 rpcz_store.cc:276] 0709 13:07:30.149043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.163078 (+ 14035us) service_pool.cc:224] Handling call
0709 13:07:31.176624 (+1013546us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540044f554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:31.176792 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367149824}
I20260709 13:07:31.177590 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2734) took 1557 ms. Trace:
I20260709 13:07:31.213176 21946 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:31.134809 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 80194.9us
I20260709 13:07:31.180375 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2722) took 2084 ms. Trace:
I20260709 13:07:31.262609 22016 rpcz_store.cc:276] 0709 13:07:29.095790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.096928 (+  1138us) service_pool.cc:224] Handling call
0709 13:07:29.145987 (+ 49059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.923587 (+1777600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.180062 (+256475us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003c9bd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:31.180297 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3881440128}
I20260709 13:07:31.261286 22019 rpcz_store.cc:276] 0709 13:07:29.620110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.621995 (+  1885us) service_pool.cc:224] Handling call
0709 13:07:29.622465 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.950559 (+328094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.177266 (+1226707us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54001f18d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:31.177495 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752958208}
I20260709 13:07:31.182562 21873 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.213766 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:31.264472 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:31.267028 22021 raft_consensus.cc:2410] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:31.220455 21872 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:31.210407 21867 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:31.272140 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:31.272567 22606 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:31.258304 22020 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:31.149093 26016 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:31.256072 21945 rpcz_store.cc:276] 0709 13:07:29.053626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.204073 (+150447us) service_pool.cc:224] Handling call
0709 13:07:29.234457 (+ 30384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.576300 (+341843us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:29.631287 (+ 54987us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.821087 (+1189800us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b1800367a20. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c1223a 00007f635607ca2a
0709 13:07:30.954525 (+133438us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:30.978070 (+ 23545us) log.cc:844] Serialized 52 byte log entry
0709 13:07:30.978338 (+   268us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:30.978607 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.165258 (+186651us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b1800367a20. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:07:31.165472 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.165551 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.165595 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:31.165608 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.165757 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3826,"prepare.queue_time_us":58260,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":1267,"raft.queue_time_us":231459,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":17358,"spinlock_wait_cycles":117179648,"thread_start_us":474496,"threads_started":2,"wal-append.queue_time_us":1354938}
I20260709 13:07:31.280000 22015 raft_consensus.cc:1217] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-11.6]   Dedup: 7.4->[9.5-11.6]
I20260709 13:07:31.280684 22015 pending_rounds.cc:85] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 4
I20260709 13:07:31.280972 22015 pending_rounds.cc:107] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:07:31.281359 22015 raft_consensus.cc:2889] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.282642 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:31.283254 22021 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:31.248212 21762 maintenance_manager.cc:419] P 2e9dea115c0a415895e1d51deced12f4: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033348
I20260709 13:07:31.295473 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:31.165977 25803 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.137729 25671 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.158294 25868 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:31.299449 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 324352us
I20260709 13:07:31.276906 25918 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:31.157266 25883 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:31.148787 25871 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.173s
I20260709 13:07:31.296020 25548 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.163165 25892 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:31.199076 25953 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:31.264003 25693 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:31.302627 25949 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:31.264293 25903 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:31.310770 22021 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:31.306612 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:31.296736 25945 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:07:31.319396 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 481) took 2482 ms. Trace:
I20260709 13:07:31.306529 25868 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:31.135547 26019 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:31.356537 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.360213 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:31.328725 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.384927 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.364213 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 70882.2us
I20260709 13:07:31.296710 26034 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:07:31.279865 25697 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:07:31.136785 25982 raft_consensus.cc:2764] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:07:31.135604 25757 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.179503 25932 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.299543 25048 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:07:31.382946 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 621) took 1698 ms. Trace:
I20260709 13:07:31.301999 25803 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.319478 25841 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.314708 25671 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.315515 25944 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:07:31.406418 25919 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:31.406555 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 82234.7us
I20260709 13:07:31.363410 25976 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:31.376000 25902 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.005s
I20260709 13:07:31.365805 25918 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:31.375775 22024 rpcz_store.cc:276] 0709 13:07:28.825076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.825219 (+   143us) service_pool.cc:224] Handling call
0709 13:07:28.930669 (+105450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:29.032350 (+101681us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:29.053713 (+ 21363us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.250065 (+196352us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:30.832254 (+1582189us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b2c00103538. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:07:30.832713 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:07:30.977371 (+144658us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:30.977700 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.302451 (+324751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.302546 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.307589 (+  5043us) raft_consensus.cc:1685] finished
0709 13:07:31.307614 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.307731 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160941,"prepare.queue_time_us":22148,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":3027,"raft.queue_time_us":184475,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":51382,"spinlock_wait_cycles":12298496,"thread_start_us":592549,"threads_started":4,"wal-append.queue_time_us":485959,"wal-append.run_cpu_time_us":2337,"wal-append.run_wall_time_us":1305253}
I20260709 13:07:31.429436 25918 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.432188 25697 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.432677 25697 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:31.433578 25697 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.434872 25697 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.436857 26032 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.384485 25903 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.438397 26032 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.438736 25048 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:31.439172 25048 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.439744 25903 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.375061 25910 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:07:31.440150 25328 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.440045 25048 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.440722 25910 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:31.441115 25910 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.441424 25048 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:31.441839 25976 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.441974 25910 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.444095 25976 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.445021 25975 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.410516 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:31.410070 21871 rpcz_store.cc:276] 0709 13:07:29.684343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.684490 (+   147us) service_pool.cc:224] Handling call
0709 13:07:31.147295 (+1462805us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:07:31.147560 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.147810 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:31.148156 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.382587 (+234431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.382638 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:31.382685 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.382758 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.382884 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":915,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":7233,"spinlock_wait_cycles":165529856,"thread_start_us":234049,"threads_started":1}
I20260709 13:07:31.452415 25808 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.438774 26032 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.453191 25808 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.453816 26032 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.454370 25808 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.455401 26032 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.455962 25808 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.379678 25949 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.461265 25949 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:31.412421 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 52334.1us
W20260709 13:07:31.422004 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 115465us
I20260709 13:07:31.424109 25919 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.426203 25928 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.426713 25548 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.440994 25902 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.400853 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2531) took 1282 ms. Trace:
I20260709 13:07:31.373215 25870 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.379253 25883 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:07:31.474895 21988 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:31.475749 26034 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:31.478046 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 67595.5us
I20260709 13:07:31.482123 25548 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:31.482611 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.488492 25928 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.488684 25868 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.490728 25912 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:31.464318 25440 consensus_queue.cc:1175] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95296a4420ed41b69191d3d4353cf2b0" responder_term: 10 status { last_received { term: 7 index: 5 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:31.496893 25948 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:31.374671 25693 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.530443 25909 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:31.416478 25803 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:31.520998 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56410us
I20260709 13:07:31.443182 25910 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.476775 25478 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:31.476642 26018 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.407330 25543 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:07:31.549206 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.552124 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 131163us
W20260709 13:07:31.553197 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 136104us
I20260709 13:07:31.551529 26040 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.563532 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:31.553174 25950 consensus_meta.cc:287] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.002s
I20260709 13:07:31.577149 25919 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.571069 25980 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:31.580523 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 105719us
I20260709 13:07:31.531188 21875 rpcz_store.cc:276] 0709 13:07:30.117331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.305834 (+188503us) service_pool.cc:224] Handling call
0709 13:07:30.306217 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.306484 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:30.526541 (+220057us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.659058 (+132517us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.079730 (+420672us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b1800419f20. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:07:31.080103 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.303924 (+223821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:31.303971 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:31.304013 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.304074 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.399153 (+ 95079us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":424952,"prepare.queue_time_us":211224,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":118,"raft.queue_time_us":480192,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":9428,"spinlock_wait_cycles":5614336,"thread_start_us":553173,"threads_started":3,"wal-append.queue_time_us":234798}
I20260709 13:07:31.579185 25827 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.563982 26023 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.565528 25548 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:31.587911 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.601642 25717 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.165s
W20260709 13:07:31.702756 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.601497 22018 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:07:31.816092 22018 pending_rounds.cc:85] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 7
I20260709 13:07:31.759057 25720 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:31.578615 25909 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.818125 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:31.704380 25868 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.819696 25909 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.819928 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:31.745009 22576 leader_election.cc:336] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.525s (SENT)
I20260709 13:07:31.816493 22018 pending_rounds.cc:107] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:07:31.744309 25902 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.821736 22018 raft_consensus.cc:2889] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.731855 25798 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:31.822922 26023 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:31.607438 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:31.589362 25697 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.235s
I20260709 13:07:31.582089 25988 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:31.729892 25693 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:31.697613 26041 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:07:31.704450 22023 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 13:07:31.829492 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 241175us
W20260709 13:07:31.830513 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.831097 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.835706 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:31.821069 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:31.836040 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:31.836943 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 91962.7us
W20260709 13:07:31.837757 22576 leader_election.cc:336] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.554s (SENT)
I20260709 13:07:31.825986 22023 pending_rounds.cc:85] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 4
I20260709 13:07:31.838944 22023 pending_rounds.cc:107] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:07:31.839351 22023 raft_consensus.cc:2889] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.652782 25903 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.171s
I20260709 13:07:31.842429 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:31.842180 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:31.814374 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 223462us
I20260709 13:07:31.840202 21948 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:07:31.838835 22576 leader_election.cc:336] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.567s (SENT)
I20260709 13:07:31.840811 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:31.845605 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:31.673714 25671 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:31.586591 25887 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.594525 25975 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.846187 21945 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:31.751626 26040 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.850493 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:31.843020 25936 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:31.852464 22576 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.620s (SENT)
I20260709 13:07:31.686245 25921 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.743397 26019 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:31.829361 25919 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.838238 25980 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.832324 25827 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.845000 25890 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.847684 25924 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:31.595355 25904 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.259s
I20260709 13:07:31.857484 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:31.818162 25720 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:31.645473 25757 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.207s
I20260709 13:07:31.851552 26032 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:31.850718 25887 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:31.851166 25697 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:31.866479 25980 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.868289 25827 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.841955 26030 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:31.869565 25921 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.911791 25921 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:31.849429 25328 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:31.903229 25887 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.860590 25919 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:31.914184 25919 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:31.857213 26040 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.888954 25954 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:31.915794 25954 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:31.916522 25954 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:31.861234 26044 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:07:31.902853 25697 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.918115 25697 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.871186 25890 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:31.869407 26043 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.196s	user 0.003s	sys 0.000s
I20260709 13:07:31.917476 25954 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.871886 25870 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:31.886063 25924 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.927304 26040 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.918434 25928 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:31.928910 25890 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:31.929895 25928 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:31.759941 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 196478us
I20260709 13:07:31.962826 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:31.966149 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:31.967163 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.844520 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:31.846889 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 239540us
I20260709 13:07:32.005622 26023 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.006152 25757 consensus_queue.cc:1243] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:07:32.006896 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 156364us
I20260709 13:07:32.007637 26023 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:32.009876 26032 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:32.012419 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:32.015117 26024 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:32.015847 26024 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:32.017309 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 117133us
I20260709 13:07:32.017310 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:32.019923 25918 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:32.017444 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:32.030683 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:32.031354 25440 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:32.008378 26023 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:32.032935 25757 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.037062 25976 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.034101 26024 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.038216 25976 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:32.038923 22576 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.749s (SENT)
I20260709 13:07:32.039824 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:31.888741 25803 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.040733 25986 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.041920 25671 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:32.041755 25986 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.040791 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1545) took 2206 ms. Trace:
I20260709 13:07:32.044993 25921 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:32.045861 22023 rpcz_store.cc:276] 0709 13:07:29.814438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.626574 (+812136us) service_pool.cc:224] Handling call
0709 13:07:30.626963 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.844838 (+1217875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.020015 (+175177us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400198f54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:32.020446 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2477105408}
I20260709 13:07:32.048079 25871 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.050457 21945 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:32.039994 26024 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.052426 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:32.053673 21947 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:32.053830 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:32.054968 21949 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:32.056178 21941 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:32.057663 25919 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:32.012265 26032 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.014251 22606 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:32.050493 25976 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:31.890074 25720 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.068131 25898 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:32.068666 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:32.069939 25720 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.069763 26038 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:32.073390 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:32.079401 26040 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.080483 26040 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.082307 26037 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:32.083268 26037 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.044324 25803 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.032364 25440 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:32.044391 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:32.088513 21942 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:32.034111 26023 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.091439 26036 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:32.091544 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 61240.4us
W20260709 13:07:32.087600 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68852.1us
W20260709 13:07:32.103600 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 258976us
I20260709 13:07:32.104944 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:32.106263 26040 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.107522 25890 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:32.113027 26019 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:32.114271 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 75669.7us
I20260709 13:07:32.114537 25440 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.117060 26034 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:32.100557 25904 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:32.108233 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:32.114346 26037 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.130177 25904 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:32.150261 25890 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:32.161763 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 117713us
I20260709 13:07:32.154295 25904 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:32.169250 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 61274us
I20260709 13:07:32.171135 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.172295 22023 raft_consensus.cc:2410] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:32.173218 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.174335 22024 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 6: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:32.148294 21841 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.622s (SENT)
I20260709 13:07:32.175418 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:32.176226 21841 leader_election.cc:336] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.634s (SENT)
I20260709 13:07:32.177260 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.185876 26023 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.178164 22015 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:32.188570 22020 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:07:32.192662 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.193168 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.193568 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.189453 26037 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:32.194487 26037 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.191509 22022 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:32.191634 25887 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.198671 25548 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.199246 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 495) took 1369 ms. Trace:
I20260709 13:07:32.193288 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.199795 25887 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:32.196187 26030 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:32.161705 25803 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:07:32.221848 25986 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.222143 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 1956) took 1570 ms. Trace:
I20260709 13:07:32.222440 25870 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:32.172508 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.222949 25548 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.223148 25870 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:32.222662 21873 rpcz_store.cc:276] 0709 13:07:30.631091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.747712 (+116621us) service_pool.cc:224] Handling call
0709 13:07:31.182280 (+434568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.266120 (+ 83840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.151206 (+885086us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540044f550. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:32.201175 (+ 49969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998653824}
I20260709 13:07:32.222215 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.225286 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.225628 25986 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.226363 25986 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.228188 26034 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.228459 25798 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.228997 26034 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.229287 25798 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.231400 26034 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:32.231787 25798 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:32.225740 22016 raft_consensus.cc:2410] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:32.224551 25870 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.233286 25986 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.232954 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.241971 22017 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:32.237178 25980 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:32.243515 26037 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.246882 25697 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.199643 22022 rpcz_store.cc:276] 0709 13:07:30.830316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.950361 (+120045us) service_pool.cc:224] Handling call
0709 13:07:32.198975 (+1248614us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001f13d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:32.199142 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2823676672}
W20260709 13:07:32.249207 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 70297.9us
I20260709 13:07:32.240753 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.252725 22017 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:32.252791 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.253571 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.253690 22016 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:32.254258 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.255194 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.254384 22021 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:32.255264 22017 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:32.258085 25803 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:32.266579 22020 raft_consensus.cc:2368] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13.
I20260709 13:07:32.258239 26030 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.280684 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.282473 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.283353 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.285066 22021 raft_consensus.cc:2368] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13.
I20260709 13:07:32.286517 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.287659 22024 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:32.289824 26030 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.289336 21772 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.294755 25697 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.303797 21947 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:32.305667 21946 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:32.306586 21949 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:32.307693 21945 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:32.316460 22019 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:32.318471 22023 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:32.292026 21772 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 8 to 9, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 9 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:32.319106 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51431.2us
I20260709 13:07:32.325322 21943 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:32.325610 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.326673 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.327694 22024 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:32.328534 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.328990 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.329874 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.330268 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.330998 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.331110 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.331636 22018 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:32.331638 22017 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
W20260709 13:07:32.336043 21987 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.69.62:45563, user_credentials={real_user=slave}} blocked reactor thread for 478232us
I20260709 13:07:32.336287 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.338552 22016 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:07:32.347162 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.346388 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:32.347730 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.348778 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.341503 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:32.352346 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.350205 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.342403 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.357738 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.353356 22020 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:32.361615 22022 raft_consensus.cc:2410] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:32.365125 22018 raft_consensus.cc:2368] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13.
I20260709 13:07:32.374876 22015 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:32.375459 22015 pending_rounds.cc:85] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 5
I20260709 13:07:32.377478 22019 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:32.370060 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.380043 21873 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:32.376128 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:32.378525 22015 pending_rounds.cc:107] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 9.6
W20260709 13:07:32.381289 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.381312 22015 raft_consensus.cc:2889] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.380003 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.383963 22020 raft_consensus.cc:2410] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:32.397888 22022 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
W20260709 13:07:32.396481 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 110470us
I20260709 13:07:32.404181 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:32.407428 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.408568 25986 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.409346 25986 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.411790 25986 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.412449 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:32.413607 25924 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:32.414098 25924 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:32.414395 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:32.414578 25924 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:32.420713 25936 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:32.422405 25936 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:32.430923 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.433055 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.433945 21872 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:32.435072 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.435775 21875 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:32.437649 25986 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:32.397028 26023 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:32.439254 26023 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.400846 25548 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.449101 25548 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:32.449548 25548 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.454373 22606 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:32.455966 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:32.458122 25950 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:32.458575 25950 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:32.458896 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:32.459661 25950 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:32.461524 26056 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:07:32.463265 22022 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
I20260709 13:07:32.468999 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.469170 25904 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.469816 22019 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:32.470409 21947 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:32.470813 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.471535 25904 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.472407 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.473076 21875 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:32.475044 21873 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:32.476740 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.477596 21869 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:32.477761 21875 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:32.401121 26037 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.483019 26037 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.488775 25918 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:32.489442 25918 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.491914 25918 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.471572 22019 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:32.513458 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.520434 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:32.526634 22022 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:32.527671 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.461575 26025 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:32.534806 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.537590 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.548285 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:32.549278 21947 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:32.549450 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:32.549705 26037 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.550511 21871 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:32.550357 26025 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:32.551676 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.552386 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:32.549288 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.553691 21943 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:07:32.554715 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.555781 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.551759 26025 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.552461 21871 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:32.562603 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:32.563405 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.557129 21869 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.568169 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:32.573256 22022 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:32.571290 21872 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:32.579281 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.585539 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:32.591185 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:32.591907 22601 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:32.593856 22601 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:32.597796 25671 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:32.598471 25671 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.599067 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:32.599371 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:32.600330 26037 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:32.600754 26037 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.601109 26037 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.601209 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:32.602421 25868 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:32.602890 25868 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.603279 25868 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.604586 25950 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.617129 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.617877 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.650198 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.612987 26023 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:32.656142 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.657500 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.661202 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.654969 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:32.669988 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:32.675946 21869 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:32.614610 25924 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.682598 21870 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.661130 25904 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.690222 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:32.699136 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:32.672084 25671 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.710512 25904 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.710892 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:32.711920 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:32.712868 25904 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.712811 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:32.713557 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:32.714627 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:32.717037 26024 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:32.718991 26032 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:32.719432 26032 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.719792 26032 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:32.722433 22602 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:32.724913 25757 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.725428 25757 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:32.725855 25757 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.728891 25798 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:32.730101 25798 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:32.730530 25798 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:32.730976 25798 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.732193 26034 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:32.732648 26034 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:32.733778 26034 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.735093 26034 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.734648 26072 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:32.738180 25924 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.738710 25903 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.739323 25903 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.739984 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:32.741714 25903 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.742298 25975 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
W20260709 13:07:32.744464 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 59560.4us
W20260709 13:07:32.746358 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60484.6us
I20260709 13:07:32.750942 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:32.758037 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 343804us
I20260709 13:07:32.764258 21870 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:32.768744 25902 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.769491 25902 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.771194 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.772123 21873 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:32.764587 21987 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:32.779881 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:32.759922 25870 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.761402 25975 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:32.784786 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:32.772475 25902 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.814728 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:32.817819 25954 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.820240 25757 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.821270 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:32.824154 26074 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:07:32.826078 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 150735us
I20260709 13:07:32.826591 25868 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.786065 25870 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:32.828114 25870 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.839411 22024 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:32.839586 21771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 285) took 18959 ms (client timeout 15000 ms). Trace:
I20260709 13:07:32.774446 26030 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.828229 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:32.852999 22017 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.853561 22023 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:07:32.853910 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.854879 21772 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.856086 25924 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:32.856731 25924 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:32.856771 21772 catalog_manager.cc:5697] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.857879 25924 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.861882 21988 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:32.782298 25903 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.763921 25548 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.882658 25868 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:32.884568 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 120055us
I20260709 13:07:32.787642 25918 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:07:32.891191 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:32.892015 22607 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.891189 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:32.783941 26037 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:32.840200 21771 rpcz_store.cc:269] 0709 13:07:13.879570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.880542 (+   972us) service_pool.cc:224] Handling call
0709 13:07:32.839345 (+18958803us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:28.320722 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:28.496552 (+175830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:28.498543 (+  1991us) write_op.cc:435] Acquired schema lock
0709 13:07:28.500992 (+  2449us) tablet.cc:662] Decoding operations
0709 13:07:28.632581 (+131589us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:28.632666 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:28.632692 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:07:28.633408 (+   716us) tablet.cc:701] Row locks acquired
0709 13:07:28.633422 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:07:28.633577 (+   155us) write_op.cc:270] Start()
0709 13:07:28.633694 (+   117us) write_op.cc:276] Timestamp: P: 1783602448633526 usec, L: 0
0709 13:07:28.633716 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:28.634457 (+   741us) log.cc:844] Serialized 3190 byte log entry
0709 13:07:29.057511 (+423054us) op_driver.cc:464] REPLICATION: finished
0709 13:07:29.282607 (+225096us) write_op.cc:301] APPLY: starting
0709 13:07:29.282699 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:29.324226 (+ 41527us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:29.350807 (+ 26581us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:29.582058 (+231251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:29.611987 (+ 29929us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:07:29.612050 (+    63us) write_op.cc:312] APPLY: finished
0709 13:07:29.612375 (+   325us) log.cc:844] Serialized 65 byte log entry
0709 13:07:29.612634 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.612769 (+   135us) write_op.cc:454] Released schema lock
0709 13:07:29.612818 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:29.646955 (+ 34137us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.647006 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":894035,"reported_tablets":43,"spinlock_wait_cycles":1292032,"child_traces":[["op",{"apply.queue_time_us":220182,"apply.run_cpu_time_us":5298,"apply.run_wall_time_us":330655,"num_ops":8,"prepare.queue_time_us":289925,"prepare.run_cpu_time_us":19051,"prepare.run_wall_time_us":534418,"raft.queue_time_us":88927,"raft.run_cpu_time_us":52260,"raft.run_wall_time_us":114178,"replication_time_us":423591,"spinlock_wait_cycles":14592,"thread_start_us":495255,"threads_started":4,"wal-append.queue_time_us":331275,"wal-append.run_cpu_time_us":23748,"wal-append.run_wall_time_us":1689745}]]}
I20260709 13:07:32.891042 26052 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.938190 26052 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:32.938894 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:32.868750 25902 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.863021 26030 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.939750 25902 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.941231 26030 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:32.917019 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 88868.3us
W20260709 13:07:32.918588 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 137532us
I20260709 13:07:32.942361 25902 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.921003 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.943758 22015 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 6.
I20260709 13:07:32.896865 25986 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:32.944921 25986 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:32.895049 26032 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.945297 25986 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:32.909716 25903 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:32.937462 26037 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.978645 22607 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:32.979944 22020 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:32.891917 25954 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.942422 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:32.991173 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.991448 25903 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:32.946205 25986 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.993074 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:32.994424 25548 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:32.938865 26052 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:33.013586 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 71277.1us
I20260709 13:07:33.014580 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:33.016038 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:33.018133 25986 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.001716 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:33.021035 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:33.021919 25898 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:33.022512 25898 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:33.023578 25898 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:32.887842 21772 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 2 to 6, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1), VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2), VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3), VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 8 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:32.997725 22017 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
W20260709 13:07:32.999800 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.986472 25757 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.035991 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:32.999552 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 90193.8us
I20260709 13:07:33.036957 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:33.043416 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:33.043579 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.004781 25868 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:33.047809 22023 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:33.050268 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:33.052999 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 315532us
I20260709 13:07:32.993108 25798 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.033222 26032 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.060441 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:33.004087 25954 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.061906 22023 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:07:33.063664 26068 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:07:33.072574 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.056141 25936 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.078707 22024 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:33.109134 21772 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.068385 25954 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:33.106787 21914 connection.cc:256] RPC call timeout handler was delayed by -1.4733528479998768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:07:33.118178 21914 connection.cc:256] RPC call timeout handler was delayed by -1.3275528479998684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:07:33.118830 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 102876us
I20260709 13:07:33.116253 21772 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 10 to 11, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 11 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:33.122546 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.123093 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0143528479999304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:07:33.123309 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 86480.1us
I20260709 13:07:33.077993 25975 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.131884 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.132900 22023 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:33.135847 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:33.118973 25950 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.002s
W20260709 13:07:33.146409 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:33.151365 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.079808 25757 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:07:33.127471 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:33.155440 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.156340 22023 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:33.129719 25975 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:33.161275 21916 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:33.160710 21772 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:33.185856 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 46236.2us
I20260709 13:07:33.166100 25975 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.166270 25950 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.168699 25903 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.192723 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:33.177145 26023 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.178062 25868 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.182646 26025 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.217801 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 120409us
I20260709 13:07:33.228978 25868 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:33.227345 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 76486.9us
I20260709 13:07:33.196868 26036 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:33.197695 26037 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.183743 25928 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.163s
I20260709 13:07:33.202024 25950 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:33.253050 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 391190us
I20260709 13:07:33.239349 26036 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:33.211246 25924 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:33.268052 21838 leader_election.cc:336] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.536s (SENT)
I20260709 13:07:33.207990 25548 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.239812 25904 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.273653 26084 consensus_queue.cc:1059] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:07:33.275255 26072 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:33.210781 25903 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.265254 25798 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.282171 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:33.287282 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 163023us
I20260709 13:07:33.234153 26025 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.238055 26023 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.289732 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:33.281795 25904 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:33.301100 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 73771.7us
W20260709 13:07:33.305354 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 92648.5us
I20260709 13:07:33.316190 25757 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:33.316623 26094 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.317350 26094 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:33.317891 26094 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:33.318177 26083 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260709 13:07:33.318429 25928 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.320169 25928 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:33.321036 26085 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:07:33.324882 25928 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.327456 25928 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:33.329499 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 47468.7us
I20260709 13:07:33.300740 26024 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:33.336236 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 149060us
I20260709 13:07:33.303666 25904 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.340821 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:33.308262 25902 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.297715 25548 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:33.337384 26034 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.005s
W20260709 13:07:33.382401 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 68953.5us
W20260709 13:07:33.384241 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 75208.4us
I20260709 13:07:33.385550 21988 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:33.317344 25757 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:33.389815 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49333.7us
I20260709 13:07:33.390411 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:33.396590 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.333009 25928 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:07:33.399782 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:33.411849 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:33.412461 22602 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:33.363171 25902 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:33.413820 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 144500us
W20260709 13:07:33.410334 21838 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.645s (SENT)
W20260709 13:07:33.418262 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.390022 25757 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:33.419111 21839 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:33.419174 25440 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.402420 25798 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:33.428397 26090 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:07:33.429212 26089 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:07:33.405563 26034 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:33.431559 21838 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.728s (SENT)
I20260709 13:07:33.449868 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.450894 22019 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:33.454113 22019 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:33.414927 25902 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.415130 26054 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.458653 25950 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.464618 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:33.465379 21869 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:33.466435 26087 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:07:33.467164 25954 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.468859 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:33.469154 25903 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.469626 21875 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.469784 25903 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:33.470443 25903 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:33.472981 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 138791us
I20260709 13:07:33.474085 21841 leader_election.cc:400] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13.
I20260709 13:07:33.475174 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:33.475840 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:33.476145 26098 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:07:33.478324 25903 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.480720 26100 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:33.481405 21874 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:33.482445 26110 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.483022 26110 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.486287 25954 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.487758 26110 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:33.486213 21869 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:33.503913 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:33.504954 21867 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 5.
I20260709 13:07:33.506050 26106 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:07:33.507339 26106 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:33.507834 26106 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:33.508762 26108 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:33.509594 26108 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.430259 25440 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:33.513507 25440 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:33.521596 26097 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:07:33.461526 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:33.480332 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:33.440026 25671 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:33.552676 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 108558us
I20260709 13:07:33.552670 26108 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:33.525399 25986 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.001s
W20260709 13:07:33.557859 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 151119us
I20260709 13:07:33.573503 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.527773 26040 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:33.576722 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 101633us
I20260709 13:07:33.579273 22022 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:33.578783 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:33.579630 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:33.582419 21869 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:33.582677 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 161448us
I20260709 13:07:33.543258 26054 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.585276 25548 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.585410 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:33.586169 25548 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:33.587375 26110 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.587874 26110 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.542784 25671 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:33.588474 25870 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.007s
I20260709 13:07:33.590188 26025 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:33.589845 25870 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.586356 21866 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.588325 26110 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.594369 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.598026 21870 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:33.588727 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:33.599064 21868 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.596133 22021 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:33.599125 22608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 688) took 1079 ms. Trace:
W20260709 13:07:33.604987 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.611418 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:33.606637 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:33.593343 25548 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:33.569792 25950 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:07:33.595780 25871 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:33.625131 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:33.615890 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 196398us
I20260709 13:07:33.603341 22608 rpcz_store.cc:276] 0709 13:07:32.512447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.518405 (+  5958us) service_pool.cc:224] Handling call
0709 13:07:32.553835 (+ 35430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.604287 (+ 50452us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:32.777365 (+173078us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.240259 (+462894us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.262642 (+ 22383us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.262785 (+   143us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:33.262822 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.262884 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.591400 (+328516us) raft_consensus.cc:1685] finished
0709 13:07:33.591428 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.591591 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9283,"prepare.queue_time_us":313568,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":46103,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":21440,"thread_start_us":588853,"threads_started":3,"wal-append.queue_time_us":398481}
I20260709 13:07:33.596638 25671 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.587880 26054 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.595705 26023 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:33.623696 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 143489us
I20260709 13:07:33.634312 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 689) took 1115 ms. Trace:
I20260709 13:07:33.632577 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:33.643065 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:33.618641 25548 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:33.620221 26118 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:33.634776 22606 rpcz_store.cc:276] 0709 13:07:32.519153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.529582 (+ 10429us) service_pool.cc:224] Handling call
0709 13:07:32.568322 (+ 38740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.581263 (+ 12941us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:32.777000 (+195737us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.164006 (+387006us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.197374 (+ 33368us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.197542 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:33.197575 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.197661 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.625417 (+427756us) raft_consensus.cc:1685] finished
0709 13:07:33.625438 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.634224 (+  8786us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":336303,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":69105,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":7715,"thread_start_us":522896,"threads_started":2,"wal-append.queue_time_us":449914}
I20260709 13:07:33.652123 22608 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:33.656286 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 47203.9us
W20260709 13:07:33.658274 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76972.8us
I20260709 13:07:33.660871 26115 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:33.644291 26117 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.661484 26115 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.661108 25548 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.661902 26115 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.661827 26117 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.662544 25548 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:33.665393 25918 raft_consensus.cc:3055] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:33.665836 25918 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:33.602640 26106 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.666833 25918 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.667644 26106 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.668416 25921 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:33.649752 26054 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:33.668967 25921 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:33.669179 26054 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:33.669718 26054 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:33.671847 26082 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.551s	user 0.008s	sys 0.004s
I20260709 13:07:33.647408 25950 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:33.673266 25870 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:33.648365 25986 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.691040 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:33.659775 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:33.700196 21875 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
W20260709 13:07:33.701226 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66984.7us
I20260709 13:07:33.694861 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:33.706506 25975 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.004s
I20260709 13:07:33.706848 26094 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.707020 25975 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:33.709508 26113 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:07:33.714077 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:33.664455 26117 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.716943 25868 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:33.657696 25954 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.717907 25954 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:33.650817 26084 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:33.658032 25798 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:33.731307 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:33.730996 21868 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:33.722484 25440 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.735004 25904 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.737282 26108 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.738859 25902 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.740960 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.741223 26094 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.735550 25440 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.718340 25954 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.764894 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:33.762380 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 142721us
I20260709 13:07:33.768698 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:33.742347 26094 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:33.769275 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 78343.8us
I20260709 13:07:33.771639 21944 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:33.700840 25986 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.743600 26120 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.743247 26037 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:33.780145 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.780061 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:33.781810 25757 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.782407 25902 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:33.742442 25798 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.821556 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.822468 21947 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:33.782889 26119 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.779497 25440 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:33.784142 25904 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.786010 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:33.786592 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.787379 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.787897 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:33.788091 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.788848 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.828181 21945 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:33.790088 21946 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:33.771026 26094 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.793051 26024 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:33.794639 26036 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.652064 26118 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.801501 25921 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.805256 26023 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:33.810707 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.844081 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:33.813575 26105 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 13:07:33.848090 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.848869 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2768) took 1234 ms. Trace:
I20260709 13:07:33.849962 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.850739 21949 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:33.849247 22016 rpcz_store.cc:276] 0709 13:07:32.617265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.623865 (+  6600us) service_pool.cc:224] Handling call
0709 13:07:32.648963 (+ 25098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.665267 (+ 16304us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:32.846969 (+181702us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b18003ef5c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf 00007f635608c038
0709 13:07:33.159831 (+312862us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.305140 (+145309us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.317704 (+ 12564us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.317846 (+   142us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:33.317891 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.317966 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.812876 (+494910us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:33.848674 (+ 35798us) raft_consensus.cc:1685] finished
0709 13:07:33.848693 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.848815 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61174,"prepare.queue_time_us":189559,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":47693,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":20931,"spinlock_wait_cycles":24246528,"thread_start_us":379336,"threads_started":2,"wal-append.queue_time_us":210601}
I20260709 13:07:33.851552 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.849296 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.759119 25868 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.820446 21944 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:33.824205 21866 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:07:33.831737 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51746.6us
I20260709 13:07:33.814036 25924 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:33.835929 26024 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.826426 21943 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:33.819998 26037 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.866724 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.867400 21943 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
W20260709 13:07:33.867635 26128 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:33.868233 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.868975 21943 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:33.834306 26119 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:33.836481 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:33.833743 21941 raft_consensus.cc:2376] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11. Re-sending same reply.
I20260709 13:07:33.845310 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.832396 26094 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:33.827072 21948 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:33.856014 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:33.858589 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:33.859499 26099 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.531s	user 0.008s	sys 0.001s
I20260709 13:07:33.857824 25924 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:33.859546 21949 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:33.862202 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:33.863262 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 77338.1us
I20260709 13:07:33.865017 25921 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.844208 26023 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.841938 26040 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.832633 25440 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.873437 21944 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:33.875401 21945 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:33.873656 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:33.865190 26118 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.878875 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:33.878362 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.819631 26120 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:33.888887 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 157660us
I20260709 13:07:33.890738 21946 raft_consensus.cc:2410] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:33.872222 26093 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.891872 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:33.892841 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.878346 26106 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.895128 21949 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:33.882107 26023 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.869139 26108 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:07:33.892264 26052 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.836s	user 0.012s	sys 0.001s
I20260709 13:07:33.912940 26052 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.915247 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.916457 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:33.917378 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.921969 25986 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.922065 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.922394 25918 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.922905 21944 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:33.925109 26115 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.926437 21942 raft_consensus.cc:2368] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 6. Current term is 7.
I20260709 13:07:33.927670 26115 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.943588 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.907687 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.894170 25975 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:33.890846 25903 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:33.910164 25924 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:33.910611 26125 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.910702 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.911433 26119 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.929638 25757 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:33.929912 25440 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:33.929979 26120 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:33.978618 22019 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:33.932507 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:33.932873 26134 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:33.977262 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:33.934621 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:33.899158 26106 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.881265 26040 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:33.906805 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.944691 22023 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:33.946578 26034 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:33.949213 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 52906.5us
I20260709 13:07:34.012516 22602 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:33.973310 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:33.960805 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 71066.5us
I20260709 13:07:33.890789 25902 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:07:33.930888 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 53944.1us
I20260709 13:07:34.014214 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:33.933820 26126 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:34.022732 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:34.024408 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.898221 25671 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.027020 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:33.937120 26052 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:34.003450 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.997331 22021 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:33.997676 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.998086 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.029174 21946 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:33.999364 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:33.998011 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:33.998291 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.030277 21866 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:33.947486 22016 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:34.016661 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:33.947445 25903 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.020938 21841 leader_election.cc:400] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13.
I20260709 13:07:34.031162 21841 leader_election.cc:403] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:34.025220 21944 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:33.977283 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:33.996243 22608 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:33.953727 25798 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:33.937110 26121 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.028517 21949 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:34.014927 26106 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.998325 25975 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:34.035121 21947 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:34.029726 21988 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:34.006175 26134 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.037882 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:33.896267 26093 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.012465 26040 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.038308 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:34.041667 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.041973 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.042268 26141 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:34.042557 26125 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:34.042680 26135 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.043844 25924 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.065042 22018 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
W20260709 13:07:34.068859 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.043879 26032 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:34.069677 26032 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:34.070658 26032 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:33.954895 26054 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.074260 26054 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.053768 25798 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.054035 26134 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.078151 25798 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:34.079017 26137 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
I20260709 13:07:34.046336 25671 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:34.033958 25903 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.039171 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.048904 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:34.049050 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:34.055866 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.054322 25871 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:07:34.061434 26093 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:34.061573 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.062305 26094 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.063145 26135 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.029379 26120 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:34.084640 22602 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:07:34.084833 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 55174.7us
I20260709 13:07:34.122071 26100 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:34.125310 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:34.096417 21944 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:34.097493 25975 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:34.104049 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55073.2us
I20260709 13:07:34.058902 26052 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.106663 21949 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.109040 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:34.108690 25902 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.081661 26084 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:34.114719 26125 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.096880 26054 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:34.107867 25440 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:34.117363 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:34.117609 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.119076 26024 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.086241 22024 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:34.197258 22606 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.125995 21945 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:34.127230 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.128674 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:34.130369 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.132017 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:34.198490 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 69911.7us
I20260709 13:07:34.198769 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.138065 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:34.138646 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:34.140254 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:34.199399 21941 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:34.193092 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:34.204228 21869 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.203229 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:34.125896 26111 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:34.107753 26030 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:34.105715 26118 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.204823 21868 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:34.140273 25904 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:34.209689 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 78172.1us
I20260709 13:07:34.259140 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:34.133574 26141 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:34.250504 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 112479us
I20260709 13:07:34.265364 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:34.140349 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:34.260772 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:34.132416 26121 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:34.263852 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 215042us
I20260709 13:07:34.136343 26084 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:34.144460 25671 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.266541 21874 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.266758 22021 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:34.267493 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.262029 26030 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:34.274629 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.203212 26025 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.109906 26110 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.271060 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:34.203488 26093 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.129462 26037 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.125705 25954 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.210947 25798 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:34.279085 22019 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.276985 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:34.196278 25921 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:07:34.252498 26072 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.220387 25440 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:34.252120 26108 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.464008 21943 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:34.272984 25936 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.388561 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:34.462821 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:34.505264 21949 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
W20260709 13:07:34.389261 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.451357 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.275628 25928 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:34.194480 25902 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.320158 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:34.140470 26034 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.422909 21867 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:34.276077 26100 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:34.398207 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 139117us
I20260709 13:07:34.397305 26093 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.264695 25898 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:34.476059 21869 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:34.553134 21866 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.478533 26030 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:34.484030 26086 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:07:34.485942 26024 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:34.491206 26115 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:34.559058 26115 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:34.560120 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.559865 26115 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.560820 26115 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.271503 25904 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.530045 25936 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:34.566637 25924 consensus_meta.cc:287] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.502s	user 0.000s	sys 0.008s
I20260709 13:07:34.566859 21944 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:34.252381 26111 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.509328 21873 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:34.567278 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:34.512885 22022 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:34.567864 21871 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.568073 26110 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:34.268064 26118 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.569505 26037 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:34.570052 26118 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:34.422233 25671 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.278172 26106 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.524349 22019 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:34.530923 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.202690 26054 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.544761 25871 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:34.545547 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:34.575744 26094 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:34.576928 26040 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.507491 26108 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.578178 26108 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.579101 26106 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.579288 21875 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.580092 21948 raft_consensus.cc:2368] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:34.548391 26134 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:34.549564 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.581489 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.539415 26090 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:34.549963 26124 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:07:34.550472 26139 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.296s
W20260709 13:07:34.551738 26144 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:07:34.581835 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.584722 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.585397 26084 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.587220 25936 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.549647 26141 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.566596 25904 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.555999 21945 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:34.600637 25757 consensus_meta.cc:287] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
I20260709 13:07:34.610019 25975 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.555999 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.572300 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:34.573062 26127 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.367s
I20260709 13:07:34.575264 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:34.621591 21866 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:34.577091 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:34.622236 21874 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
W20260709 13:07:34.623021 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 46071.4us
I20260709 13:07:34.624253 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:34.293852 26025 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.579977 25871 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.581794 25902 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.600335 21871 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:34.557699 25440 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.627370 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:34.642046 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:34.645982 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:34.648798 21916 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:34.662499 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 388756us
I20260709 13:07:34.579101 26040 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:34.662772 21946 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:34.625680 26030 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.665225 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:34.629899 25871 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:34.612223 26108 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.626457 25975 raft_consensus.cc:2764] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:34.634363 25671 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.668723 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:34.640705 26037 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.678169 22606 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
W20260709 13:07:34.664655 26023 consensus_meta.cc:287] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.007s
I20260709 13:07:34.662962 26121 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.683205 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:34.663457 26115 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.666019 25902 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.697171 21949 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:34.682915 25871 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.682586 25904 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:34.710842 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 200534us
I20260709 13:07:34.685499 25671 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:34.727852 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 457276us
I20260709 13:07:34.728960 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:34.701732 26040 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.702217 25902 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:34.733065 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 64484.5us
W20260709 13:07:34.709731 26148 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.436s	user 0.000s	sys 0.002s
I20260709 13:07:34.734620 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:34.736272 22608 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:34.736074 21838 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:34.709337 26110 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:34.738969 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:34.729839 25671 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.692633 26023 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.749791 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:34.735790 26121 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.733482 25954 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:34.734028 26040 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:34.711632 25870 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:34.738411 25902 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.740842 26110 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:34.748667 25903 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.002s
I20260709 13:07:34.765256 26110 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:34.769119 26152 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:07:34.755221 26121 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:34.771859 26121 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.772706 25903 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:34.773401 26159 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:34.775287 21950 raft_consensus.cc:2368] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11.
I20260709 13:07:34.775432 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.776151 25870 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:34.739818 25975 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:34.776650 25870 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:34.779124 21947 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:34.763428 26040 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.763669 26156 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:34.801434 25868 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.801995 26023 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:34.802822 25868 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:34.805248 21941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:34.806030 21941 raft_consensus.cc:606] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:34.806371 21941 raft_consensus.cc:614] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:34.806907 25671 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.808929 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:34.809626 21947 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:34.810889 21916 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:34.819567 21947 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:34.818900 26135 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:34.859403 26151 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:07:34.799839 26156 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:34.862398 26156 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.862500 25902 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:34.865648 26157 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:07:34.870151 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 131257us
I20260709 13:07:34.871084 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:34.813630 26158 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:07:34.816335 26106 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:34.914808 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43812.8us
I20260709 13:07:34.916018 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:34.913151 26100 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.906478 25870 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.935806 26165 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.917523 26025 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.936331 25870 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.938998 26121 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.936373 26165 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:34.927392 26106 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:34.941184 26052 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.003s
I20260709 13:07:34.941362 26165 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.941684 26052 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13.
I20260709 13:07:34.942441 25902 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.943159 26108 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:34.945802 25871 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.947829 26037 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.948757 26135 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:34.949143 25898 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:34.949374 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:34.949421 26135 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:34.950155 26135 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:34.952795 26162 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:07:34.953864 26165 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.906507 26110 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:34.956141 26165 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:34.940725 25671 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:34.942070 26106 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:34.972875 22016 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:34.973109 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.972335 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2790) took 1063 ms. Trace:
W20260709 13:07:34.934265 26119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.000s	sys 0.017s
I20260709 13:07:34.974675 22022 rpcz_store.cc:276] 0709 13:07:33.908624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.916214 (+  7590us) service_pool.cc:224] Handling call
0709 13:07:34.971995 (+1055781us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54001ee6d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:34.972246 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362870144}
W20260709 13:07:34.984216 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.991822 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 205892us
W20260709 13:07:34.978302 26119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.000s	sys 0.018s
I20260709 13:07:34.972260 25898 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:34.992980 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:35.006130 25898 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:35.017690 26164 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:07:35.021139 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2789) took 1112 ms. Trace:
I20260709 13:07:35.008049 25671 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.027134 22015 rpcz_store.cc:276] 0709 13:07:33.908303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.908474 (+   171us) service_pool.cc:224] Handling call
0709 13:07:33.918280 (+  9806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.918477 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:34.136329 (+217852us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.020772 (+884443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.020830 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:35.020876 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.020960 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.021075 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807293,"prepare.queue_time_us":119927,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"thread_start_us":255194,"threads_started":2,"wal-append.queue_time_us":343540}
W20260709 13:07:35.143932 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 151083us
I20260709 13:07:35.145550 26110 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:35.070346 26143 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.147735 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.147611 26143 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:35.148471 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.149008 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.149927 26143 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:35.068342 26139 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.150607 21945 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:35.196650 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 571) took 1001 ms. Trace:
I20260709 13:07:35.153318 21949 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:35.154579 26107 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.154126 26135 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.158739 26036 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.159354 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2783) took 1254 ms. Trace:
I20260709 13:07:35.171384 26110 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.078295 26174 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:35.173386 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1489) took 1251 ms. Trace:
I20260709 13:07:35.028481 26133 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:35.211278 21948 rpcz_store.cc:276] 0709 13:07:33.922322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.947902 (+ 25580us) service_pool.cc:224] Handling call
0709 13:07:35.173100 (+1225198us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540029ac54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:35.173275 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263575424}
I20260709 13:07:35.175571 26040 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:35.070300 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.181782 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.222703 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.016673 25898 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.140699 25871 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:35.188791 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1477) took 1385 ms. Trace:
I20260709 13:07:35.198426 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 570) took 1063 ms. Trace:
I20260709 13:07:35.197150 21945 rpcz_store.cc:276] 0709 13:07:34.195335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.150102 (+954767us) service_pool.cc:224] Handling call
0709 13:07:35.150435 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.196251 (+ 45816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.196550 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.200742 22018 rpcz_store.cc:276] 0709 13:07:33.904742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.904921 (+   179us) service_pool.cc:224] Handling call
0709 13:07:35.159097 (+1254176us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54004196d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:35.159273 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338102656}
I20260709 13:07:35.238524 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.244508 22024 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:35.239982 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.244994 22023 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:35.245342 22021 raft_consensus.cc:2410] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:35.240255 22019 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.240655 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.246526 22020 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.242290 21949 rpcz_store.cc:276] 0709 13:07:34.134680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.147473 (+1012793us) service_pool.cc:224] Handling call
0709 13:07:35.153010 (+  5537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.198093 (+ 45083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.198357 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.241343 21943 rpcz_store.cc:276] 0709 13:07:33.791185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.869619 (+ 78434us) service_pool.cc:224] Handling call
0709 13:07:33.870035 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.506576 (+636541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.176588 (+670012us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400140fd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:35.176797 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302973312}
I20260709 13:07:35.248627 21943 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:35.249961 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.250710 22023 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.257825 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.258664 22024 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:35.265484 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.261245 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.268621 22019 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.271201 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.272696 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.273846 22021 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:35.168362 26156 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.273545 22018 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:35.281596 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.282354 22021 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.284219 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.285323 21868 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:35.248615 25440 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.211923 26107 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.262720 26166 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.305948 21949 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:35.216681 26110 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.312750 22019 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:35.267089 26121 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.315678 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:35.320289 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.321375 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.321642 22019 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:35.324427 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:35.407300 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 82995us
I20260709 13:07:35.408586 21916 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:35.410655 26140 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:35.411067 25902 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:35.411713 25902 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:35.411661 26140 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:35.412494 25902 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.413031 26140 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:35.413546 26140 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:35.414763 26140 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.416504 26140 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.329519 26166 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:35.342687 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.423354 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.353540 21873 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:07:35.341511 22023 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:35.201345 26139 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.424674 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.364315 22021 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:07:35.398639 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2206) took 1283 ms. Trace:
I20260709 13:07:35.374814 26111 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.377799 26110 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.308135 25440 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.352741 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.283931 26094 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:35.331496 25671 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:35.328780 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.234915 26133 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.328537 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:35.405663 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2207) took 1290 ms. Trace:
I20260709 13:07:35.405524 22020 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:35.406271 21868 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:35.441489 22017 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:07:35.379426 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.442335 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.443171 21868 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:35.346310 26037 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:35.428376 21947 rpcz_store.cc:276] 0709 13:07:34.115260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.859611 (+744351us) service_pool.cc:224] Handling call
0709 13:07:34.859941 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.860149 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:34.962148 (+101999us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.398145 (+435997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.398223 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:35.398283 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.398375 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.398554 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":396043,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":5195,"raft.queue_time_us":140,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":16319,"thread_start_us":536990,"threads_started":2}
I20260709 13:07:35.304574 26024 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.338991 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.333003 21949 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:35.430529 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.429903 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.433828 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.449023 22022 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.439056 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.429656 21916 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:35.444089 21866 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.427264 26180 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.451258 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:35.450703 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.453653 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.454002 22017 raft_consensus.cc:2368] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
W20260709 13:07:35.454205 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 125760us
I20260709 13:07:35.452148 21874 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:35.454317 22019 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:35.451326 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.455005 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.444998 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:35.456451 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:35.456970 26118 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:35.458079 26025 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:35.458214 26118 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:35.457372 21916 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:35.461988 21868 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:35.441577 21942 rpcz_store.cc:276] 0709 13:07:34.115522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.860971 (+745449us) service_pool.cc:224] Handling call
0709 13:07:34.861284 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.861485 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:35.217075 (+355590us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.405302 (+188227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.405358 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:35.405402 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.405467 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.405595 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":445896,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":94,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":17665,"thread_start_us":539098,"threads_started":2}
I20260709 13:07:35.443092 26093 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:35.439080 26111 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:35.462347 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:35.465178 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:35.468325 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.468760 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.468820 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.469033 22021 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:35.450685 26037 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.474308 21868 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:35.475641 22017 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:35.466579 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:35.477041 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.452411 26135 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:35.450178 26179 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.454319 26110 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:35.445969 26094 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.522080 26094 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:35.523517 21868 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:07:35.523746 25986 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:35.458631 26025 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:35.477324 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:35.486362 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:35.524384 25986 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.496245 21866 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:35.458842 26118 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:35.497886 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:35.498246 26139 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:35.498943 26178 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:07:35.476496 26111 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.502161 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.503958 26084 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.506307 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:35.498183 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2208) took 1382 ms. Trace:
I20260709 13:07:35.510551 25440 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:35.512811 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:35.513109 26166 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:35.486292 26110 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.517491 21945 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:35.519110 26179 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.522257 26037 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.484640 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.464120 26040 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.459597 26024 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.461196 26180 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.465672 26106 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:07:35.524852 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.680866 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.681352 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.681145 21868 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:35.682096 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 577) took 1133 ms. Trace:
I20260709 13:07:35.653704 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 665) took 1596 ms. Trace:
W20260709 13:07:35.629529 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.683027 22017 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:35.626636 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 520) took 1420 ms. Trace:
I20260709 13:07:35.465808 25798 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.681741 21873 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:35.584903 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.478391 26125 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:35.691995 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:35.692830 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:35.653797 21950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1469) took 1867 ms (client timeout 1728 ms). Trace:
I20260709 13:07:35.469552 26108 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:35.682631 21945 rpcz_store.cc:276] 0709 13:07:34.553918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.516757 (+962839us) service_pool.cc:224] Handling call
0709 13:07:35.517275 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.681738 (+164463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.682035 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:35.693539 21950 rpcz_store.cc:269] 0709 13:07:33.786059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.788535 (+  2476us) service_pool.cc:224] Handling call
0709 13:07:33.896808 (+108273us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4df8c 00007f6352f4def6 0000000000375939 00007f635afc11e0 00007f635b08a0c4 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:07:35.653480 (+1756672us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b540029a254. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:35.653702 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662125440}
I20260709 13:07:35.625535 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:35.697120 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.578902 22019 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
W20260709 13:07:35.687438 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.684547 21949 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:35.684036 21948 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:35.683696 22016 rpcz_store.cc:276] 0709 13:07:34.206708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.206880 (+   172us) service_pool.cc:224] Handling call
0709 13:07:34.972586 (+765706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.973597 (+  1011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.626386 (+652789us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54001ee6d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:35.626561 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642217216}
I20260709 13:07:35.470647 26188 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.691984 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.686316 21867 rpcz_store.cc:276] 0709 13:07:34.056824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.056983 (+   159us) service_pool.cc:224] Handling call
0709 13:07:34.097878 (+ 40895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.535492 (+437614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.653331 (+1117839us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540034cbd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:35.653613 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746982272}
I20260709 13:07:35.693056 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.686825 21944 rpcz_store.cc:276] 0709 13:07:34.115787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.126905 (+ 11118us) service_pool.cc:224] Handling call
0709 13:07:35.497976 (+1371071us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b540032a354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:35.498111 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848055168}
I20260709 13:07:35.600780 21941 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:35.698611 21988 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:35.712077 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.736459 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 578) took 1107 ms. Trace:
I20260709 13:07:35.733361 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:35.703941 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 232012us
I20260709 13:07:35.734431 21866 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:35.711046 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:35.736639 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.603729 26186 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:07:35.697527 21874 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:35.708935 22022 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:35.698077 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.737200 21941 rpcz_store.cc:276] 0709 13:07:34.629781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.586421 (+956640us) service_pool.cc:224] Handling call
0709 13:07:35.600467 (+ 14046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.736213 (+135746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.736407 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.737445 22021 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:35.738775 22024 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.685211 26110 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.747637 22020 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:35.744454 21872 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.483908 26149 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:35.747140 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.749387 22016 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:35.749832 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51301.6us
I20260709 13:07:35.748761 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.525871 25903 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.751240 21866 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:35.743012 21871 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:35.753901 22017 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:35.575690 26189 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:35.751241 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:35.758873 21950 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:35.759744 21945 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:07:35.731877 26120 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:35.695670 26107 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:35.763248 22024 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:35.569041 25928 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:35.731714 26094 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:35.760130 21945 pending_rounds.cc:85] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 9
I20260709 13:07:35.769914 21945 pending_rounds.cc:107] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:07:35.770257 21945 raft_consensus.cc:2889] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.731178 26153 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.676311 26134 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:35.739976 26125 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:35.603464 25898 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:35.772001 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.766283 21988 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:35.780110 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:35.769083 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 286671us
I20260709 13:07:35.750735 26149 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.764780 26093 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:35.790740 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:35.784063 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.782764 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:35.788946 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.769995 25440 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:35.769694 26094 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.750281 25902 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.801997 21870 raft_consensus.cc:2368] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13.
I20260709 13:07:35.745226 26188 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.803766 22608 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:35.804111 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:35.805889 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.785212 26107 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:35.789788 26139 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:35.765044 26181 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:07:35.786849 26149 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:35.810763 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:35.788753 26036 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:35.814213 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 660) took 1835 ms. Trace:
I20260709 13:07:35.814807 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.797267 26134 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:35.797822 25440 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:35.817544 21946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2201) took 1703 ms (client timeout 2194 ms). Trace:
I20260709 13:07:35.794144 26193 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.765763 26189 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.781725 26153 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:35.861459 21946 rpcz_store.cc:269] 0709 13:07:34.113804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.540654 (+426850us) service_pool.cc:224] Handling call
0709 13:07:35.817334 (+1276680us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54000fcb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:35.817462 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114448640}
I20260709 13:07:35.807753 26093 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:35.823510 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:35.808374 26183 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.891701 22016 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:35.821987 21947 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:35.860302 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.862455 21866 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.861826 21875 rpcz_store.cc:276] 0709 13:07:33.978579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.978696 (+   117us) service_pool.cc:224] Handling call
0709 13:07:34.012141 (+ 33445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.579681 (+567540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.814014 (+1234333us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540044dc54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:35.814166 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303882496}
I20260709 13:07:35.892460 21867 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:35.823696 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:35.896281 21945 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:35.823186 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:35.870244 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.898141 21869 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:35.871529 21948 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:35.873956 26054 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.823150 26037 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.877518 26180 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:35.904954 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.880672 26111 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.904899 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.819896 25903 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.885320 26179 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:35.820477 26107 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.863070 25440 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.885802 26118 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.887192 26106 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:35.888214 26166 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.806529 26094 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.824421 26143 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:35.913190 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:35.899022 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 88941.5us
I20260709 13:07:35.816841 26139 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.902604 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.897518 21950 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:35.878935 26189 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.859877 25898 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:35.881177 26125 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.906769 21875 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:35.798533 26025 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.910104 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.919003 26139 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.922967 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:35.924484 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.867781 26036 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:35.914686 26191 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:07:35.929586 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.934048 21841 leader_election.cc:400] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:35.870443 26193 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:35.910112 25986 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:35.939934 21841 leader_election.cc:403] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.914916 26108 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:35.940936 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.945341 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.951517 22023 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:35.945626 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:35.926678 26118 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.906646 26037 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.953064 21874 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:35.911913 25903 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.914820 26166 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:35.936887 26143 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:35.936192 26040 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:35.959024 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:35.959246 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.979509 21869 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:35.968629 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 172389us
I20260709 13:07:35.957109 21866 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
W20260709 13:07:35.970484 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 204191us
I20260709 13:07:35.957724 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:35.958011 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:35.928088 25898 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:35.958505 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:35.957141 21875 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:35.985853 21873 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:35.979941 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:35.986908 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.984476 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:35.987654 21873 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:35.991816 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:35.981576 21838 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.042s (SENT) [suppressed 48 similar messages]
I20260709 13:07:35.996016 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.997159 21872 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:35.996270 22573 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:35.997407 21866 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:35.999135 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.999657 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.000473 21867 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:36.000948 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.002107 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.969437 26124 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.003533 21873 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:35.970110 26195 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:35.985023 25871 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:36.008122 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.016664 21866 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:36.018258 21866 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [8.5-11.7]
I20260709 13:07:35.972920 25928 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:36.011672 21869 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:35.995371 25986 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:36.018949 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:35.996055 26084 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:36.019829 21950 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:36.020985 21866 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:36.026589 21948 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:36.022552 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:36.028071 21946 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:36.023183 21873 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:36.006805 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.023191 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:36.029138 21872 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 7: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:36.023445 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:36.029733 21941 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.017684 21949 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:07:36.030782 21949 pending_rounds.cc:85] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 4
I20260709 13:07:36.031082 21949 pending_rounds.cc:107] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:36.031333 21949 raft_consensus.cc:2889] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.032284 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.032976 21875 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:35.995692 25868 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:36.008862 25902 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.009054 25898 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:36.046240 21873 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:36.015998 25871 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:36.009303 26180 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:36.012338 26135 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:36.012861 26134 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:36.041481 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:36.033987 21866 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:36.022239 26181 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:35.958844 26093 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.064905 21866 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:36.048918 21874 raft_consensus.cc:2376] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12. Re-sending same reply.
I20260709 13:07:36.010061 26124 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.069137 21873 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:36.039449 25924 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:36.082170 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.048543 26040 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:36.045846 26188 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.045734 25898 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.013463 26108 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.034963 26204 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:36.085033 21944 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:36.063694 26135 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:36.033099 26179 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:07:36.068178 25871 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:36.088873 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 175772us
I20260709 13:07:36.081907 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:36.065544 26181 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:36.016677 26195 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.069227 26199 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:36.100090 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 91376.3us
W20260709 13:07:36.104347 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 90863.8us
W20260709 13:07:36.116284 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 134723us
I20260709 13:07:36.086277 26040 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:36.062445 26110 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.092772 25898 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.071592 26180 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.069475 26202 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:07:36.046034 26143 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.113888 26181 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.045495 25928 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:36.130864 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 150989us
W20260709 13:07:36.131736 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 140004us
I20260709 13:07:36.081702 26084 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:36.144232 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:36.144723 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:36.125944 26199 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:36.111245 26204 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:36.153810 21841 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:36.124403 26036 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:36.160215 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.160866 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.161693 22017 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:36.104887 26200 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:07:36.163358 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:36.163554 25868 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:36.151721 26134 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.164218 21873 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:36.169358 26084 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:36.152345 25903 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:36.172004 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.182997 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.172569 26210 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:36.173274 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.175518 26189 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:36.181077 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.176352 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:36.229768 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.187070 25868 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:36.189839 22023 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
W20260709 13:07:36.202209 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100404us
W20260709 13:07:36.235948 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 59688.2us
I20260709 13:07:36.203400 26222 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:36.230731 22016 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:36.163141 26193 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:36.232172 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.240903 22015 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:36.155154 26212 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:36.182355 26037 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.182623 26084 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:36.242269 21873 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:36.242398 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:36.189468 26210 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.155511 26111 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:07:36.237718 26036 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:36.242839 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 59300.3us
I20260709 13:07:36.248445 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:36.237818 26101 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.145308 26135 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.255030 22608 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:07:36.255414 22608 pending_rounds.cc:85] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 8
I20260709 13:07:36.255671 22608 pending_rounds.cc:107] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:36.239535 26214 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.255761 21873 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:36.255915 22608 raft_consensus.cc:2889] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.242471 26200 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:36.248072 26222 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:36.244161 26166 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.233107 26215 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:07:36.268934 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.270072 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:36.251597 26212 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:36.253154 26210 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.251091 26189 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:36.254873 26036 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:36.189777 26040 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.279084 21950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:36.267401 26200 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:36.261680 26101 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.281613 25868 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.241490 26207 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:07:36.284871 26206 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:36.277307 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:36.279515 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:36.295595 21941 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:36.266258 26222 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:36.266714 26125 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:36.310488 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:36.293256 21950 raft_consensus.cc:606] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:36.311182 21950 raft_consensus.cc:614] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:36.274803 26133 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:36.304795 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:36.264950 26193 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:36.277974 26202 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:07:36.314554 25798 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.005s
I20260709 13:07:36.315610 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:36.316546 26205 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:07:36.263553 26214 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.320981 26110 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.325403 26101 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.302546 26135 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.326891 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:36.299016 26139 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.304440 26209 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.334128 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:36.265684 26199 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.337359 26153 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:36.340764 26037 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.343751 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.375380 21866 raft_consensus.cc:2376] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13. Re-sending same reply.
I20260709 13:07:36.350555 25798 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:36.326414 26125 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.345233 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.377765 21868 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.346376 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2209) took 1029 ms. Trace:
I20260709 13:07:36.311316 26206 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.301697 26200 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.378603 21947 rpcz_store.cc:276] 0709 13:07:35.316934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.451016 (+134082us) service_pool.cc:224] Handling call
0709 13:07:36.346186 (+895170us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54000fc154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:36.346316 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847141760}
I20260709 13:07:36.262042 26204 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.369937 22605 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:36.301249 26189 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.302501 26084 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.307351 25902 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:36.381271 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.383881 21866 raft_consensus.cc:2376] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10. Re-sending same reply.
I20260709 13:07:36.385030 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.385748 21866 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:36.380092 26037 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.388823 26037 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.390233 26024 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:36.390548 26206 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:36.392141 26110 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.392798 25871 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.393846 26214 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:36.361358 26195 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.395082 25871 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.396898 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.397548 21869 raft_consensus.cc:2376] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10. Re-sending same reply.
I20260709 13:07:36.398479 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.398857 26189 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.399188 21869 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:36.400951 26139 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:36.402460 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.403357 21869 raft_consensus.cc:2376] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12. Re-sending same reply.
I20260709 13:07:36.404199 22022 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:36.408748 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.408342 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.412058 21869 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:36.414279 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2211) took 1096 ms. Trace:
I20260709 13:07:36.421599 21943 rpcz_store.cc:276] 0709 13:07:35.317555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.737315 (+419760us) service_pool.cc:224] Handling call
0709 13:07:35.737608 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.767430 (+ 29822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.767474 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.781336 (+ 13862us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.886696 (+105360us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18003678a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:07:36.034538 (+147842us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:36.034573 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.034636 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.404722 (+370086us) raft_consensus.cc:1685] finished
0709 13:07:36.404742 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.414198 (+  9456us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6947,"raft.queue_time_us":44955,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4925,"spinlock_wait_cycles":5748096,"thread_start_us":147631,"threads_started":1,"wal-append.queue_time_us":333338}
W20260709 13:07:36.428510 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 118264us
I20260709 13:07:36.425954 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.349228 26222 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.431538 26222 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.436326 21869 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:36.438977 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:36.373435 26209 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.484232 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.455734 21868 raft_consensus.cc:2410] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:36.459506 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:36.486407 22017 raft_consensus.cc:2368] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12.
I20260709 13:07:36.377519 26094 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.472997 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:36.371006 26212 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.489298 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.490008 21868 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
W20260709 13:07:36.440778 26227 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:07:36.436195 26084 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.492903 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:36.493872 22024 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.469650 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.495642 21869 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:36.451448 25870 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:36.497608 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.506691 22024 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:36.442268 26156 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.446589 26125 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:36.519357 22021 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:36.514848 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.521054 21869 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:36.522346 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.523144 21868 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.524642 21916 leader_election.cc:400] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12.
I20260709 13:07:36.525144 21916 leader_election.cc:403] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:36.528363 22017 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:36.510836 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:36.511046 21839 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:36.513249 22016 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:36.493228 26195 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:36.538790 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 46730us
I20260709 13:07:36.496340 25870 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:36.542356 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:36.543658 21839 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:36.544648 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.545320 21944 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:36.545766 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:36.549809 21839 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:36.550722 21944 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:36.465975 26210 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.535482 25902 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.555707 21948 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:36.554009 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:36.552452 21839 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:36.554634 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:36.554857 26037 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:36.538794 25924 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:36.555807 21916 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:36.566143 21868 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:36.546907 26156 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:36.564422 26219 raft_consensus.cc:2764] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:36.548837 26118 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.572114 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.552443 26237 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:36.554487 26197 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.579993 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1602) took 1131 ms. Trace:
I20260709 13:07:36.565614 26125 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.569310 25986 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:36.578058 25870 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.619071 25870 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.619355 26209 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.619630 26210 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:36.621243 26204 consensus_queue.cc:1175] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "51e52b544fab4275aab4f7fbe81942d2" responder_term: 12 status { last_received { term: 12 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:36.627270 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:36.628708 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.591733 26153 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:36.593640 26118 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12.
I20260709 13:07:36.594440 26200 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.595610 26124 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.665916 26156 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:36.667485 26156 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.598227 26110 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:36.600196 26149 consensus_meta.cc:287] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.001s
I20260709 13:07:36.669467 26149 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.601289 26111 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:36.673480 26111 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:36.674770 26111 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.580394 22020 rpcz_store.cc:276] 0709 13:07:35.448878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.448997 (+   119us) service_pool.cc:224] Handling call
0709 13:07:35.743687 (+294690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.748040 (+  4353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.579792 (+831752us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540017cad0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:36.579925 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677044992}
I20260709 13:07:36.581987 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.678047 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.678910 21868 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:36.680142 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.680943 21868 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.680735 26241 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:36.572644 26195 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:36.682756 26195 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:36.676445 26111 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.672276 26149 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:36.684055 26195 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:36.586086 26184 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.072s	user 0.003s	sys 0.001s
I20260709 13:07:36.609274 26107 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.613087 26037 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:36.578169 26224 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:07:36.631150 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.628587 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2582) took 1124 ms. Trace:
I20260709 13:07:36.689416 26037 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.690117 21874 rpcz_store.cc:276] 0709 13:07:35.503691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.998873 (+495182us) service_pool.cc:224] Handling call
0709 13:07:36.628373 (+629500us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b54003ad754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:36.628492 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112872192}
I20260709 13:07:36.691366 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.691903 21874 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.632035 22024 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:36.629624 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:36.693558 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64010.4us
I20260709 13:07:36.693835 21949 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:36.694231 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:36.633541 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.636384 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.637542 26229 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:36.638424 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.696885 26229 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.697155 26232 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:36.697309 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.640370 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2217) took 1319 ms. Trace:
I20260709 13:07:36.697448 26229 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.697625 26232 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:36.641535 26101 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:36.698114 26232 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:36.698319 26101 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:36.699388 26101 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.642246 26213 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:36.700440 26213 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:36.700794 26107 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:36.701268 26107 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:36.701655 26107 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.701444 26213 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.696913 22015 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:36.703500 26213 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.644138 26180 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:36.648291 25898 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.003s
I20260709 13:07:36.705367 25898 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:36.653644 25440 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.002s
I20260709 13:07:36.603040 26106 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:36.705580 22019 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:36.707851 26110 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.632628 26153 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:36.708448 26110 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.709513 26153 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.710891 26153 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.711133 26110 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.615763 26125 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.708357 21866 raft_consensus.cc:2368] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12.
I20260709 13:07:36.697850 21942 rpcz_store.cc:276] 0709 13:07:35.321065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.473614 (+152549us) service_pool.cc:224] Handling call
0709 13:07:36.640174 (+1166560us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b540029ac54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:36.640309 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140460416}
I20260709 13:07:36.714481 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:36.728793 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 56794.1us
I20260709 13:07:36.718637 21868 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
W20260709 13:07:36.731065 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 177027us
W20260709 13:07:36.729449 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 161387us
I20260709 13:07:36.735494 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.720643 25440 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.738816 25440 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:36.741017 26094 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:36.741935 26125 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:36.743896 26200 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:36.744987 26181 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.001s
I20260709 13:07:36.745467 26181 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.747880 26181 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:36.751405 22016 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:36.751979 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:36.752784 22020 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.753909 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.757244 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.758044 25902 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:36.760968 26194 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:36.761516 26194 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.761917 26194 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.763988 22020 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:07:36.765103 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:36.730907 21874 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:36.769023 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.773263 26183 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:36.773746 26183 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:36.774632 26183 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.775720 26183 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.782598 22610 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:36.782877 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.826344 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:36.965847 21950 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:36.833791 22023 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:36.810508 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:36.945055 21870 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2564) took 1616 ms (client timeout 1546 ms). Trace:
I20260709 13:07:36.947983 26040 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:36.860708 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.969350 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.783193 25870 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.181s
I20260709 13:07:36.970978 25870 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.967017 21870 rpcz_store.cc:269] 0709 13:07:35.328316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.328501 (+   185us) service_pool.cc:224] Handling call
0709 13:07:36.944815 (+1616314us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540022bad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:36.944948 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829566336}
I20260709 13:07:36.971541 25870 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:36.972460 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.973307 21870 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:36.800222 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:36.973989 25870 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.832573 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:36.974852 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 142369us
I20260709 13:07:36.975598 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.953382 26229 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.783622 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.977850 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:36.978773 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.979070 26229 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:36.979233 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:36.979866 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.982751 26037 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:36.983947 21869 raft_consensus.cc:2410] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:36.980425 21868 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.988408 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:36.989210 21949 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:36.898638 26025 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:36.973431 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:36.974152 21948 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:36.826444 21947 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: [6.4-9.5]
I20260709 13:07:37.013051 22023 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:36.974977 26213 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:36.976840 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:36.991796 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:37.015055 21874 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:37.015949 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:36.972450 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.016996 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:37.017320 21944 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:37.017599 21874 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:36.998229 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:37.019694 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:36.980518 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:36.825826 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.020257 21947 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:36.997277 22574 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:37.018738 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.020740 21941 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.005128 21949 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:37.006929 26232 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.779259 26200 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:36.909999 26107 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:36.960994 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:37.028223 21866 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:37.028347 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.022364 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.006103 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:37.023391 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.024289 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:37.024735 21950 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:37.024236 21870 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:37.025650 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:37.031718 22574 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:37.012271 21868 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:37.029978 21943 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:37.033947 21868 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:37.024586 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:37.014343 26213 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.033964 21869 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:37.041251 21870 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:37.039604 22605 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:37.039700 21874 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.044195 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:37.044461 21874 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:37.036509 21868 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:37.053828 21941 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:37.047111 22608 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.036119 26200 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:37.095862 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.047071 21870 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:37.075542 21869 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:37.079440 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.095002 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.102234 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.102234 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.027451 26202 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:37.103257 21949 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:37.077200 21866 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:37.094799 21944 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:37.143352 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.143510 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.145334 21948 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:37.144635 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:37.072218 26153 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:37.042096 26213 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:37.195937 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.182406 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.173954 21948 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:37.206084 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:37.185799 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.142972 21866 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:37.175798 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2587) took 1663 ms. Trace:
I20260709 13:07:37.228232 21867 rpcz_store.cc:276] 0709 13:07:35.512542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.902272 (+389730us) service_pool.cc:224] Handling call
0709 13:07:37.175601 (+1273329us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b54000e10d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:37.175731 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186771712}
I20260709 13:07:37.186331 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.231316 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.233760 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:37.234709 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.235280 21947 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:37.236846 21942 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:37.232282 22602 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:37.048872 26124 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.165620 21869 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:37.035166 26110 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.107112 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:37.195715 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.165802 22601 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:37.149471 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:37.248180 21941 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:37.078150 26229 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:37.208525 26139 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:07:37.093022 26107 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:37.244889 26110 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.084643 26232 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:37.077955 26207 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.179s
W20260709 13:07:37.257483 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.242566 26124 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:37.264355 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.108292 26194 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:37.274060 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.320101 21946 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:37.280457 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.207334 26208 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.224650 26153 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.285256 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.289692 26036 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:37.236043 26134 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.293723 26040 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:37.295567 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.242305 26094 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:07:37.296921 25440 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.105774 26202 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:37.269735 26101 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.283535 26229 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.236729 25757 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:07:37.308626 26213 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:37.187621 26200 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:37.334674 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.340322 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.308292 26110 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.345971 26196 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:37.339504 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:37.317313 26183 consensus_meta.cc:287] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.001s
I20260709 13:07:37.318099 26124 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:37.311125 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.320871 21945 raft_consensus.cc:2376] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12. Re-sending same reply.
I20260709 13:07:37.660892 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:37.661232 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:37.661801 21873 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:37.662034 21875 raft_consensus.cc:2368] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9.
I20260709 13:07:37.661301 26166 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.341277 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.262729 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2814) took 1456 ms. Trace:
I20260709 13:07:37.337433 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1617) took 1391 ms. Trace:
I20260709 13:07:37.584970 26257 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.670033 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 437104us
I20260709 13:07:39.120675 26257 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.120993 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:37.722930 22018 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:37.384750 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.124699 21987 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:39.125770 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.407591 22604 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.360057 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 848) took 3048 ms. Trace:
I20260709 13:07:37.455248 22603 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:37.370441 22573 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:39.449812 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 2.07928e+06us
I20260709 13:07:39.451594 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:37.518980 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:37.564091 21838 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:39.532490 26275 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:39.532892 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 1.96871e+06us
W20260709 13:07:37.862049 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.682706 21866 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:39.551297 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2625) took 1869 ms. Trace:
I20260709 13:07:39.551792 21866 rpcz_store.cc:276] 0709 13:07:37.681865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.681993 (+   128us) service_pool.cc:224] Handling call
0709 13:07:37.682334 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.550920 (+1868586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.551217 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.678153 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:37.680989 21869 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:37.663761 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:39.556329 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2624) took 1876 ms. Trace:
I20260709 13:07:39.556789 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2616) took 1896 ms. Trace:
I20260709 13:07:39.556730 21869 rpcz_store.cc:276] 0709 13:07:37.680216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.680336 (+   120us) service_pool.cc:224] Handling call
0709 13:07:37.680723 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.556021 (+1875298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.556268 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.557225 21870 rpcz_store.cc:276] 0709 13:07:37.660134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.663515 (+  3381us) service_pool.cc:224] Handling call
0709 13:07:39.556724 (+1893209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.557397 26277 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.557893 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:37.666937 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:37.666196 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:39.561280 21873 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:07:39.561812 21873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2619) took 1897 ms (client timeout 2185 ms). Trace:
W20260709 13:07:39.562255 21873 rpcz_store.cc:269] 0709 13:07:37.664340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.665953 (+  1613us) service_pool.cc:224] Handling call
0709 13:07:39.561743 (+1895790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.665438 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:37.542811 21914 connection.cc:256] RPC call timeout handler was delayed by -1.1509949680000773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 13:07:39.566112 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0952600570000186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:07:39.566493 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0277600570000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:07:39.566793 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0178600570000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:07:39.567082 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0070600569999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:07:37.289220 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.682551 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.594015 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.353621 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:39.603492 21941 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
W20260709 13:07:39.604236 21941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1514) took 2409 ms (client timeout 2213 ms). Trace:
W20260709 13:07:39.604677 21941 rpcz_store.cc:269] 0709 13:07:37.195189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.318284 (+123095us) service_pool.cc:224] Handling call
0709 13:07:39.604101 (+2285817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.347078 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:39.606269 21946 raft_consensus.cc:2376] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11. Re-sending same reply.
W20260709 13:07:39.606783 21946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1518) took 2295 ms (client timeout 2131 ms). Trace:
W20260709 13:07:39.607142 21946 rpcz_store.cc:269] 0709 13:07:37.311335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.323875 (+ 12540us) service_pool.cc:224] Handling call
0709 13:07:39.606718 (+2282843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.282034 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:39.608620 21947 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:39.609056 21947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1516) took 2392 ms (client timeout 1923 ms). Trace:
W20260709 13:07:39.609391 21947 rpcz_store.cc:269] 0709 13:07:37.216966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.239050 (+ 22084us) service_pool.cc:224] Handling call
0709 13:07:39.608991 (+2369941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.309726 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:37.662775 21949 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:39.622836 21948 raft_consensus.cc:2376] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8. Re-sending same reply.
W20260709 13:07:39.623859 21948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1517) took 2377 ms (client timeout 1991 ms). Trace:
W20260709 13:07:39.624351 21948 rpcz_store.cc:269] 0709 13:07:37.246611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.247131 (+   520us) service_pool.cc:224] Handling call
0709 13:07:39.623757 (+2376626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.625074 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 592) took 2473 ms. Trace:
I20260709 13:07:39.625504 21949 rpcz_store.cc:276] 0709 13:07:37.152056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.582100 (+430044us) service_pool.cc:224] Handling call
0709 13:07:37.662584 (+ 80484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.623269 (+1960685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.624851 (+  1582us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b5400298e50. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:39.625008 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184308608}
I20260709 13:07:37.579967 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:39.107174 26263 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.116506 26264 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.627591 26204 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:39.628193 26264 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.628693 26204 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.630674 26264 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.631193 26264 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.631670 26264 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.304018 26268 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:39.305866 26266 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.636226 26266 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.638567 26266 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.639096 26266 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.639544 26266 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.323294 21768 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.327163 26270 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.328486 26271 consensus_queue.cc:1059] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:39.330265 21761 maintenance_manager.cc:643] P 2e9dea115c0a415895e1d51deced12f4: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.906s	user 0.208s	sys 0.061s Metrics: {"bytes_written":29892,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":127013,"dirs.run_cpu_time_us":488,"dirs.run_wall_time_us":27779,"drs_written":1,"lbm_read_time_us":396,"lbm_reads_lt_1ms":4,"lbm_write_time_us":117150,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":133731,"threads_started":2,"update_count":8,"wal-append.queue_time_us":6825}
I20260709 13:07:39.380401 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:39.384780 21772 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 164) took 23536 ms (client timeout 15000 ms). Trace:
I20260709 13:07:39.044710 22019 rpcz_store.cc:276] 0709 13:07:35.806011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.806149 (+   138us) service_pool.cc:224] Handling call
0709 13:07:35.806458 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.706684 (+900226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.262445 (+555761us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b54000dd9d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:37.262656 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067356032}
W20260709 13:07:39.325176 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46508.6us
I20260709 13:07:39.122611 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2839) took 1400 ms. Trace:
I20260709 13:07:39.693153 26286 raft_consensus.cc:3055] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:39.693347 22018 rpcz_store.cc:276] 0709 13:07:37.722170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.722277 (+   107us) service_pool.cc:224] Handling call
0709 13:07:37.722597 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.122348 (+1399751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.122546 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.693678 26286 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:07:39.304716 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 178955us
I20260709 13:07:39.694875 26286 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.120332 22021 rpcz_store.cc:276] 0709 13:07:35.946518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.948745 (+  2227us) service_pool.cc:224] Handling call
0709 13:07:35.949207 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.520012 (+570805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.337141 (+817129us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400365954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:37.337351 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310385536}
I20260709 13:07:39.698588 26266 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.698911 26286 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:38.777940 22045 debug-util.cc:398] Leaking SignalData structure 0x7b0800067f80 after lost signal to thread 20759
W20260709 13:07:39.702301 22045 debug-util.cc:398] Leaking SignalData structure 0x7b0800039620 after lost signal to thread 21807
W20260709 13:07:39.703578 22045 debug-util.cc:398] Leaking SignalData structure 0x7b0800039300 after lost signal to thread 21899
W20260709 13:07:39.703853 22045 debug-util.cc:398] Leaking SignalData structure 0x7b0800039360 after lost signal to thread 21900
W20260709 13:07:39.315423 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.592854 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.408262 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.370042 22608 raft_consensus.cc:2368] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14.
I20260709 13:07:39.721203 22608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 704) took 2442 ms. Trace:
I20260709 13:07:39.721691 22608 rpcz_store.cc:276] 0709 13:07:37.278553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.279927 (+  1374us) service_pool.cc:224] Handling call
0709 13:07:39.720929 (+2441002us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b54002f80d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:39.721125 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22538496}
I20260709 13:07:39.723254 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:37.501674 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 654) took 1259 ms. Trace:
I20260709 13:07:37.474555 22601 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:39.727293 26290 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.727780 22601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 705) took 2415 ms (client timeout 1699 ms). Trace:
W20260709 13:07:39.728214 22601 rpcz_store.cc:269] 0709 13:07:37.312912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.313082 (+   170us) service_pool.cc:224] Handling call
0709 13:07:39.727613 (+2414531us) spinlock_profiling.cc:243] Waited 77.2 ms on lock 0x7b5400663854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:39.727714 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177629952}
I20260709 13:07:37.448047 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:39.730300 22602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 708) took 2399 ms (client timeout 2163 ms). Trace:
W20260709 13:07:39.730659 22602 rpcz_store.cc:269] 0709 13:07:37.331041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.447670 (+116629us) service_pool.cc:224] Handling call
0709 13:07:39.730232 (+2282562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.389292 22609 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:37.396214 25440 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.750603 25440 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:37.571810 25898 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:37.563021 25986 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.528937 26025 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:39.755551 25986 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.756093 26025 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.757939 25986 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:37.397969 26036 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.111670 26054 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:39.765738 26054 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.768234 26054 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:37.471002 26110 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.771386 26110 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.286720 26134 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:39.314549 26139 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:39.349730 26149 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.364459 26153 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.663271 26166 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.786696 26166 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.396622 26037 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:37.411521 26194 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.295686 26040 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.795207 26040 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:37.398614 26196 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:37.370127 26084 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.798416 26196 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.798849 26084 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.799599 26196 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.288934 26101 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.481142 26124 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.020780 26141 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.364253 26208 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.801578 26101 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.806773 26208 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:37.435331 26213 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:37.385921 26229 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.803812 26040 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.333634 26183 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:37.384879 26202 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.127527 26207 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.817404 26207 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.819653 26207 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.363699 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2838) took 1641 ms. Trace:
I20260709 13:07:39.821636 22023 rpcz_store.cc:276] 0709 13:07:37.721935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.825477 (+1103542us) service_pool.cc:224] Handling call
0709 13:07:38.825916 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.122609 (+296693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.122643 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.123151 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.240239 (+117088us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:39.240300 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.363254 (+122954us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54001793d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:39.363303 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.363356 (+    53us) raft_consensus.cc:1685] finished
0709 13:07:39.363369 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.363632 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":179769,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":680301824,"thread_start_us":116641,"threads_started":1,"wal-append.queue_time_us":15480}
I20260709 13:07:39.823421 22605 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
W20260709 13:07:39.825582 22605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 659) took 2487 ms (client timeout 2692 ms). Trace:
W20260709 13:07:39.825959 22605 rpcz_store.cc:269] 0709 13:07:37.338125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.592480 (+254355us) service_pool.cc:224] Handling call
0709 13:07:39.825406 (+2232926us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54005b2cd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:39.825521 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242940672}
I20260709 13:07:39.826978 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:39.827692 22605 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:39.360582 22604 rpcz_store.cc:276] 0709 13:07:36.312049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.312153 (+   104us) service_pool.cc:224] Handling call
0709 13:07:36.331263 (+ 19110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.358687 (+3027424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.359664 (+   977us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400650ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:39.359922 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474770176}
I20260709 13:07:39.423599 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 852) took 2591 ms. Trace:
I20260709 13:07:39.830156 22603 rpcz_store.cc:276] 0709 13:07:36.832660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.833262 (+   602us) service_pool.cc:224] Handling call
0709 13:07:36.833559 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.362691 (+2529132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.423300 (+ 60609us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b5400587354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:39.423523 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429270400}
I20260709 13:07:39.434919 26272 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.832971 26272 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.835261 26272 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.464259 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:39.482213 26200 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.836392 26200 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:39.836890 26200 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.495312 26188 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:39.497351 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45859.1us
I20260709 13:07:39.840497 26188 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.840931 26188 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.842283 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:39.843533 26166 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:39.844323 26166 consensus_queue.cc:1243] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:39.501266 26198 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.844863 26198 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.845329 26166 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:39.845748 26166 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:39.846575 26166 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.847172 26198 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.515604 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:39.528177 26030 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:39.847829 26166 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.848227 26030 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.832499 22603 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:39.850422 26030 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:39.529064 26094 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:07:39.529518 21988 connection.cc:256] RPC call timeout handler was delayed by -2.2889424509999117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:07:39.801347 26084 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:39.851302 21988 connection.cc:256] RPC call timeout handler was delayed by -2.2049422009999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:07:39.851097 26094 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:39.851725 21988 connection.cc:256] RPC call timeout handler was delayed by -2.1347422009999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:07:39.852047 21988 connection.cc:256] RPC call timeout handler was delayed by -1.8386422009999706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 13:07:39.852324 21988 connection.cc:256] RPC call timeout handler was delayed by -1.8191424509999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2656s for a response
W20260709 13:07:39.852576 21988 connection.cc:256] RPC call timeout handler was delayed by -1.7291906340000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:07:39.852896 21988 connection.cc:256] RPC call timeout handler was delayed by -1.7291906340000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 13:07:39.540123 26275 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.545874 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:39.853154 26094 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.853739 26094 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:39.563973 21875 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
W20260709 13:07:39.853852 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 308041us
I20260709 13:07:39.564405 26277 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.565500 26280 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.854382 21875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2620) took 2189 ms (client timeout 2188 ms). Trace:
W20260709 13:07:39.854761 21875 rpcz_store.cc:269] 0709 13:07:37.664688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.665203 (+   515us) service_pool.cc:224] Handling call
0709 13:07:39.854307 (+2189104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.854682 26280 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.855887 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:37.684794 21871 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.857875 26213 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:39.619421 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51885.8us
I20260709 13:07:39.858541 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:39.858963 26188 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.627594 21950 raft_consensus.cc:2410] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:07:39.860958 21950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1511) took 2688 ms (client timeout 3058 ms). Trace:
W20260709 13:07:39.861296 21950 rpcz_store.cc:269] 0709 13:07:37.172708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.579695 (+406987us) service_pool.cc:224] Handling call
0709 13:07:39.860901 (+2281206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.650411 21874 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
W20260709 13:07:39.862104 21874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2623) took 2182 ms (client timeout 2085 ms). Trace:
W20260709 13:07:39.862452 21874 rpcz_store.cc:269] 0709 13:07:37.679914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.380099 (+1700185us) service_pool.cc:224] Handling call
0709 13:07:39.862043 (+481944us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.863579 21874 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:39.632285 26204 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:39.853200 21988 connection.cc:256] RPC call timeout handler was delayed by -1.5824906340000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 13:07:39.865113 21988 connection.cc:256] RPC call timeout handler was delayed by -1.4183349979999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 13:07:39.656283 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.674137 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:39.865432 22605 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:07:39.865851 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.644987 21768 catalog_manager.cc:5697] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:39.866856 25898 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:39.866711 21768 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.867367 25898 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:07:39.651041 21772 rpcz_store.cc:269] 0709 13:07:15.847926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.848110 (+   184us) service_pool.cc:224] Handling call
0709 13:07:39.376583 (+23528473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:33.718612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:33.734244 (+ 15632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:33.734297 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:07:33.734326 (+    29us) tablet.cc:662] Decoding operations
0709 13:07:33.735372 (+  1046us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:33.735461 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:33.735493 (+    32us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:07:33.736287 (+   794us) tablet.cc:701] Row locks acquired
0709 13:07:33.736345 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:07:33.736533 (+   188us) write_op.cc:270] Start()
0709 13:07:33.768216 (+ 31683us) write_op.cc:276] Timestamp: P: 1783602453736463 usec, L: 0
0709 13:07:33.768243 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:07:33.901851 (+133608us) log.cc:844] Serialized 3231 byte log entry
0709 13:07:34.935920 (+1034069us) op_driver.cc:464] REPLICATION: finished
0709 13:07:35.426307 (+490387us) write_op.cc:301] APPLY: starting
0709 13:07:35.438631 (+ 12324us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:35.515724 (+ 77093us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:35.515866 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:35.516717 (+   851us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:35.517219 (+   502us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:07:35.517262 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:35.517646 (+   384us) log.cc:844] Serialized 65 byte log entry
0709 13:07:35.517854 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:35.517983 (+   129us) write_op.cc:454] Released schema lock
0709 13:07:35.518048 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:35.518675 (+   627us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:35.518700 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":985552,"reported_tablets":28,"spinlock_wait_cycles":19328,"child_traces":[["op",{"apply.queue_time_us":425983,"apply.run_cpu_time_us":4678,"apply.run_wall_time_us":128562,"num_ops":8,"prepare.queue_time_us":373253,"prepare.run_cpu_time_us":18310,"prepare.run_wall_time_us":410550,"raft.queue_time_us":122544,"raft.run_cpu_time_us":67136,"raft.run_wall_time_us":302079,"replication_time_us":1166514,"thread_start_us":708007,"threads_started":4,"wal-append.queue_time_us":104355,"wal-append.run_cpu_time_us":34222,"wal-append.run_wall_time_us":2417299}]]}
I20260709 13:07:39.868257 25898 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.656430 26285 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:39.869114 21768 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 8 to 10, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 10 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:39.869556 26285 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.870388 25986 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:39.870668 21768 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 9, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 9 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:39.871778 26285 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.872262 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:39.872859 21874 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:39.669040 26271 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.627874 26263 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.683844 21762 maintenance_manager.cc:419] P 2e9dea115c0a415895e1d51deced12f4: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9618 bytes on disk
I20260709 13:07:39.687196 26288 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.687376 26287 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.656996 26270 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.691864 26264 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.696017 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:39.903033 26040 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.705296 22045 debug-util.cc:398] Leaking SignalData structure 0x7b08003eafc0 after lost signal to thread 21974
W20260709 13:07:39.718775 22606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 658) took 2381 ms (client timeout 2188 ms). Trace:
I20260709 13:07:39.904310 26286 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.726227 22610 rpcz_store.cc:276] 0709 13:07:36.241792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.242100 (+   308us) service_pool.cc:224] Handling call
0709 13:07:37.501408 (+1259308us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400242f54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:37.501572 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762541440}
I20260709 13:07:39.733175 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:39.727833 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:39.741601 22602 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:07:39.740983 22609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 702) took 2536 ms (client timeout 1948 ms). Trace:
I20260709 13:07:39.903214 26271 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.745981 26291 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:39.909598 26229 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.910135 26291 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.911235 26271 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.911695 26229 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:39.903388 26282 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.906903 26285 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.907131 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:39.913450 21946 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
W20260709 13:07:39.905853 21838 connection.cc:256] RPC call timeout handler was delayed by -1.5860014359999468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:07:39.907560 26040 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.907611 26030 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:39.914526 21838 connection.cc:256] RPC call timeout handler was delayed by -1.1737173210000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 13:07:39.914788 26030 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:39.773295 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.907758 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:39.915849 21947 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.915755 26030 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:37.710512 26107 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:39.776463 26054 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.912382 26291 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.927765 21761 maintenance_manager.cc:643] P 2e9dea115c0a415895e1d51deced12f4: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.006s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":363,"lbm_reads_lt_1ms":4}
I20260709 13:07:39.926072 26271 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.928220 26054 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.928941 26271 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.792579 26037 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:39.807089 26101 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:39.803470 26124 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:39.804347 26141 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.122897 26257 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:39.851789 26084 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:39.853446 26275 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.939675 26084 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:39.940110 26084 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:39.941398 26275 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.941097 26084 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.851326 26276 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:07:39.942421 26084 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.942792 26276 consensus_queue.cc:1243] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:39.618204 26283 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:39.589838 26279 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.856959 26280 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.856923 26094 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.945068 26037 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.857937 21871 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:39.682927 21873 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:39.927731 26107 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:39.926265 26263 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:39.944689 26213 consensus_queue.cc:1175] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95296a4420ed41b69191d3d4353cf2b0" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:39.952365 26263 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:39.952931 26263 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:39.952525 21871 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.930621 26200 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.954133 21871 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.946537 26279 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.955762 26200 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.957667 26279 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.958634 26283 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.961027 21870 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:39.961257 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:39.962224 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:39.962944 21870 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.871981 21768 catalog_manager.cc:5697] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:07:39.865387 21988 connection.cc:256] RPC call timeout handler was delayed by -1.351839512999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 13:07:39.850425 22603 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.881929 21875 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:07:39.963636 21988 connection.cc:256] RPC call timeout handler was delayed by -1.261190633999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 13:07:39.900127 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.964161 21988 connection.cc:256] RPC call timeout handler was delayed by -1.261190633999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 13:07:39.964689 21988 connection.cc:256] RPC call timeout handler was delayed by -1.2422906340000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 13:07:39.965113 21988 connection.cc:256] RPC call timeout handler was delayed by -1.1870346959999551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260709 13:07:39.965840 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:39.903000 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:39.895934 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:39.904780 21950 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:39.967310 21949 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:37.796931 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.727839 26290 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.913189 26285 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:39.914902 21838 connection.cc:256] RPC call timeout handler was delayed by -1.133301435999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
W20260709 13:07:39.996560 21838 connection.cc:256] RPC call timeout handler was delayed by -1.081393999999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 13:07:39.996831 21949 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:39.917030 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:39.997638 22610 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
W20260709 13:07:39.907840 22606 rpcz_store.cc:269] 0709 13:07:37.337760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.407897 (+ 70137us) service_pool.cc:224] Handling call
0709 13:07:39.718667 (+2310770us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.908501 26270 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.963153 26272 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.908588 26286 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.988837 26183 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:07:40.000449 26272 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:39.907706 22045 debug-util.cc:398] Leaking SignalData structure 0x7b080015a080 after lost signal to thread 21975
I20260709 13:07:39.907932 26288 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:39.908085 21867 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:39.908166 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:39.907402 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 211473us
I20260709 13:07:39.947799 26141 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:39.950975 26094 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.011627 21870 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:39.915853 26040 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:39.909610 22609 rpcz_store.cc:269] 0709 13:07:37.204885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.230138 (+ 25253us) service_pool.cc:224] Handling call
0709 13:07:39.740876 (+2510738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.907436 26287 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:39.921043 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:39.884824 26198 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:39.927871 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 660) took 2589 ms. Trace:
I20260709 13:07:39.930428 26054 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.893241 26110 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.932929 22604 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:07:40.050710 22604 pending_rounds.cc:85] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 11
I20260709 13:07:40.051090 22604 pending_rounds.cc:107] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:07:40.051326 22604 raft_consensus.cc:2889] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.855981 26277 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.946231 26037 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.886718 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:39.968990 22574 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:39.907270 26289 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.971148 21941 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:39.962142 21873 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:39.905733 26294 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.974948 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:39.976073 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:39.987804 21947 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:39.989192 21871 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:40.069545 22603 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:40.069715 21871 pending_rounds.cc:85] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 7
I20260709 13:07:40.070040 21871 pending_rounds.cc:107] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:40.070350 21871 raft_consensus.cc:2889] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.071344 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2626) took 2388 ms. Trace:
I20260709 13:07:39.895174 26207 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:07:39.884457 26153 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.085042 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:40.086637 26153 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:39.995587 22573 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:39.996393 21768 catalog_manager.cc:5697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:39.768787 21872 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
W20260709 13:07:40.087847 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 92367.4us
W20260709 13:07:40.088496 21872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2621) took 2423 ms (client timeout 1992 ms). Trace:
I20260709 13:07:39.999151 21839 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:40.088243 21768 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 8 to 11, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 11 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:40.088896 22573 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:40.089244 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 90179.7us
I20260709 13:07:40.089774 21768 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.090457 22607 raft_consensus.cc:2368] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13.
I20260709 13:07:39.775583 26134 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:40.091506 22607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 701) took 2896 ms (client timeout 1541 ms). Trace:
W20260709 13:07:40.091974 22607 rpcz_store.cc:269] 0709 13:07:37.195248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.195407 (+   159us) service_pool.cc:224] Handling call
0709 13:07:40.091314 (+2895907us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b54006d1d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:40.091437 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6546884864}
I20260709 13:07:40.095592 22573 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:40.007329 22045 debug-util.cc:398] Leaking SignalData structure 0x7b080037fda0 after lost signal to thread 22048
I20260709 13:07:40.006830 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:40.011802 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:40.096817 21944 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.012413 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:40.097369 22045 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1de0 after lost signal to thread 22634
W20260709 13:07:40.097683 22045 debug-util.cc:398] Leaking SignalData structure 0x7b0800389e60 after lost signal to thread 22635
I20260709 13:07:40.097740 21943 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.013163 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:39.908860 22601 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:40.018685 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:40.021641 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.025599 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:40.027359 21838 leader_election.cc:336] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.710s (SENT)
I20260709 13:07:39.991776 26257 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:40.088889 21872 rpcz_store.cc:269] 0709 13:07:37.665089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.666687 (+  1598us) service_pool.cc:224] Handling call
0709 13:07:40.088317 (+2421630us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400219654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:40.088427 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479661824}
I20260709 13:07:39.906747 26202 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.000980 26208 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.045078 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:40.104624 21768 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:40.118328 22018 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.045826 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.062512 26188 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.045639 22602 rpcz_store.cc:276] 0709 13:07:37.338478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.731325 (+2392847us) service_pool.cc:224] Handling call
0709 13:07:39.741370 (+ 10045us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.909279 (+167909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.927664 (+ 18385us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b540057dfd0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:39.927813 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22368512}
I20260709 13:07:40.052474 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:40.008648 25757 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:40.057389 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.126748 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.061558 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 92641.3us
I20260709 13:07:40.064664 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.131007 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.065913 22016 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:40.001322 26196 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:40.024113 26271 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.024030 26183 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.111466 26257 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:40.079655 26294 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.081470 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:40.081601 21867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2622) took 2404 ms (client timeout 1796 ms). Trace:
I20260709 13:07:40.066318 26110 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:40.084645 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.091724 26134 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:40.092772 26270 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.001724 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:40.093263 26296 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:40.079563 26289 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.094679 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.179229 21944 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:40.003355 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:40.100538 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:40.180939 26296 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:07:40.184451 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 157118us
W20260709 13:07:40.185545 21838 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.923s (SENT)
W20260709 13:07:40.186300 21838 leader_election.cc:336] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.989s (SENT)
I20260709 13:07:40.186637 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:40.101265 21875 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.071813 21871 rpcz_store.cc:276] 0709 13:07:37.683347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.684324 (+   977us) service_pool.cc:224] Handling call
0709 13:07:37.684675 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.070935 (+2386260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.071272 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:40.191330 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.925637 26295 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:07:39.954109 26263 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.119127 21950 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:40.046228 21868 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.117151 26229 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.119561 26094 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.117358 26141 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:40.193547 26229 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:40.193912 26141 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.194459 26229 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.196018 26141 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.123232 21942 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.128059 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:40.129491 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:40.134748 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.117311 26207 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.113978 26153 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.136494 22608 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:40.054623 26198 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:40.213711 26166 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.215246 26198 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.215656 26288 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.216285 26271 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.079519 26054 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:40.153648 21867 rpcz_store.cc:269] 0709 13:07:37.677695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.677829 (+   134us) service_pool.cc:224] Handling call
0709 13:07:40.081408 (+2403579us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540006f9d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:40.081528 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812672768}
I20260709 13:07:40.153146 26188 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.217042 26054 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:40.126366 25757 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:40.217362 26188 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.217950 26054 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:40.219239 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 91307.2us
I20260709 13:07:40.219352 25757 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:40.161957 26025 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.220767 21945 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.158146 25440 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.221524 25440 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:40.222198 26025 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.223481 25440 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:40.143878 21768 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 10, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:40.223927 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:40.224161 26282 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.111785 26194 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:07:40.082397 21866 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:40.167454 26286 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.224725 21768 catalog_manager.cc:5697] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 7, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 7 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:40.225814 26286 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:40.225917 26207 raft_consensus.cc:697] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:40.226153 26272 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:40.225811 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.122000 26208 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.226936 26207 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.227401 26287 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.228451 26208 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.153570 26257 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:40.229270 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:40.169643 21870 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:40.153483 21941 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.228477 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:40.174019 21949 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.230718 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:40.231251 21869 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.224761 21948 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:40.234154 21945 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:40.226295 21768 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:40.095716 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 119724us
I20260709 13:07:40.229841 22601 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:40.242555 21839 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:40.246014 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.247058 21948 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:40.248023 26289 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.248409 21948 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:40.248883 26283 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.250115 21768 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.252290 21768 catalog_manager.cc:5697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:40.253794 21942 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:40.255039 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:40.255285 21942 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:40.255915 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:40.256799 26271 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.257334 26271 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.257755 26271 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.181998 26270 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.258395 26270 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.260680 21947 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:40.260891 26141 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:40.153435 26183 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.262473 26141 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:40.264135 26183 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:40.211138 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 81762.3us
I20260709 13:07:40.213419 26153 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.274977 26202 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:40.275285 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:40.225050 26285 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.276140 22602 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:40.167682 26290 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.242686 21943 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:40.279058 21943 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:40.260289 26110 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.256814 26030 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:07:40.265568 26188 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.267616 21768 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:40.164721 26294 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.275383 26153 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.216368 26292 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:40.280155 21943 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:40.264544 25440 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.226326 26286 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.201016 21838 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.991s (SENT)
I20260709 13:07:40.282470 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:40.308758 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:40.283951 21868 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:40.284433 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:40.285327 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:40.285560 21948 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:40.290920 21874 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:40.210186 21875 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
W20260709 13:07:40.295874 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 201107us
I20260709 13:07:40.315097 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:40.296651 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 409970us
I20260709 13:07:40.264086 26141 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:40.300702 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.317435 22573 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:40.323246 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 122270us
W20260709 13:07:40.324151 21838 leader_election.cc:336] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.131s (SENT)
I20260709 13:07:40.324572 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:40.324791 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:40.327261 26030 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.328084 26030 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:40.329252 26030 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.331758 22018 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:40.286727 26025 raft_consensus.cc:2764] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:40.337872 21768 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:07:40.339107 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.340431 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.341953 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:40.343686 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:40.344969 21872 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
I20260709 13:07:40.345101 21768 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:40.346817 21768 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 10, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:40.350236 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:40.350222 21869 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:40.327139 21949 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:40.321848 26286 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.361033 21941 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:40.362010 22016 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:40.362043 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.332742 26183 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:40.333129 26294 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.321297 26292 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:40.376822 21941 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:07:40.378844 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:40.379871 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 687) took 1062 ms. Trace:
I20260709 13:07:40.341320 26036 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.376822 21839 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:40.336256 26208 consensus_queue.cc:1059] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:40.390460 21946 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:40.380388 21868 rpcz_store.cc:276] 0709 13:07:39.317108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.515317 (+198209us) service_pool.cc:224] Handling call
0709 13:07:40.379719 (+864402us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400318dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:40.379811 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455937920}
I20260709 13:07:40.332543 26094 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:40.395457 22574 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:40.357018 25898 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:40.408875 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08000538a0 after lost signal to thread 20759
W20260709 13:07:40.410315 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080008ed00 after lost signal to thread 21807
W20260709 13:07:40.411989 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe0e0 after lost signal to thread 21899
W20260709 13:07:40.412345 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080010c780 after lost signal to thread 21900
I20260709 13:07:40.415838 22574 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:40.418571 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800121200 after lost signal to thread 21915
W20260709 13:07:40.419723 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003b32c0 after lost signal to thread 21941
W20260709 13:07:40.420226 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003bf560 after lost signal to thread 21946
W20260709 13:07:40.420614 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800203fc0 after lost signal to thread 21947
W20260709 13:07:40.420959 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080033c9c0 after lost signal to thread 21948
W20260709 13:07:40.421748 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003bf580 after lost signal to thread 21974
W20260709 13:07:40.422254 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800378ea0 after lost signal to thread 21975
W20260709 13:07:40.423702 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800307780 after lost signal to thread 22048
W20260709 13:07:40.424861 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8d60 after lost signal to thread 22601
W20260709 13:07:40.429271 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 110938us
I20260709 13:07:40.397356 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:40.395956 26037 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:40.389714 26036 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:40.493062 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.572387 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.455686 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800305740 after lost signal to thread 22602
W20260709 13:07:40.573406 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800388a80 after lost signal to thread 22605
W20260709 13:07:40.463901 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 85106.6us
I20260709 13:07:40.582644 21941 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:40.532290 26094 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:40.581789 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800341140 after lost signal to thread 22606
W20260709 13:07:40.584519 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.588131 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.596405 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.602255 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:40.407258 26188 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.215s
I20260709 13:07:40.432801 26304 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.195s
W20260709 13:07:40.537362 26306 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:07:40.428195 26229 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:40.430727 26084 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:40.661284 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.454957 26183 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:40.610729 21945 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
W20260709 13:07:40.586644 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800105420 after lost signal to thread 22608
I20260709 13:07:40.574756 26037 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.455977 26036 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.713980 21946 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:40.455569 26141 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:40.721814 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.729611 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb840 after lost signal to thread 22609
W20260709 13:07:40.729981 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb2a0 after lost signal to thread 22610
I20260709 13:07:40.608129 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:40.733781 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.724174 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:40.737709 21941 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:40.732744 21948 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:40.546945 26263 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:40.583911 26094 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:40.520560 26302 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:40.546701 26270 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.617749 25757 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:40.755501 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 171959us
W20260709 13:07:40.741436 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003d25c0 after lost signal to thread 22634
I20260709 13:07:40.470609 26257 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:40.754691 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 180167us
W20260709 13:07:40.757891 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08000f26a0 after lost signal to thread 22635
I20260709 13:07:40.608342 26290 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:40.759060 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 444021us
I20260709 13:07:40.736457 26037 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.765467 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4f20 after lost signal to thread 25440
W20260709 13:07:40.768638 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae9e0 after lost signal to thread 25898
W20260709 13:07:40.769047 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080034b4a0 after lost signal to thread 25986
W20260709 13:07:40.771276 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003098a0 after lost signal to thread 26025
W20260709 13:07:40.771772 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080029cbe0 after lost signal to thread 26036
I20260709 13:07:40.756363 25757 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:40.772264 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003505a0 after lost signal to thread 26084
I20260709 13:07:40.530925 26292 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.774662 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:40.780088 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080036afe0 after lost signal to thread 26107
I20260709 13:07:40.783067 22023 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:40.788662 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080039a500 after lost signal to thread 26110
I20260709 13:07:40.608872 26296 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.798208 26296 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:40.790123 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb9a0 after lost signal to thread 26124
I20260709 13:07:40.808079 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:40.810139 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080031e7e0 after lost signal to thread 26153
W20260709 13:07:40.813376 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080026a5e0 after lost signal to thread 26166
W20260709 13:07:40.813763 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080039bb00 after lost signal to thread 26194
W20260709 13:07:40.814204 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2780 after lost signal to thread 26196
W20260709 13:07:40.814520 21971 debug-util.cc:398] Leaking SignalData structure 0x7b08003afcc0 after lost signal to thread 26202
W20260709 13:07:40.814858 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080033d980 after lost signal to thread 26208
W20260709 13:07:40.815128 21971 debug-util.cc:398] Leaking SignalData structure 0x7b080030dde0 after lost signal to thread 26213
W20260709 13:07:40.815404 21971 debug-util.cc:398] Leaking SignalData structure 0x7b0800283340 after lost signal to thread 26229
I20260709 13:07:40.760671 26301 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:07:40.770718 26302 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:40.756412 26107 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:40.865957 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 58096.1us
I20260709 13:07:40.843429 26290 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:40.914101 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:40.915009 26290 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.829054 26094 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:40.916232 26204 raft_consensus.cc:2764] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 13:07:40.917145 26311 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:07:40.918010 26313 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:40.919366 26313 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:40.805192 25440 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:40.915367 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:40.926635 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:40.941794 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:40.929795 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.930856 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:40.925539 26286 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.007s
I20260709 13:07:40.848505 25898 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.788250 26315 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
W20260709 13:07:40.969482 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.960325 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45015.8us
I20260709 13:07:40.970824 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:40.911023 26271 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.003s
I20260709 13:07:40.916357 26270 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.976938 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:40.986430 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.941270 26198 raft_consensus.cc:2764] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:07:40.942432 26196 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.989060 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:40.926173 26319 consensus_queue.cc:1175] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:40.977397 26271 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.995280 26271 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:40.972795 25898 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:40.998601 25898 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:40.972893 26286 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:41.001264 26286 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:41.009532 21871 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:40.965668 26194 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.963421 26204 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.853255 26153 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:40.927016 26313 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:07:40.817507 26141 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:41.021517 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.983716 26298 raft_consensus.cc:2764] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:07:40.985008 26296 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:40.848922 26183 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:41.008673 26196 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:41.049726 22607 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:07:41.050800 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 274686us
I20260709 13:07:40.938274 25757 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:41.046096 26325 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:41.042925 26296 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.063832 26229 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:41.030616 26198 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.026963 26194 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:41.073639 26296 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.055125 26196 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.079571 21946 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:41.087118 21943 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:41.087495 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:41.047286 26304 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:41.083580 26257 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:41.095427 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 144283us
I20260709 13:07:41.107172 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2255) took 1023 ms. Trace:
I20260709 13:07:41.107720 21949 rpcz_store.cc:276] 0709 13:07:40.083613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.359460 (+275847us) service_pool.cc:224] Handling call
0709 13:07:40.360287 (+   827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.586065 (+225778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.586098 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.621276 (+ 35178us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.773202 (+151926us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:40.773259 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.773358 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.106952 (+333594us) raft_consensus.cc:1685] finished
0709 13:07:41.106972 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.107108 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222315,"raft.queue_time_us":225552,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":121757,"thread_start_us":151464,"threads_started":1,"wal-append.queue_time_us":189911}
I20260709 13:07:41.088482 25757 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.077332 26315 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:41.053053 25440 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:41.092689 26084 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:41.105666 26301 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:41.130730 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.094094 26318 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:41.093077 26314 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:07:41.069667 26302 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:41.146698 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 169828us
W20260709 13:07:41.148787 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.149394 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:41.149739 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 373254us
I20260709 13:07:41.111817 26202 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:07:41.139227 26310 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:07:41.154474 26298 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.136827 26229 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:41.138573 26301 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:41.161477 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:41.155741 26312 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 13:07:41.167266 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78216us
I20260709 13:07:41.126920 26329 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:07:41.163344 26317 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:07:41.169540 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.170629 21914 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:41.172672 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:41.175482 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2246) took 1116 ms. Trace:
W20260709 13:07:41.166898 26321 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:07:41.181175 26326 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:07:41.138893 26194 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:41.170825 26316 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:07:41.175608 26282 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:41.175908 21950 rpcz_store.cc:276] 0709 13:07:40.058843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.276558 (+217715us) service_pool.cc:224] Handling call
0709 13:07:40.278680 (+  2122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.279036 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.279069 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.279536 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.592858 (+313322us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:40.592916 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.593010 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.175184 (+582174us) raft_consensus.cc:1685] finished
0709 13:07:41.175213 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.175401 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33389,"raft.queue_time_us":935,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11871,"thread_start_us":301051,"threads_started":1,"wal-append.queue_time_us":503486}
I20260709 13:07:41.190459 21914 leader_election.cc:400] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12.
I20260709 13:07:41.168857 26198 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.182394 26336 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:41.195612 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:41.205742 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:41.205681 26343 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:41.212390 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.213567 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.191354 26282 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:41.201112 26323 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:07:41.220405 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 52247.4us
I20260709 13:07:41.222239 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2244) took 1164 ms. Trace:
I20260709 13:07:41.225111 21942 rpcz_store.cc:276] 0709 13:07:40.058268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.256294 (+198026us) service_pool.cc:224] Handling call
0709 13:07:40.265850 (+  9556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.266260 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.266302 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.266893 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.762287 (+495394us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:40.762333 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.762405 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.221926 (+459521us) raft_consensus.cc:1685] finished
0709 13:07:41.221967 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.222155 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8533,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":495017,"threads_started":1,"wal-append.queue_time_us":759428}
I20260709 13:07:41.226420 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.227188 22020 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:41.227366 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.228935 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.229998 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.230703 22016 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:41.231590 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.232834 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.193346 26301 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:41.234006 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.234651 22018 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:41.235539 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.236282 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:41.219050 26336 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.236861 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.198279 26334 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.237597 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.238406 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.236258 22018 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:41.238721 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.210323 26257 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.244872 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:41.224129 26324 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:07:41.220078 26198 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.206512 26030 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:07:41.223237 26282 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.247394 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.248077 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.251026 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.243631 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.239486 26314 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:41.256699 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.249923 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.187402 26084 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:41.254947 22017 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:41.255831 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.257594 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:41.258114 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55049.5us
I20260709 13:07:41.259442 22018 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:41.259477 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.260283 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.260718 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.261027 22021 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:41.261811 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.261909 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.259807 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:41.264178 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.264814 22015 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.264802 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.271715 26094 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.248332 26336 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:41.272423 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.277907 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.273365 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:41.287590 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.287314 22024 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:41.287839 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.275329 22015 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:41.273911 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.290342 22023 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.221016 26339 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:07:41.285712 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.272902 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.293184 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:41.256340 26314 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:41.292303 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2245) took 1233 ms. Trace:
W20260709 13:07:41.272358 26263 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.003s
I20260709 13:07:41.294068 22016 raft_consensus.cc:2376] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12. Re-sending same reply.
I20260709 13:07:41.295966 22015 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:41.295512 21947 rpcz_store.cc:276] 0709 13:07:40.058578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.261597 (+203019us) service_pool.cc:224] Handling call
0709 13:07:40.541742 (+280145us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:07:40.542027 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.542557 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.542597 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.543195 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:07:40.758678 (+215483us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:40.758739 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.758835 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.275280 (+516445us) raft_consensus.cc:1685] finished
0709 13:07:41.275309 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.292236 (+ 16927us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4767,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"spinlock_wait_cycles":12629888,"thread_start_us":214960,"threads_started":1,"wal-append.queue_time_us":444678}
I20260709 13:07:41.300251 22021 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.295416 22018 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:41.293159 21987 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:41.303663 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.617s (SENT) [suppressed 32 similar messages]
I20260709 13:07:41.309895 22016 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:07:41.310423 22016 pending_rounds.cc:85] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 7
I20260709 13:07:41.310720 22016 pending_rounds.cc:107] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:07:41.311030 22016 raft_consensus.cc:2889] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:41.273152 26107 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.292829 26318 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:41.305963 26322 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.301s	user 0.002s	sys 0.003s
I20260709 13:07:41.309099 26208 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.335638 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2251) took 1253 ms. Trace:
I20260709 13:07:41.272291 26037 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:41.326201 22576 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.531s (SENT)
I20260709 13:07:41.313278 26337 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:07:41.341864 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.351312 22023 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:41.336241 21944 rpcz_store.cc:276] 0709 13:07:40.082528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.281660 (+199132us) service_pool.cc:224] Handling call
0709 13:07:40.281953 (+   293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:40.297817 (+ 15864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.297869 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:40.299071 (+  1202us) log.cc:844] Serialized 52 byte log entry
0709 13:07:40.614336 (+315265us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b18001982e0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:07:40.811707 (+197371us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:40.811756 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.811822 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.320051 (+508229us) raft_consensus.cc:1685] finished
0709 13:07:41.320080 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.335543 (+ 15463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10210,"raft.queue_time_us":24280,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":23407,"spinlock_wait_cycles":19070720,"thread_start_us":197115,"threads_started":1,"wal-append.queue_time_us":694413}
I20260709 13:07:41.326711 26318 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:41.365760 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 160080us
I20260709 13:07:41.366997 21914 leader_election.cc:400] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9.
I20260709 13:07:41.367372 21914 leader_election.cc:403] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:41.342551 26208 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:41.402875 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.368263 26318 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.406612 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:41.380893 26208 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:41.436218 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 132583us
I20260709 13:07:41.440186 21944 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:41.442768 21950 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:07:41.449115 21841 leader_election.cc:336] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.648s (SENT)
I20260709 13:07:41.451278 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:41.443642 26315 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:41.391316 26030 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.396862 26302 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 8. Current term is 9.
W20260709 13:07:41.452967 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.454569 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48073.1us
I20260709 13:07:41.518066 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:41.518996 21942 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:41.520114 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:41.537268 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 299388us
W20260709 13:07:41.561333 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.581666 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:41.583209 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:41.588871 22576 leader_election.cc:336] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.795s (SENT)
I20260709 13:07:41.589509 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:41.527899 21948 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:41.525463 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:41.603861 26343 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:41.605728 26343 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:41.607296 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:41.607043 26343 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.454170 26263 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:41.617583 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 92243.4us
I20260709 13:07:41.623729 21914 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:41.367491 26314 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:41.464579 26315 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:41.601034 26296 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.002s
W20260709 13:07:41.630155 21841 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.803s (SENT)
I20260709 13:07:41.630787 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:41.518736 26353 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:41.611763 26084 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.646139 26333 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.646942 26333 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:41.649223 26362 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.649894 26362 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:41.650385 26362 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.652371 26333 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:41.520412 26030 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:41.580017 26198 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 13:07:41.664116 22576 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.871s (SENT)
W20260709 13:07:41.641062 25757 consensus_meta.cc:287] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.006s
I20260709 13:07:41.632153 26342 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:41.635258 26302 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:41.637734 26263 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:41.683215 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.704180 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 96985.4us
I20260709 13:07:41.705932 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:41.709131 21988 leader_election.cc:400] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14.
I20260709 13:07:41.710741 21988 leader_election.cc:403] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:41.711637 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:41.715708 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:41.716468 22022 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:41.716929 21988 leader_election.cc:400] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13.
I20260709 13:07:41.634424 26296 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:41.671707 26337 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.672463 26314 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:41.705262 26036 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.961s	user 0.014s	sys 0.000s
I20260709 13:07:41.676342 26353 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:41.706563 26354 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:07:41.676800 26302 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:41.734771 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.742241 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.723198 26263 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.723500 26037 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:41.745087 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 113973us
I20260709 13:07:41.755841 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.741417 26302 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.738250 26353 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:41.755980 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 96199.2us
I20260709 13:07:41.713656 26315 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:41.782912 26153 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:41.788475 22023 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:41.737382 26036 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:41.758508 26358 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:41.766702 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.746915 26336 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.770794 26342 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:41.772832 26356 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:41.775449 26196 consensus_meta.cc:287] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.001s
I20260709 13:07:41.792927 21950 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:07:41.767189 26363 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.799806 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:41.816552 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 150061us
I20260709 13:07:41.751024 26263 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:41.820488 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 196875us
I20260709 13:07:41.821580 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:41.759492 26337 raft_consensus.cc:2764] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:41.835767 26208 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:41.837966 26318 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:41.841765 26350 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:41.846669 26315 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:41.851428 26282 consensus_meta.cc:287] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.587s	user 0.004s	sys 0.005s
I20260709 13:07:41.852816 26292 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.857976 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.861214 26030 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:41.864210 21943 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:41.872308 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.762218 26353 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.880435 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:41.940917 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:41.948227 22602 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:41.948477 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68159.8us
I20260709 13:07:41.949177 22023 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 11. Ops: []
W20260709 13:07:41.951784 21838 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.045s (SENT)
I20260709 13:07:41.954766 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:41.941578 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.862200 26359 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 13:07:41.940917 21841 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.115s (SENT)
W20260709 13:07:41.944660 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.958539 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:41.877344 26037 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.959169 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.959709 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:41.962745 22016 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:41.864269 26153 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:07:41.967135 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:41.967674 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2852) took 1625 ms. Trace:
I20260709 13:07:41.972110 22019 rpcz_store.cc:276] 0709 13:07:40.342084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.342291 (+   207us) service_pool.cc:224] Handling call
0709 13:07:40.342659 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.743217 (+400558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.743280 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:40.754303 (+ 11023us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.056565 (+302262us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:41.056620 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.056699 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.830955 (+774256us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b240020d848. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352e0b9c4 00007f6352e09acb 00007f6352fc4dc9 00007f6352fc4a55 00007f6352fc3fb0 00007f6355c3a488 00007f6355c3abe8 00007f6355c12398 00007f6355c0d76a 00007f6355c0cbb6
0709 13:07:41.963070 (+132115us) raft_consensus.cc:1685] finished
0709 13:07:41.963089 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.967610 (+  4521us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57933,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"spinlock_wait_cycles":3879808,"thread_start_us":667296,"threads_started":2,"wal-append.queue_time_us":356470}
I20260709 13:07:41.940665 26270 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.946928 26036 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:41.945749 26333 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.862962 26196 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:41.943631 26334 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:07:41.988253 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:41.997877 22603 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.996495 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:41.999151 22604 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 9: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:07:41.969435 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 198250us
I20260709 13:07:41.977917 21943 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:41.982265 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:41.986315 26355 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:07:41.971041 26094 consensus_meta.cc:287] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.000s
I20260709 13:07:41.962638 26198 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:42.000702 26198 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:41.995702 22019 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:42.000738 26025 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.975786 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:42.007570 22605 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:41.954861 26292 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:41.946305 26282 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.001279 26198 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.018278 21950 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:42.031545 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.969215 26037 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.038647 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:42.045259 21944 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:42.034574 26257 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.003s
I20260709 13:07:41.993551 26270 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.020809 26296 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:41.996574 26333 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:42.122267 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.156581 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:42.160043 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 219153us
I20260709 13:07:42.152814 26257 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:42.162106 26318 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:42.162926 26037 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.016258 26025 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.172410 22602 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
W20260709 13:07:42.174119 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.173511 26380 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:07:42.176750 26263 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.180962 26363 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:42.258872 26373 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
W20260709 13:07:42.199216 26382 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:07:42.205307 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:42.260663 26333 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.261018 22607 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:42.261206 26107 consensus_meta.cc:287] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.931s	user 0.013s	sys 0.000s
I20260709 13:07:42.261346 26333 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:42.263454 26362 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.612s	user 0.015s	sys 0.000s
I20260709 13:07:42.263752 26353 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.059581 25757 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:07:42.054975 26339 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.121s
I20260709 13:07:42.232514 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:42.181412 26037 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.173903 26296 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:42.164470 26141 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:07:42.239423 22603 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:42.257290 26370 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
I20260709 13:07:42.257388 26263 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.231912 26204 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.235152 26360 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.258363 26196 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.265563 22017 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.266475 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:42.264339 26362 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.269682 22607 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:42.233680 26301 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.234206 26372 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.287318 26357 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.265120 26202 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.306329 26367 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.333s	user 0.000s	sys 0.003s
W20260709 13:07:42.307065 26386 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.120s	user 0.000s	sys 0.002s
I20260709 13:07:42.289994 26369 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:42.325188 26371 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.351s	user 0.000s	sys 0.002s
I20260709 13:07:42.320333 26208 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:42.334419 26292 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:42.306303 26360 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.291520 26296 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.347781 26362 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:42.349300 26358 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.005s
I20260709 13:07:42.349735 26360 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:42.350011 26358 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14.
W20260709 13:07:42.351066 26343 consensus_meta.cc:287] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.001s
I20260709 13:07:42.351492 26343 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.353376 26343 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.355087 26353 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.320358 26372 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.358150 26372 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.330696 26369 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.390358 21943 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:42.391103 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.196348 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.265116 21914 connection.cc:256] RPC call timeout handler was delayed by -2.6467762799999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 13:07:42.395051 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 443164us
W20260709 13:07:42.396000 21914 connection.cc:256] RPC call timeout handler was delayed by -2.1931762799998751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26920000000000005s for a response
W20260709 13:07:42.397413 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.398219 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:42.399624 21950 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.403831 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 612) took 1235 ms. Trace:
I20260709 13:07:42.291864 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:42.405272 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:42.406010 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.408077 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:42.425041 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.425626 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:42.426735 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.427136 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:42.258725 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:42.269227 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:42.439635 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.440802 22020 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:42.441015 21867 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 6.
I20260709 13:07:42.442381 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:42.439690 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:42.443753 22016 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:42.417544 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.445168 22601 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
W20260709 13:07:42.417582 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.420956 21942 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.396138 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:42.447875 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.449278 21867 raft_consensus.cc:2393] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 9: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:42.449167 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:42.422294 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:42.427166 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.450671 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:42.450969 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.451557 21871 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:42.452143 21874 raft_consensus.cc:2368] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12.
I20260709 13:07:42.411334 22018 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:42.428325 21947 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:42.444192 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:42.454161 22020 raft_consensus.cc:2410] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:42.430334 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:42.432335 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.433441 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.457594 22603 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:42.434738 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.458943 22602 raft_consensus.cc:2368] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12.
W20260709 13:07:42.459969 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 59415.6us
I20260709 13:07:42.293689 26037 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.461236 21839 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:42.445703 22016 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.454123 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:42.404379 21941 rpcz_store.cc:276] 0709 13:07:41.168328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.168491 (+   163us) service_pool.cc:224] Handling call
0709 13:07:41.170227 (+  1736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.170431 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.170455 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.879613 (+709158us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b2c00010da8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:07:41.956052 (+ 76439us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.098005 (+141953us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:42.098059 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.098151 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.403120 (+304969us) raft_consensus.cc:1685] finished
0709 13:07:42.403161 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.403595 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635136,"thread_start_us":111023,"threads_started":1,"wal-append.queue_time_us":377138}
I20260709 13:07:42.462728 26107 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:42.465122 26263 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.465384 26107 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.465922 26037 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.466285 26333 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:42.467417 26296 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.467895 26037 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:42.467054 26333 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.469112 26196 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:07:42.468506 26107 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:42.480967 26315 consensus_meta.cc:287] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.001s
I20260709 13:07:42.306414 26204 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.327780 26202 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.465956 26263 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:42.514052 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 51133.7us
I20260709 13:07:42.614269 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:42.520730 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:42.585850 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.521817 22024 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:07:42.608481 21900 heartbeater.cc:646] Failed to heartbeat to 127.20.69.62:45563 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.69.62:45563 timed out after 15.000s (SENT)
I20260709 13:07:42.325870 26357 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.522177 22015 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:07:42.511540 26384 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.584735 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:42.647324 26357 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:42.648196 26302 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.871s	user 0.008s	sys 0.005s
W20260709 13:07:42.650314 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.650605 26353 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 13:07:42.651089 26315 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:42.651460 26362 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:07:42.651878 26315 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.652697 26270 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.654533 26315 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.661986 26333 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.662940 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.664022 21867 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:42.667173 21947 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:42.668642 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:42.669657 26282 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.652256 26362 consensus_queue.cc:1243] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:42.669706 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:42.675464 21950 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:42.590745 26372 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.685413 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.690510 21948 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:42.672387 26362 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.567677 26037 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:42.686146 22602 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:42.689158 26196 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:42.703514 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 207047us
I20260709 13:07:42.703733 22016 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:42.694911 26362 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.690486 26384 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:42.713636 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.714359 26369 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.714849 21875 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:42.715241 21867 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:42.717188 26282 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.717595 26263 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.717769 26282 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:42.719229 26282 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.721144 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:42.708103 26362 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:42.731166 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.733971 26384 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.689239 26302 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.745709 26372 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:42.747093 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.748368 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.763427 21949 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:42.712342 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:42.765117 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:42.769973 21838 leader_election.cc:336] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.213s (SENT)
I20260709 13:07:42.781155 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.760401 26204 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.787052 21871 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:42.764519 26282 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.782186 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:42.782964 26302 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:42.797566 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.812348 26134 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:42.809423 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 112043us
I20260709 13:07:42.759016 26037 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:42.837546 22603 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
W20260709 13:07:42.843842 26301 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.008s
I20260709 13:07:42.822467 26134 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:42.857198 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 87304.7us
I20260709 13:07:42.860728 21872 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:42.860842 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:42.861894 21871 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:42.862432 21872 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.862182 21946 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:42.863719 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:42.864017 21872 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:42.868634 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.868952 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.870275 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.871753 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.872763 22607 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:07:42.876259 26405 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.864516 21866 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.906073 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.908077 21872 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:42.909971 21872 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:42.910301 26196 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.917271 26183 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.918784 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:42.925062 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:42.929881 26358 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.930583 26358 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:42.935851 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68136.2us
I20260709 13:07:42.931289 26183 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.901280 26134 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:42.938421 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:42.939795 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.952893 21873 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:42.961369 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:42.964902 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:42.972121 21950 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:42.988788 26420 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:42.993108 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:42.994164 21950 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:42.995275 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:42.997117 26358 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.986909 26025 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:42.999504 21866 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:42.995965 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:42.998037 26037 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:43.023695 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.013239 26037 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:43.018514 26198 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.955s	user 0.006s	sys 0.011s
W20260709 13:07:43.036902 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.037691 26037 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.038617 21987 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:43.039225 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.040098 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.040892 26315 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:43.041558 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2268) took 1597 ms. Trace:
I20260709 13:07:43.041925 21946 rpcz_store.cc:276] 0709 13:07:41.444000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.444132 (+   132us) service_pool.cc:224] Handling call
0709 13:07:43.041352 (+1597220us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400298954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:43.041490 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3046258944}
I20260709 13:07:43.043342 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.044126 21946 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:07:43.048038 26401 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:07:43.036916 26198 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.052742 21947 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:43.053488 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.054289 21946 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:43.055155 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.055724 21946 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:43.056488 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.057264 21946 raft_consensus.cc:2410] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:43.058041 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.059196 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:43.051690 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.075651 26344 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:43.076169 26344 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:43.077471 26344 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.078660 26344 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:43.082161 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.086681 26376 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:43.087359 26376 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:43.089641 26183 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:43.090298 26198 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:43.026628 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:43.028656 26409 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:07:43.029984 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 547) took 1148 ms. Trace:
I20260709 13:07:43.032232 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.033885 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2273) took 1020 ms. Trace:
I20260709 13:07:43.035006 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 546) took 1226 ms. Trace:
I20260709 13:07:43.036384 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2272) took 1176 ms. Trace:
W20260709 13:07:43.072228 22576 connection.cc:256] RPC call timeout handler was delayed by -1.1100710570000274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:07:43.105705 22576 connection.cc:256] RPC call timeout handler was delayed by -1.0894575240000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
W20260709 13:07:43.092803 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 135515us
I20260709 13:07:43.109947 26292 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:43.109786 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 69391.1us
I20260709 13:07:43.113402 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:43.104435 22024 rpcz_store.cc:276] 0709 13:07:41.881912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.884059 (+  2147us) service_pool.cc:224] Handling call
0709 13:07:43.029719 (+1145660us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54000dded4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:43.029897 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041068928}
I20260709 13:07:43.104784 22023 rpcz_store.cc:276] 0709 13:07:41.808454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.808842 (+   388us) service_pool.cc:224] Handling call
0709 13:07:41.877852 (+ 69010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.949571 (+ 71719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.034540 (+1084969us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b5400417dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:43.034821 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163568384}
I20260709 13:07:43.105093 21944 rpcz_store.cc:276] 0709 13:07:41.860100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.860325 (+   225us) service_pool.cc:224] Handling call
0709 13:07:41.860699 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.045761 (+185062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.035958 (+990197us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400377654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:43.036207 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423997696}
I20260709 13:07:43.123344 21945 raft_consensus.cc:2393] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:43.124513 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.125898 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.126766 21945 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:43.127647 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.128901 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.123409 21950 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:43.131971 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:43.132700 21950 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.104739 21943 rpcz_store.cc:276] 0709 13:07:42.013570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.013713 (+   143us) service_pool.cc:224] Handling call
0709 13:07:42.014000 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.391623 (+377623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.033566 (+641943us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b540019c154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:43.033822 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863780736}
I20260709 13:07:43.130299 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.139973 22023 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:43.141392 22016 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:43.141763 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.142325 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.142952 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.143118 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.143471 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.143853 22018 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:43.145071 22020 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:43.145432 21950 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:43.146124 22021 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:43.146332 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.147158 21950 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:43.146466 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.148095 21944 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:43.148293 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.149055 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.149461 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.149633 21944 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:43.150218 21950 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:43.150492 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.143590 21945 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:43.141382 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.152397 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.153530 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.154639 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.155591 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.156101 21945 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 7.
I20260709 13:07:43.142366 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.157006 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.120226 26376 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.157562 21945 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:43.158015 26376 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.158437 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.159189 21945 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:43.159920 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.151005 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.157727 26362 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.161298 22573 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:43.164536 26362 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:43.166159 21950 raft_consensus.cc:2393] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:43.166311 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.166795 26362 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:43.166700 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 53425.7us
I20260709 13:07:43.167699 26362 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:43.166817 26291 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.169045 26362 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.169828 22574 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:43.169725 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2274) took 1153 ms. Trace:
I20260709 13:07:43.169757 26291 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:43.157405 21944 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:43.167588 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.161043 26037 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.170794 21949 rpcz_store.cc:276] 0709 13:07:42.016246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.017357 (+  1111us) service_pool.cc:224] Handling call
0709 13:07:42.017656 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.764042 (+746386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.169445 (+405403us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540019c654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:43.169663 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676259584}
I20260709 13:07:43.160506 21945 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:43.145706 21874 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:43.178462 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.191690 21946 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:43.182534 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.192865 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.195401 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.195863 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.195446 21950 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:43.199415 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.200541 21948 raft_consensus.cc:2393] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:43.203621 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.204572 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.207050 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.208190 22023 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:43.198873 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:43.209345 21949 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.211516 21944 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:43.194205 26315 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:43.212381 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.214288 21946 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:43.212644 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:43.216181 21950 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:07:43.210695 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 73910.9us
I20260709 13:07:43.213095 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.218559 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.222018 26291 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.195469 26107 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:07:43.215510 26025 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:43.227005 26025 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.229503 26025 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:43.231213 21947 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:43.226320 26411 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.389s	user 0.000s	sys 0.002s
I20260709 13:07:43.232918 21950 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:43.231230 21944 pending_rounds.cc:85] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 3
I20260709 13:07:43.235917 21949 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:43.239096 21949 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:43.246302 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.237679 21944 pending_rounds.cc:107] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:43.249155 21944 raft_consensus.cc:2889] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:43.250198 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.251720 21947 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.264218 21949 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.265090 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:43.267334 26290 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:43.267836 26290 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.268435 26290 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.267396 26428 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:43.255872 26025 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.273310 26428 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:43.273901 26428 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:43.274641 26196 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:43.273402 21874 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:43.277879 26153 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:07:43.280264 21947 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:43.281402 26383 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.016s	user 0.001s	sys 0.000s
I20260709 13:07:43.277362 26304 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:43.284157 26304 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:43.285259 26304 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.286561 26315 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.273228 26025 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.289436 26025 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:43.290788 22605 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:43.267881 26037 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:43.289849 21948 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:07:43.293426 21838 leader_election.cc:336] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.536s (SENT)
I20260709 13:07:43.294548 26282 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:07:43.295222 26413 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.283s	user 0.000s	sys 0.004s
I20260709 13:07:43.295511 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:43.287111 26304 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.300841 21945 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:43.316560 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.319795 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.321849 21946 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:43.327834 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:43.303917 26282 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:43.334669 21946 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:43.337378 22576 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.215s (SENT)
I20260709 13:07:43.338018 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:43.340723 26426 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.279619 26428 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.342105 26428 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.344691 22605 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:43.345881 26426 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:43.347517 26153 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:43.328405 22607 raft_consensus.cc:2376] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11. Re-sending same reply.
W20260709 13:07:43.349503 22576 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.737s (SENT)
I20260709 13:07:43.352113 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.351136 21949 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:43.352886 22024 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:43.353657 22607 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:43.353720 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.354463 22016 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:43.352030 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:43.352946 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.368857 26344 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:43.372102 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.375662 21947 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:43.377540 26153 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:43.378530 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.377904 22024 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:43.383531 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:43.384696 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:43.386031 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:43.387426 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:43.387768 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2860) took 1600 ms. Trace:
I20260709 13:07:43.388177 22017 rpcz_store.cc:276] 0709 13:07:41.787198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.792866 (+  5668us) service_pool.cc:224] Handling call
0709 13:07:41.793153 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.415596 (+622443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.387407 (+971811us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540017c0d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:43.387598 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085968128}
I20260709 13:07:43.388938 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:43.389542 22603 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.395426 21950 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:43.401378 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.401659 26198 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.333630 26282 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.352746 26358 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:43.405143 26282 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.428206 26304 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:07:43.442370 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.445485 22603 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:07:43.380328 26425 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:07:43.331671 26301 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:07:43.452216 21838 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:43.452064 21839 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:43.468930 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.465543 26384 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:43.440979 26198 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:43.515870 22022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1625) took 2273 ms (client timeout 1648 ms). Trace:
I20260709 13:07:43.516779 26270 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:43.518695 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:43.518886 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:43.453579 26358 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:43.521255 22022 rpcz_store.cc:269] 0709 13:07:41.227139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.228681 (+  1542us) service_pool.cc:224] Handling call
0709 13:07:43.466904 (+2238223us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54000dedd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:43.501001 (+ 34097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030747008}
I20260709 13:07:43.543138 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:43.524902 26270 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.520015 26291 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:43.549005 22605 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:43.523571 26384 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:43.547454 26304 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.502794 26204 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:43.550650 26270 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.568460 26358 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:43.569054 26198 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:43.570722 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.570762 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 615) took 1779 ms. Trace:
I20260709 13:07:43.572080 26304 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:43.572108 21942 rpcz_store.cc:276] 0709 13:07:41.791157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.791308 (+   151us) service_pool.cc:224] Handling call
0709 13:07:41.829518 (+ 38210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:42.447451 (+617933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.570548 (+1123097us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54000fd554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:43.570714 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316494080}
I20260709 13:07:43.574035 26290 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.561189 22603 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:43.574508 26426 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:43.583679 26290 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:43.583518 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:43.565862 26291 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:43.600533 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:43.604146 21942 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.582718 26426 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:07:43.607187 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 107515us
I20260709 13:07:43.607718 26333 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.609162 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:43.612407 26333 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.614710 26333 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:43.615156 21947 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:43.614754 26304 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.615876 26333 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.611470 26315 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.627288 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70198.6us
I20260709 13:07:43.632633 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.633464 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.633893 22020 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.610527 26420 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:07:43.638129 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.640187 26451 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:43.641429 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.646451 26426 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.647862 26426 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.648939 26291 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.650126 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.650856 22024 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:43.649420 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.654285 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.662133 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.663564 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.668853 26356 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.669616 26356 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.671109 22024 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 7.
I20260709 13:07:43.668758 21942 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:43.672647 22573 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:43.675531 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.672308 22024 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.675027 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:43.678191 22020 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:43.683198 21950 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:43.683770 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:43.690323 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:43.635812 26315 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.702260 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:43.631479 26384 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.672025 26356 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:43.708051 22015 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:07:43.710307 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100522us
I20260709 13:07:43.706868 21838 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:43.712276 26037 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:43.712822 26315 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:43.712821 26037 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.713764 26037 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.710307 26290 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:43.717234 26290 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:43.717638 26290 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.705564 26451 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.715794 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 329575us
I20260709 13:07:43.722122 22018 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:43.723181 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:43.724273 22018 raft_consensus.cc:2410] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:43.720963 26457 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:43.734956 22024 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:43.737720 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.750494 21841 leader_election.cc:336] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.120s (SENT)
I20260709 13:07:43.761330 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:43.772293 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 65527.7us
I20260709 13:07:43.763974 22024 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:43.774660 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:43.701226 26282 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.721110 26451 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:43.775593 21949 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.912827 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:44.134260 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:43.946377 26461 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:07:43.967880 26414 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.941s	user 0.005s	sys 0.001s
W20260709 13:07:43.817690 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.576961 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:44.149857 26202 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:43.960203 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.965728 26270 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:43.749179 26457 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:07:43.853978 26462 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:07:43.856987 26454 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 13:07:44.256172 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.133306 26464 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:07:43.858182 26458 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:07:44.236699 26384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.007s
W20260709 13:07:44.262006 26384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.003s	sys 0.007s
I20260709 13:07:43.802704 26333 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:44.262571 26333 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.263002 26333 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.244555 26301 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:43.946508 26313 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:43.963704 26037 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:44.270275 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 537048us
I20260709 13:07:44.236402 26282 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:44.276702 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 129735us
I20260709 13:07:44.255581 26405 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:44.281646 26362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.022s	sys 0.028s
I20260709 13:07:44.274523 26313 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:44.292522 26362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.022s	sys 0.028s
I20260709 13:07:44.303957 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:44.308766 26319 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.314760 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 687832us
I20260709 13:07:44.284874 26384 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.327744 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:44.329154 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:44.331622 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:44.333474 26451 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:44.276271 26301 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.328461 22601 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:07:44.404709 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 270838us
I20260709 13:07:44.405167 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:44.408541 22017 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.409518 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2059) took 1660 ms. Trace:
I20260709 13:07:44.411770 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:44.412485 21941 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:44.414065 21867 rpcz_store.cc:276] 0709 13:07:42.749334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.749642 (+   308us) service_pool.cc:224] Handling call
0709 13:07:42.750030 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:42.750589 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.750622 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:42.751272 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 13:07:42.792147 (+ 40875us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:42.793105 (+   958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.793739 (+   634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:43.967307 (+1173568us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b24001956c8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352e0b9c4 00007f6352e09acb 00007f6352fc4dc9 00007f6352fc4a55 00007f6352fc409d 00007f6355bf610e 00007f6355c0d88c 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221
0709 13:07:44.403074 (+435767us) raft_consensus.cc:1685] finished
0709 13:07:44.403102 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.409438 (+  6336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1292,"raft.queue_time_us":414,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":300660608,"thread_start_us":39715,"threads_started":1,"wal-append.queue_time_us":215959}
I20260709 13:07:44.423985 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:44.424715 26451 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.412817 26457 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:44.425370 26451 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:44.428725 21946 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:44.431137 26420 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:44.431787 26420 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:44.433276 26270 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:44.433777 26025 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.434087 26420 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:44.434489 26025 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.435125 26471 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:44.438511 26451 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:44.439124 26452 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:44.439687 26452 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:44.443465 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2064) took 1345 ms. Trace:
I20260709 13:07:44.444077 21869 rpcz_store.cc:276] 0709 13:07:43.048054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.048173 (+   119us) service_pool.cc:224] Handling call
0709 13:07:43.048562 (+   389us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:43.049181 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.049224 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:43.050057 (+   833us) log.cc:844] Serialized 78 byte log entry
0709 13:07:43.177161 (+127104us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:43.203186 (+ 26025us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.210579 (+  7393us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.210812 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.210880 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.262136 (+1051256us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800045700. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f532a6 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1
0709 13:07:44.262721 (+   585us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b1800045700. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:44.393409 (+130688us) raft_consensus.cc:1685] finished
0709 13:07:44.393430 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.393579 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30165,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":3395,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":8492,"spinlock_wait_cycles":55904256,"thread_start_us":126699,"threads_started":1,"wal-append.queue_time_us":161825}
I20260709 13:07:44.446076 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2878) took 1077 ms. Trace:
I20260709 13:07:44.447983 22017 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:44.392814 26282 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.446565 22023 rpcz_store.cc:276] 0709 13:07:43.368526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.369782 (+  1256us) service_pool.cc:224] Handling call
0709 13:07:43.370200 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.557684 (+187484us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:43.590599 (+ 32915us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.629764 (+ 39165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:43.629825 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:43.629859 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.444837 (+814978us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b18000cbf20. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f532a6 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419
0709 13:07:44.445833 (+   996us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400333454. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:44.445879 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.446015 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1777,"prepare.queue_time_us":29842,"prepare.run_wall_time_us":5856,"raft.queue_time_us":75,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3955,"spinlock_wait_cycles":439235456,"thread_start_us":38762,"threads_started":1,"wal-append.queue_time_us":89260}
W20260709 13:07:44.451962 21841 leader_election.cc:336] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.170s (SENT)
I20260709 13:07:44.452646 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:44.447831 26037 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:44.459323 26290 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.741s	user 0.021s	sys 0.000s
I20260709 13:07:44.400816 26319 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.457891 26282 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:44.515564 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:44.516407 21869 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.519627 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.496872 26270 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.530743 21875 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:44.514096 26025 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:44.490903 26290 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:44.539340 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 696998us
I20260709 13:07:44.536180 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.479063 26452 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:44.545794 26282 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:44.573100 22576 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.505s (SENT)
I20260709 13:07:44.578243 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:44.562234 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.526671 26196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.047s	sys 0.058s
W20260709 13:07:44.583009 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 169161us
W20260709 13:07:44.580168 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.558486 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 141162us
W20260709 13:07:44.586592 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.587204 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.587579 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.573891 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:44.588555 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:44.581923 26196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.047s	sys 0.059s
I20260709 13:07:44.479719 26313 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.594437 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:44.597249 21949 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:44.599627 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:44.599969 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58692.9us
I20260709 13:07:44.605325 21872 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:07:44.606678 21871 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:44.607496 21950 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:44.548475 26290 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:44.569602 26319 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:44.602728 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:44.610667 21942 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:44.611611 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:44.613832 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:44.617357 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:44.615068 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:44.605792 21872 pending_rounds.cc:85] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 4
I20260709 13:07:44.618233 21872 pending_rounds.cc:107] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:07:44.618572 21872 raft_consensus.cc:2889] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.620687 21943 raft_consensus.cc:2410] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:44.622536 21945 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:44.622922 21949 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:44.625782 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:44.627096 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54030.9us
I20260709 13:07:44.624439 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:44.634008 21869 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:44.639715 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:44.640780 21871 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:44.610896 26425 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.621547 26313 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.623239 26405 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.603883 26402 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:44.627568 26291 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:44.634354 26304 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:44.668901 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.669600 21870 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:44.670610 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:44.670433 26292 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:44.671326 21870 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.668954 26304 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.675654 26304 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:44.680554 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.683929 26469 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.531s	user 0.002s	sys 0.000s
W20260709 13:07:44.686498 26477 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.532s	user 0.002s	sys 0.000s
I20260709 13:07:44.658437 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:44.666354 26357 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:44.701107 26357 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:44.651590 26405 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.701790 26405 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.702152 26357 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.705143 21875 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:44.635874 26301 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:44.645531 26452 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:44.728951 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.733896 21950 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:44.735895 21872 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:44.739444 21871 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:44.657980 26291 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.772058 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.749176 26291 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.785578 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:44.787997 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 166051us
I20260709 13:07:44.777529 26486 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:44.791139 26196 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:44.798802 26443 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:07:44.799074 26196 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.802026 26196 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:44.795771 26315 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:44.807674 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 573) took 1178 ms. Trace:
W20260709 13:07:44.813433 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.815433 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:44.813339 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 198394us
I20260709 13:07:44.817410 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 574) took 1187 ms. Trace:
I20260709 13:07:44.818456 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2885) took 1142 ms. Trace:
W20260709 13:07:44.818764 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.819389 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.820019 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.819057 22024 rpcz_store.cc:276] 0709 13:07:43.676234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.245052 (+568818us) service_pool.cc:224] Handling call
0709 13:07:44.265937 (+ 20885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.266246 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:44.581852 (+315606us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.817995 (+236143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.818071 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:44.818144 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.818234 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.818385 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253464,"prepare.queue_time_us":57988,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3253,"thread_start_us":293340,"threads_started":1}
I20260709 13:07:44.822839 21872 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:44.824138 22017 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:44.817859 22020 rpcz_store.cc:276] 0709 13:07:43.630034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.688871 (+ 58837us) service_pool.cc:224] Handling call
0709 13:07:43.721719 (+ 32848us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.923471 (+201752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.923516 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:44.145909 (+222393us) log.cc:844] Serialized 52 byte log entry
0709 13:07:44.485761 (+339852us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:44.485824 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.485912 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.817189 (+331277us) raft_consensus.cc:1685] finished
0709 13:07:44.817212 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.817349 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61739,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":110,"thread_start_us":339190,"threads_started":1,"wal-append.queue_time_us":452884}
I20260709 13:07:44.825568 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 624) took 1571 ms. Trace:
I20260709 13:07:44.809547 22022 rpcz_store.cc:276] 0709 13:07:43.629318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.687236 (+ 57918us) service_pool.cc:224] Handling call
0709 13:07:43.701526 (+ 14290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.732710 (+ 31184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.732754 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:43.802902 (+ 70148us) log.cc:844] Serialized 52 byte log entry
0709 13:07:44.259099 (+456197us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:44.286228 (+ 27129us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.292329 (+  6101us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.566869 (+274540us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:44.807009 (+240140us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b18002b13e0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:07:44.807260 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.807339 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.807382 (+    43us) raft_consensus.cc:1685] finished
0709 13:07:44.807398 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.807591 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5658,"prepare.queue_time_us":171023,"prepare.run_cpu_time_us":169,"prepare.run_wall_time_us":359,"raft.queue_time_us":38533,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":28713,"spinlock_wait_cycles":121912960,"thread_start_us":335931,"threads_started":1,"wal-append.queue_time_us":612024}
I20260709 13:07:44.828135 21948 rpcz_store.cc:276] 0709 13:07:43.254354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.333483 (+ 79129us) service_pool.cc:224] Handling call
0709 13:07:43.394745 (+ 61262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.405350 (+ 10605us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:43.458443 (+ 53093us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.563228 (+1104785us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18000cb380. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c1223a 00007f635607ca2a
0709 13:07:44.825104 (+261876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.825179 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:44.825254 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.825351 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.825496 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6722,"prepare.queue_time_us":62540,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":6943,"spinlock_wait_cycles":6380928,"thread_start_us":254690,"threads_started":1}
I20260709 13:07:44.832908 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:44.834889 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:44.837522 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:44.838343 21872 raft_consensus.cc:2368] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11.
I20260709 13:07:44.838932 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:44.812942 26356 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.839923 21866 raft_consensus.cc:2368] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13.
I20260709 13:07:44.840444 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:44.798398 26486 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.827744 26344 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:44.850090 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:44.856199 21872 raft_consensus.cc:2368] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
W20260709 13:07:44.840975 26333 consensus_meta.cc:287] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.001s
I20260709 13:07:44.860399 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:44.869011 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:44.870880 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:44.880683 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 280040us
I20260709 13:07:44.847002 26425 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:44.899310 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.884829 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:44.885638 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.900703 21866 raft_consensus.cc:2368] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:07:44.887530 21872 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:44.855520 26292 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:44.908869 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.905253 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:44.911378 21950 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:07:44.917336 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 505631us
I20260709 13:07:44.918054 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.918689 21866 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:44.898018 26425 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:44.929087 21872 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:44.921873 26292 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:44.865935 26344 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:44.932467 21988 leader_election.cc:400] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12.
I20260709 13:07:44.935801 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.941802 21988 leader_election.cc:403] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:44.942029 21866 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:44.943077 26429 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.925457 26457 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:07:44.943936 26429 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:44.944694 26479 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.946297 26429 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:44.946820 26410 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.988s	user 0.005s	sys 0.000s
W20260709 13:07:44.943281 26484 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 13:07:44.956063 26483 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:07:44.958778 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:44.959434 21873 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.922991 26485 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:44.943166 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.885023 26333 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:44.936077 26425 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:44.987970 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:44.989295 21866 raft_consensus.cc:2410] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:07:44.991151 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 182034us
W20260709 13:07:44.992835 22576 leader_election.cc:336] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.812s (SENT)
I20260709 13:07:44.994128 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:45.007560 26448 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.375s	user 0.001s	sys 0.004s
I20260709 13:07:44.970008 26485 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.009004 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2882) took 1627 ms. Trace:
I20260709 13:07:45.015096 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:45.011814 22021 rpcz_store.cc:276] 0709 13:07:43.381909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.382255 (+   346us) service_pool.cc:224] Handling call
0709 13:07:43.387406 (+  5151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.387846 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.387876 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.388350 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.526405 (+138055us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:43.526465 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.526557 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.568989 (+1042432us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b48001d01d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:07:45.006895 (+437906us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:45.008681 (+  1786us) raft_consensus.cc:1685] finished
0709 13:07:45.008715 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.008924 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246173,"raft.queue_time_us":1248,"raft.run_cpu_time_us":3494,"raft.run_wall_time_us":1180127,"spinlock_wait_cycles":22301312,"thread_start_us":136987,"threads_started":1,"wal-append.queue_time_us":194596}
I20260709 13:07:45.009032 26107 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.959429 26486 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:45.013818 26485 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:45.040388 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.041136 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.041568 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.047192 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:45.047860 21874 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.049131 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:45.050619 21868 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.056205 21874 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:45.057721 21874 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:45.060060 21874 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:07:45.073177 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.035681 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:45.083160 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:45.084589 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.086097 21867 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.024353 26405 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:45.091208 26497 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:07:45.038944 26107 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:45.104382 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 111600us
I20260709 13:07:45.105625 21872 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:45.106889 21875 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:45.107941 26498 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.109012 21870 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:45.110599 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:45.112638 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:45.108067 26453 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:45.124738 26456 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 1.313s	user 0.004s	sys 0.000s
I20260709 13:07:45.126211 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 672) took 1742 ms. Trace:
I20260709 13:07:45.126631 22602 rpcz_store.cc:276] 0709 13:07:43.384184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.386505 (+  2321us) service_pool.cc:224] Handling call
0709 13:07:43.386812 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.542359 (+155547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.542393 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.575795 (+ 33402us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.621241 (+ 45446us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:43.621283 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.621354 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.124084 (+1502730us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:45.125839 (+  1755us) raft_consensus.cc:1685] finished
0709 13:07:45.125860 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.126116 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21338,"raft.queue_time_us":197172,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4522,"spinlock_wait_cycles":15559936,"thread_start_us":153724,"threads_started":2,"wal-append.queue_time_us":117648}
I20260709 13:07:45.128988 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2879) took 1760 ms. Trace:
I20260709 13:07:45.129438 22016 rpcz_store.cc:276] 0709 13:07:43.368974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.370477 (+  1503us) service_pool.cc:224] Handling call
0709 13:07:43.370887 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.371365 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.371406 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.372040 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.639144 (+1267104us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18000cbec0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:07:44.788950 (+149806us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:44.788994 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.789135 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.128655 (+339520us) raft_consensus.cc:1685] finished
0709 13:07:45.128678 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.128924 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5167,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11672,"spinlock_wait_cycles":5075712,"thread_start_us":149574,"threads_started":1,"wal-append.queue_time_us":1527311}
I20260709 13:07:45.133867 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:45.076220 26292 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.113520 26486 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.136453 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:45.138103 21841 connection.cc:256] RPC call timeout handler was delayed by -2.7210749519998672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.268s for a response
I20260709 13:07:45.138927 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:45.141505 21841 connection.cc:256] RPC call timeout handler was delayed by -2.6281383939999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2425s for a response
W20260709 13:07:45.141918 21841 connection.cc:256] RPC call timeout handler was delayed by -2.5884302709998792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2755s for a response
I20260709 13:07:45.142098 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:45.142529 21841 connection.cc:256] RPC call timeout handler was delayed by -2.5612282549999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:07:45.142695 21875 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:07:45.142931 21841 connection.cc:256] RPC call timeout handler was delayed by -2.5494225899999492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3174s for a response
W20260709 13:07:45.143297 21841 connection.cc:256] RPC call timeout handler was delayed by -2.2483383939999158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2847s for a response
W20260709 13:07:45.143642 21841 connection.cc:256] RPC call timeout handler was delayed by -2.1531921129999319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2993s for a response
W20260709 13:07:45.144241 21841 connection.cc:256] RPC call timeout handler was delayed by -2.1009921129999611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30510000000000004s for a response
W20260709 13:07:45.144579 21841 connection.cc:256] RPC call timeout handler was delayed by -1.9787197979999291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3058s for a response
I20260709 13:07:45.143587 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:45.144954 21841 connection.cc:256] RPC call timeout handler was delayed by -1.959343964000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:07:45.153594 26503 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:45.145521 21875 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:45.159363 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:45.160298 21875 raft_consensus.cc:2410] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 11 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:45.162063 21868 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:07:45.145500 21841 connection.cc:256] RPC call timeout handler was delayed by -1.86232200500001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24750000000000003s for a response
W20260709 13:07:45.162933 21841 connection.cc:256] RPC call timeout handler was delayed by -1.8249687239998593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.38630000000000003s for a response
W20260709 13:07:45.163290 21841 connection.cc:256] RPC call timeout handler was delayed by -1.7855854140000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:07:45.163548 21841 connection.cc:256] RPC call timeout handler was delayed by -1.7333854139999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 13:07:45.163772 21841 connection.cc:256] RPC call timeout handler was delayed by -1.692959764999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 13:07:45.164016 21841 connection.cc:256] RPC call timeout handler was delayed by -1.6765655269999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4045s for a response
W20260709 13:07:45.164224 21841 connection.cc:256] RPC call timeout handler was delayed by -1.6676854139999477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:07:45.164427 21841 connection.cc:256] RPC call timeout handler was delayed by -1.4355153619999328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:07:45.164660 21841 connection.cc:256] RPC call timeout handler was delayed by -1.3995153619999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 13:07:45.164893 21841 connection.cc:256] RPC call timeout handler was delayed by -1.385115361999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:07:45.165112 21841 connection.cc:256] RPC call timeout handler was delayed by -1.3822855449999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4457s for a response
W20260709 13:07:45.165326 21841 connection.cc:256] RPC call timeout handler was delayed by -1.3374153620000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 13:07:45.165540 21841 connection.cc:256] RPC call timeout handler was delayed by -1.3248153619999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 13:07:45.165762 21841 connection.cc:256] RPC call timeout handler was delayed by -1.2770380119999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31320000000000003s for a response
W20260709 13:07:45.165992 21841 connection.cc:256] RPC call timeout handler was delayed by -1.2645153619999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:07:45.166210 21841 connection.cc:256] RPC call timeout handler was delayed by -1.1673153619999539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 13:07:45.166432 21841 connection.cc:256] RPC call timeout handler was delayed by -1.0656153619999031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
I20260709 13:07:45.169126 22602 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:45.177876 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 259828us
I20260709 13:07:45.178720 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:45.179072 26498 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:45.180116 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:45.180780 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 171222us
I20260709 13:07:45.181630 21987 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:45.181981 26313 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:07:45.183032 26505 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:45.183499 26134 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:45.183955 26134 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.184314 26134 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.184882 26208 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:45.185274 26208 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:45.186146 26208 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:45.187453 26208 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.188458 26084 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:45.178409 21875 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:07:45.189252 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.189137 26356 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:45.187237 26319 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:45.184474 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:45.190819 21875 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:45.180912 26376 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12.
I20260709 13:07:45.181483 26508 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:45.206844 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.207036 26319 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.207425 26319 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:45.208070 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:45.217298 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:45.248731 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.150554 26486 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:45.264117 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 56148.8us
I20260709 13:07:45.265091 26486 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:45.265542 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:45.266722 26183 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.267367 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 583) took 1559 ms. Trace:
I20260709 13:07:45.267597 26183 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:45.268290 26183 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:45.269383 26405 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:45.208441 26319 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:45.270207 26376 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:45.203617 26356 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:45.271051 26356 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:45.271924 26356 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:45.273222 26356 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.264137 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:45.275759 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.276084 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66338.2us
W20260709 13:07:45.276974 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.282500 22017 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:45.270627 26319 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.203454 26508 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:45.267783 22019 rpcz_store.cc:276] 0709 13:07:43.708312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.328313 (+620001us) service_pool.cc:224] Handling call
0709 13:07:44.328669 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.808646 (+479977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.808695 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.832486 (+ 23791us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.986878 (+154392us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:44.986936 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.987036 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.267043 (+280007us) raft_consensus.cc:1685] finished
0709 13:07:45.267064 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.267198 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479311,"raft.queue_time_us":482318,"spinlock_wait_cycles":9612672,"thread_start_us":100915,"threads_started":1,"wal-append.queue_time_us":248391}
I20260709 13:07:45.167199 26496 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 13:07:45.300907 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:45.270651 26376 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:45.146004 26291 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.208681 26457 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:07:45.290541 26429 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:45.269423 26183 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:45.299124 26498 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:45.288146 26405 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:07:45.309389 21838 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:45.297492 26508 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.321501 26315 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:45.322077 26315 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:45.324847 22576 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.789s (SENT)
I20260709 13:07:45.280572 26313 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:45.303601 26376 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.304195 26270 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:45.305058 26362 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:45.339092 21914 connection.cc:256] RPC call timeout handler was delayed by -1.6031697590000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 13:07:45.353747 21914 connection.cc:256] RPC call timeout handler was delayed by -1.5896697590001168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 13:07:45.358636 21914 connection.cc:256] RPC call timeout handler was delayed by -1.5095697590001009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:07:45.340653 21841 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:45.372929 21914 connection.cc:256] RPC call timeout handler was delayed by -1.4600697590000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:07:45.377245 21914 connection.cc:256] RPC call timeout handler was delayed by -1.4384697590000997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 13:07:45.332536 26514 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:07:45.332875 26511 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:07:45.341830 26479 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:45.402060 26479 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.402451 26479 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:45.405154 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.405369 26513 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 13:07:45.341552 26362 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.407697 26362 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:45.334590 26425 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:45.409919 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69385.7us
I20260709 13:07:45.411399 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:45.412808 26384 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.414295 22601 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:45.414708 26384 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.340349 26313 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.418340 26313 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:45.419749 26344 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:45.419469 26313 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.342229 26134 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.423138 26134 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:45.315574 26498 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:45.429662 26498 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:45.430869 26498 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.442286 26425 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:45.444502 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:45.447853 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.452028 26516 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:07:45.457052 26313 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.463225 21867 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
W20260709 13:07:45.465335 21873 consensus_meta.cc:287] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 13:07:45.465952 21873 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:45.480105 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 295685us
I20260709 13:07:45.471685 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:45.489157 21947 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:45.474323 21942 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:07:45.481138 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 215659us
I20260709 13:07:45.460775 26291 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:45.493649 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:45.501853 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:45.514889 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 45192.8us
I20260709 13:07:45.518327 21942 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:45.527801 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.485220 26333 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:45.533670 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:45.536096 22604 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.543047 26229 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.513124 26107 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:45.565018 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 69553.9us
I20260709 13:07:45.566638 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:07:45.574086 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 83964.2us
I20260709 13:07:45.575006 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:45.575881 26362 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.577356 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:45.578235 26362 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:45.578608 26362 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:45.578980 26362 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.579818 26429 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.580240 26429 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.580904 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:45.581598 22605 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:45.585109 22604 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
W20260709 13:07:45.592868 22576 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.051s (SENT)
I20260709 13:07:45.594332 26356 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:45.585341 21988 leader_election.cc:400] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12.
I20260709 13:07:45.596858 22603 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:45.569783 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:45.598187 22601 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:45.587636 26362 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:45.590026 26485 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:07:45.615094 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:45.568939 26315 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.615083 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:45.618254 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:45.622351 21874 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.604900 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:45.533124 26270 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:07:45.613754 26426 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.202s	user 0.043s	sys 0.037s
W20260709 13:07:45.627384 22576 leader_election.cc:336] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.098s (SENT)
I20260709 13:07:45.638072 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:45.571767 26319 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:45.646238 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.547396 26229 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:45.640846 26426 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.043s	sys 0.037s
I20260709 13:07:45.651950 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:45.657508 21942 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:45.640661 26319 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:45.662576 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.670344 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 732) took 1061 ms. Trace:
W20260709 13:07:45.673810 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 124986us
I20260709 13:07:45.673913 21874 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:45.623838 26485 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.649454 26208 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:45.680682 22022 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:45.684131 26496 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:45.650337 26270 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.705834 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:45.688078 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60719.2us
W20260709 13:07:45.707506 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 234132us
I20260709 13:07:45.679575 26183 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:07:45.698107 26486 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:45.699021 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 94267.3us
I20260709 13:07:45.700736 26315 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:45.696183 21773 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:07:45.704469 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 79505.3us
I20260709 13:07:45.672780 21871 rpcz_store.cc:276] 0709 13:07:44.609444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.787321 (+177877us) service_pool.cc:224] Handling call
0709 13:07:44.793775 (+  6454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.794054 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:44.808046 (+ 13992us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.447556 (+639510us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18002e7e00. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c1223a 00007f635607ca2a
0709 13:07:45.669879 (+222323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.669949 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:45.670020 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.670110 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.670269 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27159,"prepare.queue_time_us":13704,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3730,"spinlock_wait_cycles":5765888,"thread_start_us":194134,"threads_started":1}
I20260709 13:07:45.703006 26208 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.645107 26376 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.678398 26319 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:45.732568 21914 connection.cc:256] RPC call timeout handler was delayed by -1.4339697590000924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:07:45.673115 26437 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.702059 26229 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:45.697706 26479 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:45.705564 26496 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:45.744681 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.745239 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2251697590000958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2405s for a response
I20260709 13:07:45.745345 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:45.748955 26496 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:45.757629 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.743752 26208 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:45.743705 26473 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.768194 26525 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:45.770130 22576 leader_election.cc:336] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.241s (SENT)
W20260709 13:07:45.789108 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 129176us
I20260709 13:07:45.807046 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:45.811861 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 64364.2us
I20260709 13:07:45.812814 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:45.820003 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.823848 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.824975 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.823676 26134 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:45.905380 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 135282us
W20260709 13:07:45.906152 22576 leader_election.cc:336] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.246s (SENT)
I20260709 13:07:45.906549 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:45.809204 26520 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:07:45.908383 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.856199 26362 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:45.910843 26527 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:07:45.776491 26473 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.922623 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:45.923758 21948 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:45.826982 26356 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:07:45.905666 26518 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:45.813710 26429 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:45.865504 26479 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:45.922264 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.925122 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 97743.2us
I20260709 13:07:45.925974 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:45.935405 21946 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.935513 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:45.928191 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:45.935537 21945 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:45.907975 26531 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.903944 26134 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.936246 21943 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.937487 21914 leader_election.cc:400] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11.
I20260709 13:07:45.937418 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:46.041865 21914 leader_election.cc:403] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:45.932938 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:45.922281 26315 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:45.940212 21941 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:46.002588 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 62518.6us
I20260709 13:07:46.005115 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:46.002660 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:46.002274 26519 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:07:46.037700 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 131570us
I20260709 13:07:46.039995 21948 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:45.915552 26468 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:46.050565 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 305281us
I20260709 13:07:46.042160 21949 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
W20260709 13:07:46.062806 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.063685 21946 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:07:46.086771 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.002070 26485 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:46.082077 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.101845 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:46.030009 26535 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:46.105638 21945 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:46.026649 26362 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:07:46.067551 26134 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.130507 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.130280 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:46.086335 26376 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:46.134306 26540 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:07:46.137624 26473 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:46.132172 26526 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 13:07:46.142176 21987 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:46.143849 21941 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:46.153153 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.131312 26535 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.158504 26535 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:46.161381 26508 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.000s
I20260709 13:07:46.161849 26508 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.164026 26508 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:46.130026 26485 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11.
I20260709 13:07:46.165512 26315 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.166157 26315 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.166584 26315 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.166790 26319 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:46.168952 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 46980.5us
W20260709 13:07:46.169735 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 232363us
I20260709 13:07:46.170341 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.170827 21914 leader_election.cc:400] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13.
I20260709 13:07:46.172186 21914 leader_election.cc:400] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:07:46.172238 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.172916 21914 leader_election.cc:403] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:46.151549 26498 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:46.172775 26479 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.181432 26333 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:46.181939 26333 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:46.173486 26543 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:46.182915 26333 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.183225 26543 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.184059 26333 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:46.185369 26496 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.187021 26429 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:46.187667 26496 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:46.188956 21943 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:46.035980 26531 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:46.190631 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 121202us
W20260709 13:07:46.193817 22576 leader_election.cc:336] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.555s (SENT)
W20260709 13:07:46.194489 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.194326 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.199185 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:46.168927 26319 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:46.217422 21942 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.224294 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:46.227129 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54934.9us
I20260709 13:07:46.229061 21950 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 13:07:46.174649 26208 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.202430 26025 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
I20260709 13:07:46.213531 26384 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:46.213222 26496 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:46.246779 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 74779.5us
I20260709 13:07:46.201956 26549 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:07:46.236800 26426 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:46.252524 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.257349 21914 leader_election.cc:400] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 7. Current term is 8.
W20260709 13:07:46.258946 21916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.007s	sys 0.018s
W20260709 13:07:46.260308 21916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.007s	sys 0.019s
W20260709 13:07:46.261034 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 67273.3us
W20260709 13:07:46.261946 22576 leader_election.cc:336] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.619s (SENT)
I20260709 13:07:46.262408 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:46.268719 21942 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
W20260709 13:07:46.263204 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 576031us
W20260709 13:07:46.272996 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 91616.2us
W20260709 13:07:46.277125 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.286934 22024 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:46.248149 26496 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.289325 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:46.261912 26384 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.287050 22015 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:46.296267 21916 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:46.285369 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.296507 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:46.306989 21943 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:46.308528 26457 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:46.309574 22602 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:46.300428 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:46.310539 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.311843 22020 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:46.277340 26229 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:46.321223 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:46.322157 21943 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:46.287436 26025 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.326570 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64646.9us
I20260709 13:07:46.340567 22018 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:46.342188 21946 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:46.327615 22576 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.544s (SENT) [suppressed 42 similar messages]
I20260709 13:07:46.345095 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:46.345800 22017 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:46.345896 22576 leader_election.cc:336] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.762s (SENT)
I20260709 13:07:46.346773 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:46.304615 26486 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.311775 26535 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.354194 22020 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:46.316151 26319 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.365134 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:46.294188 26426 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:07:46.297762 26362 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:07:46.374132 21988 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:46.367404 26485 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:07:46.376571 26546 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:07:46.389253 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 77118.1us
W20260709 13:07:46.366415 26528 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.629s	user 0.007s	sys 0.007s
I20260709 13:07:46.350054 26468 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:46.397243 26468 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:46.400327 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:46.401059 21947 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:46.398974 26468 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.408193 22019 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:46.408270 26498 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:46.355482 26535 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:46.415568 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69723.4us
I20260709 13:07:46.422545 22017 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:46.365296 26319 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:46.425798 21947 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
W20260709 13:07:46.431783 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 57771.7us
I20260709 13:07:46.347667 26025 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.377647 26208 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:46.364300 26486 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.415858 26535 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:46.483992 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 183679us
W20260709 13:07:46.487380 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.494472 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 80271.3us
I20260709 13:07:46.493016 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:46.425215 26457 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:46.427603 26534 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:46.432580 26319 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:46.510448 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.501976 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.413496 26545 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:07:46.412636 26384 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:07:46.378311 26547 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.120s
W20260709 13:07:46.503448 26522 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:07:46.431176 26556 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:46.495813 26508 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:46.489573 26549 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:46.503125 26229 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:46.556181 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 237312us
W20260709 13:07:46.555189 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 118935us
W20260709 13:07:46.558161 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 147317us
I20260709 13:07:46.510684 26531 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:46.560292 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:46.522763 26270 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.564852 22020 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:46.518020 26282 raft_consensus.cc:3055] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:46.516431 26315 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.538945 26556 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:46.553438 26496 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:46.518952 26521 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:07:46.575842 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:46.559254 26229 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:46.566504 26555 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:46.518766 26534 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.566236 26270 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:46.576443 22573 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:46.566443 26282 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:46.569511 26315 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:46.590986 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.559088 26547 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:46.579177 26565 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:46.602193 26282 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.569885 26426 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:46.602130 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:46.583720 26384 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:46.579753 26556 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.582577 26229 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.613013 26565 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:46.580802 26457 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.621208 26384 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:46.623816 26384 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.624254 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:46.625479 26565 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.626852 26565 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.560889 26549 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.587177 26270 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:46.630168 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54409us
I20260709 13:07:46.628844 26568 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.635133 26568 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.635516 26568 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.607640 26562 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:46.636884 26562 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.637216 26562 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.640276 26543 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:46.642432 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:46.643044 21941 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.644907 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:46.631976 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 58069.7us
I20260709 13:07:46.632575 26573 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.633108 26025 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:46.634244 21914 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:46.646216 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.631615 26282 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:46.657696 26508 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:07:46.658066 26549 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:46.659446 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:46.660751 26573 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:46.660878 26561 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:07:46.661348 26573 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:46.662789 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:46.644567 26534 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:46.666863 26570 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:46.667311 26025 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.682850 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.684437 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:46.691911 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:46.696274 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:46.697779 21869 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:46.699934 21872 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:46.703824 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:46.706447 21873 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:46.710107 21875 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:46.708505 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:46.711344 21872 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:46.682850 26531 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.709529 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:46.711740 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:46.714617 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:46.713008 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:46.715224 21867 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:46.715133 21866 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
W20260709 13:07:46.717319 26134 consensus_meta.cc:287] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.002s
I20260709 13:07:46.717449 21871 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:46.717511 26531 raft_consensus.cc:2764] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:46.706980 26546 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:46.688537 26525 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:46.725219 21869 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:46.725098 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:46.725857 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:46.722396 21868 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:46.695544 26549 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.695911 26534 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:46.680418 26559 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:46.729031 26134 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.662263 26573 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.731190 26319 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.739149 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:46.702375 26547 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:46.742759 21868 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:46.744505 26534 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:46.709416 26429 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:46.710578 26570 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:46.765885 21941 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:46.779804 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54782.2us
I20260709 13:07:46.822731 26584 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:46.761034 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:46.760782 21871 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
I20260709 13:07:46.825881 22016 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:46.824993 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 74587.4us
I20260709 13:07:46.826788 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:46.822410 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73371.2us
I20260709 13:07:46.822575 22602 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:46.821338 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:46.827471 21867 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:46.830462 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69497.5us
I20260709 13:07:46.750171 26525 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:46.752651 26356 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.834606 26546 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:46.836874 26356 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.838898 26485 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:46.839367 26485 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:46.839466 26356 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:46.843403 26134 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:46.847566 26553 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:46.835151 26548 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.850366 26548 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.854669 26556 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.857455 26556 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:46.877049 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:46.877807 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.847998 26229 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.860965 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:46.885113 21874 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:46.885061 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57365.6us
I20260709 13:07:46.861050 26534 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.863879 26384 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.747997 26549 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.819231 26429 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.865635 26545 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:46.868754 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:46.860303 26270 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.872287 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:46.868319 21987 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:46.918365 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:46.911154 22576 leader_election.cc:336] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.745s (SENT)
I20260709 13:07:46.880139 26229 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:46.921438 21944 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 8: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:46.921767 22605 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:46.819473 26508 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:07:46.927029 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:46.929090 22607 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.929996 21869 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:46.819134 26565 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:07:46.889565 26479 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.891265 26546 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:46.941370 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:46.944486 21875 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:46.897078 26548 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:46.947177 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 78929.7us
I20260709 13:07:46.949151 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:46.947934 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:46.967782 22015 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:46.967651 22016 raft_consensus.cc:2376] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11. Re-sending same reply.
I20260709 13:07:46.973414 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:46.974241 22604 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.916281 26356 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.975385 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:46.976616 22020 raft_consensus.cc:2410] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:46.973445 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:46.973519 26134 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.915369 26545 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:46.991124 21987 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:46.979154 22017 raft_consensus.cc:2410] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:07:46.982429 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:46.993122 21875 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:46.982980 26282 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:46.995769 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:46.840308 26485 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.893848 26562 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:46.997884 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:46.998953 22020 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 7: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:46.987826 26558 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:07:46.931214 26568 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:46.987143 26569 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:47.031358 22603 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:47.036350 26548 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.037081 26548 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.040783 21941 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:46.949724 26479 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:47.048076 21867 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:46.951617 26535 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.049947 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:47.049962 21945 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:47.052531 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.053248 22022 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.054054 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.057083 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.020887 26559 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:47.060313 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 162468us
I20260709 13:07:47.005730 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:47.070242 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 359542us
I20260709 13:07:46.965289 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:47.141582 22608 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.047468 26569 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:47.111584 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.091975 22576 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.812s (SENT)
I20260709 13:07:47.005616 26134 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.150589 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:47.106350 21841 leader_election.cc:336] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.707s (SENT)
I20260709 13:07:47.049535 26485 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.996842 26356 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.051252 26534 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:47.166738 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.166669 22608 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:07:47.093439 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.136919 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:47.105278 22022 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:07:47.169396 21945 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.169746 22017 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:47.169422 22024 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:47.108461 22604 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:47.014912 26570 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:47.130209 21874 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:47.088999 26208 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.148689 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:47.151428 22015 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:47.154049 21875 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:47.179751 22609 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:47.157111 26574 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.428s	user 0.002s	sys 0.003s
I20260709 13:07:47.158331 26562 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:47.160040 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.094579 26559 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:47.188993 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:47.189375 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.178033 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:47.185624 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 93693.2us
I20260709 13:07:47.189150 22020 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:47.189061 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:47.191210 22576 leader_election.cc:336] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.936s (SENT)
I20260709 13:07:47.191347 22605 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.191974 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:47.192644 21875 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.193872 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.191745 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:47.195880 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:47.194835 22022 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:47.206559 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:47.162196 26319 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:47.213483 21914 connection.cc:256] RPC call timeout handler was delayed by -1.7639732240000967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:07:47.133086 26521 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:07:47.212173 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:47.223205 21949 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.193667 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:47.224393 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:47.225909 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 150703us
I20260709 13:07:47.228664 21875 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:47.230916 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.232311 21838 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:47.049734 26546 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:47.219748 21914 connection.cc:256] RPC call timeout handler was delayed by -1.7621732240000938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:07:47.233597 21914 connection.cc:256] RPC call timeout handler was delayed by -1.72887322400004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 13:07:47.234229 21914 connection.cc:256] RPC call timeout handler was delayed by -1.6901982770000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2557s for a response
W20260709 13:07:47.234643 21914 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.588s (SENT)
I20260709 13:07:47.237126 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.238024 22022 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:47.152868 26556 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:47.206122 26457 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.211819 26313 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.107141 26545 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.262840 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.189767 26208 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:47.246701 26583 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:07:47.235176 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:47.259017 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:47.265288 22016 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:47.266139 22022 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:47.277798 21871 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.233630 26405 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:47.281256 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.288317 21949 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:47.291877 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.246954 26270 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:47.299893 22016 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:47.283113 26548 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:47.295845 26568 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:47.263621 26549 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:47.310056 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:47.265291 26384 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:47.295410 26573 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.328510 26208 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:47.334417 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:47.335295 21946 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:47.338068 26384 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:47.341137 21949 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:47.341408 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:47.265089 26313 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.338673 26384 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:47.346621 22022 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:47.350517 22022 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:47.358600 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 902) took 1033 ms. Trace:
I20260709 13:07:47.359190 26429 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:47.359057 22602 rpcz_store.cc:276] 0709 13:07:46.325744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.325944 (+   200us) service_pool.cc:224] Handling call
0709 13:07:46.354475 (+ 28531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.831195 (+476720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.358371 (+527176us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54006d1354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:47.358537 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076042112}
W20260709 13:07:47.365576 26582 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:07:47.248070 26569 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:47.322836 26545 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.318578 26270 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:47.332835 26543 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:47.351511 22022 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.379889 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:47.383225 22016 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:07:47.377612 26598 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:07:47.387116 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 152485us
I20260709 13:07:47.340211 26479 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:47.345005 26535 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:47.388788 22022 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.397843 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.398763 22016 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:47.399837 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.381605 26543 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:47.408784 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.409610 22016 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
W20260709 13:07:47.403697 26601 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 13:07:47.442166 22022 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:07:47.443279 22022 pending_rounds.cc:85] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 9
I20260709 13:07:47.443596 22022 pending_rounds.cc:107] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:07:47.443946 22022 raft_consensus.cc:2889] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.433580 21945 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
W20260709 13:07:47.433064 22607 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.501s	user 0.014s	sys 0.007s
I20260709 13:07:47.448396 22607 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:07:47.318800 26559 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.398598 26134 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:47.385007 26270 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:47.407573 26571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.013s	sys 0.007s
I20260709 13:07:47.405896 26356 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:47.465215 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73140.6us
I20260709 13:07:47.459059 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.467255 22022 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:47.467710 22016 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:47.442144 26405 raft_consensus.cc:697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:07:47.457901 26571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.013s	sys 0.008s
W20260709 13:07:47.470041 21914 connection.cc:256] RPC call timeout handler was delayed by -1.5497732240000914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:07:47.473047 21914 connection.cc:256] RPC call timeout handler was delayed by -1.519173224000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 13:07:47.404950 22602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:36026
I20260709 13:07:47.474108 22602 raft_consensus.cc:606] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:47.475317 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.476080 22016 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:47.442378 26384 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:47.477594 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:47.478820 21948 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:47.479189 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:47.479432 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:47.483256 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:47.525233 21943 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:47.486375 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.525782 21871 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:47.490247 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.492302 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:47.493956 26313 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:47.477401 26604 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:47.529716 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.530377 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:47.531589 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.532164 21870 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
W20260709 13:07:47.533128 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.533322 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.533993 21870 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:47.499081 22605 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:47.500398 21773 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 11, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 11 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.503742 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:47.505803 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.535542 21875 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:47.527665 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:47.536092 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:47.536669 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 306816us
I20260709 13:07:47.537111 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:47.537364 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.537976 26535 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:47.538542 26025 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:47.538692 26610 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.538686 22018 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:47.538734 26535 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:47.539351 26610 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.541466 26618 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:47.543568 22606 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:47.530369 22020 raft_consensus.cc:2376] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15. Re-sending same reply.
I20260709 13:07:47.545269 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.546275 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.546898 21868 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:47.547643 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.543399 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.552134 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.552521 21868 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:47.553161 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.542289 26618 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:47.557401 22022 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:47.557893 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:47.558451 21868 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:47.558544 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.559098 22016 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.561295 22573 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:47.563215 26457 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:47.563376 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:47.563668 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.564044 21867 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.564181 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.564563 26473 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:47.564906 22019 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:47.565778 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.566450 22019 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:47.567098 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.568329 22019 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:47.563774 26457 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:47.569432 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.615437 21871 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:47.563081 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:47.568876 26611 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:47.608044 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.624910 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.625322 22022 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:47.677882 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:47.707194 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.708173 22023 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:47.543280 26486 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:47.715296 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:47.616398 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:47.617353 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:47.564332 22021 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:48.168321 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:48.140516 22606 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:47.974227 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.144976 26485 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.983s	user 0.019s	sys 0.020s
I20260709 13:07:48.145450 26605 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:47.744379 22020 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
W20260709 13:07:48.147766 21867 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.532s	user 0.013s	sys 0.005s
I20260709 13:07:48.141444 21871 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:48.140695 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 516232us
I20260709 13:07:47.643461 26520 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:47.939808 26457 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:47.552307 26604 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.156785 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:47.469985 26543 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.143863 26270 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:48.140036 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:47.780915 26405 consensus_queue.cc:237] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:47.989045 21872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.003s	sys 0.011s
W20260709 13:07:48.241444 21872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.004s	sys 0.013s
I20260709 13:07:48.242429 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2100) took 1263 ms. Trace:
W20260709 13:07:48.161275 21868 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.602s	user 0.028s	sys 0.020s
W20260709 13:07:48.159900 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 550293us
W20260709 13:07:48.140269 22016 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.014s
I20260709 13:07:48.244367 21868 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:48.244777 22016 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:48.184993 21873 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:48.186069 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 904) took 1544 ms. Trace:
I20260709 13:07:48.244336 22017 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:48.194242 21867 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:48.248492 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:48.249660 21867 raft_consensus.cc:2410] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:48.202143 22019 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.204304 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:48.250351 21871 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:48.246913 22603 rpcz_store.cc:276] 0709 13:07:46.641571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.645585 (+  4014us) service_pool.cc:224] Handling call
0709 13:07:46.666543 (+ 20958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.033202 (+366659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.185731 (+1152529us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54005deb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:48.185990 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838455040}
I20260709 13:07:48.251259 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:48.252022 21871 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:48.254407 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:48.254528 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:48.254930 21871 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.260645 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:48.261636 21868 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:48.263441 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:48.267905 26291 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:48.242920 21872 rpcz_store.cc:276] 0709 13:07:46.978929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.979768 (+   839us) service_pool.cc:224] Handling call
0709 13:07:46.980090 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.980286 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:47.192709 (+212423us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.241941 (+1049232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.242021 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:48.242089 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.242182 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.242353 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15935,"prepare.queue_time_us":56934,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":135781,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":16926,"thread_start_us":1245267,"threads_started":3,"wal-append.queue_time_us":130879}
W20260709 13:07:48.270706 26534 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.092s	user 0.018s	sys 0.002s
I20260709 13:07:48.271670 22015 raft_consensus.cc:2410] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:48.271713 21870 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:48.171429 26611 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.272949 26604 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:48.191905 26605 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:48.274349 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:48.274587 26604 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:48.176256 26584 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:48.274928 21867 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.272717 26611 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.275382 26584 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.274219 26605 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.278657 21873 raft_consensus.cc:2368] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10.
I20260709 13:07:48.278725 21871 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:48.199291 26562 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:48.284176 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.398650 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.288026 26344 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:48.399873 26344 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:48.400907 26344 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.402417 26344 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.159369 26376 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:48.404978 26376 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:48.281666 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.303118 21867 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:48.409662 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2658) took 1023 ms. Trace:
I20260709 13:07:48.335350 22019 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
W20260709 13:07:48.396392 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 223607us
I20260709 13:07:48.200052 26183 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:48.330822 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 767712us
I20260709 13:07:48.295917 21866 raft_consensus.cc:2393] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:48.412586 21867 rpcz_store.cc:276] 0709 13:07:47.386222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.274069 (+887847us) service_pool.cc:224] Handling call
0709 13:07:48.409589 (+135520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.431299 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:48.433120 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:48.237582 26485 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.434765 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:48.436555 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:48.440936 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2672) took 1028 ms. Trace:
W20260709 13:07:48.483476 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47007.6us
I20260709 13:07:48.202121 26520 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:48.526605 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:48.517206 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 757) took 1273 ms. Trace:
I20260709 13:07:48.517601 21871 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 13:07:48.534093 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:48.277591 26618 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:48.283622 26545 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.896s	user 0.011s	sys 0.006s
I20260709 13:07:48.291879 26610 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:48.506582 21866 rpcz_store.cc:276] 0709 13:07:47.412855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.200281 (+787426us) service_pool.cc:224] Handling call
0709 13:07:48.440868 (+240587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.278200 26270 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.281019 26620 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 13:07:48.536255 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2106) took 1245 ms. Trace:
I20260709 13:07:48.566732 21871 rpcz_store.cc:276] 0709 13:07:47.291361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.515435 (+1224074us) service_pool.cc:224] Handling call
0709 13:07:48.517304 (+  1869us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.535098 (+ 17794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.536188 (+  1090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.533305 21867 rpcz_store.cc:276] 0709 13:07:47.243599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.516230 (+1272631us) service_pool.cc:224] Handling call
0709 13:07:48.516581 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.516792 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.516827 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.516878 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:48.516937 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.517005 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.517140 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.539891 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 751) took 1802 ms. Trace:
I20260709 13:07:48.569240 21869 rpcz_store.cc:276] 0709 13:07:46.737836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.741042 (+  3206us) service_pool.cc:224] Handling call
0709 13:07:46.753942 (+ 12900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.930596 (+176654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.539628 (+1609032us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003183d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:48.539812 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404302720}
I20260709 13:07:48.526305 26570 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:48.553308 22603 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:48.432715 26183 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:48.440572 26534 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.472401 26315 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:07:48.491744 26384 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:48.540362 21874 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:48.557741 26618 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:48.526774 26025 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.536255 26605 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.576506 21873 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:48.582974 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 759) took 1010 ms. Trace:
I20260709 13:07:48.439870 26567 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:07:48.615365 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2668) took 1203 ms. Trace:
I20260709 13:07:48.615115 21866 rpcz_store.cc:276] 0709 13:07:47.572195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.554550 (+982355us) service_pool.cc:224] Handling call
0709 13:07:48.582442 (+ 27892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.582639 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.582663 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.582705 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:48.582744 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.582801 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.582917 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.416987 26562 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:48.605913 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2666) took 1194 ms. Trace:
W20260709 13:07:48.541947 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 303698us
I20260709 13:07:48.615869 21873 rpcz_store.cc:276] 0709 13:07:47.411656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.534321 (+1122665us) service_pool.cc:224] Handling call
0709 13:07:48.569192 (+ 34871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.615071 (+ 45879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.615301 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.621901 21916 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:48.565606 26543 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.526963 26313 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:07:48.584964 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 967606us
I20260709 13:07:48.515527 26485 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.539978 26362 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:07:48.560371 26610 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:48.620800 21874 rpcz_store.cc:276] 0709 13:07:47.411088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.533828 (+1122740us) service_pool.cc:224] Handling call
0709 13:07:48.534138 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.605598 (+ 71460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.605844 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.637769 21867 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:48.607990 26545 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.545243 26569 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:07:48.628417 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.649019 21873 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:48.649679 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 760) took 1026 ms. Trace:
I20260709 13:07:48.649998 21873 rpcz_store.cc:276] 0709 13:07:47.623613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.622082 (+998469us) service_pool.cc:224] Handling call
0709 13:07:48.648707 (+ 26625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.649429 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.649619 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.651259 21874 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:48.609977 26622 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:48.576370 26270 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.638481 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2681) took 1024 ms. Trace:
W20260709 13:07:48.663194 21841 leader_election.cc:336] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.107s (SENT)
I20260709 13:07:48.643213 21866 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:07:48.714322 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2111) took 1097 ms. Trace:
I20260709 13:07:48.714860 21866 rpcz_store.cc:276] 0709 13:07:47.616895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.616806 (+999911us) service_pool.cc:224] Handling call
0709 13:07:48.637495 (+ 20689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.713925 (+ 76430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.714244 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.587749 26473 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:48.655678 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2665) took 1233 ms. Trace:
I20260709 13:07:48.582906 26563 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:07:48.577764 26570 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:48.663573 21867 rpcz_store.cc:276] 0709 13:07:47.614474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.614756 (+1000282us) service_pool.cc:224] Handling call
0709 13:07:48.637598 (+ 22842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.638217 (+   619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.638425 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.582468 26626 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
W20260709 13:07:48.674384 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.675355 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 244282us
I20260709 13:07:48.676770 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.605858 26534 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.624468 26025 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.621942 26618 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.614205 26384 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.699100 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.740085 22605 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:48.706391 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.709203 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.704607 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:07:48.656585 26545 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.648192 26610 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.716389 21870 rpcz_store.cc:276] 0709 13:07:47.410751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.552944 (+142193us) service_pool.cc:224] Handling call
0709 13:07:48.643670 (+1090726us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b540022bd54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:48.643787 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650994048}
I20260709 13:07:48.728260 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.739176 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.665431 26622 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.732873 26570 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:48.741858 22019 raft_consensus.cc:606] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:48.687598 26362 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:07:48.752728 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:48.760999 21875 raft_consensus.cc:2376] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10. Re-sending same reply.
I20260709 13:07:48.761575 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2675) took 1212 ms. Trace:
I20260709 13:07:48.762084 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.761938 21875 rpcz_store.cc:276] 0709 13:07:47.549410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.557632 (+  8222us) service_pool.cc:224] Handling call
0709 13:07:48.752582 (+1194950us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4deee 0000000000375939 00007f635afc11e0 00007f635b08a0c4 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:07:48.761516 (+  8934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3156224}
W20260709 13:07:48.752810 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 294887us
I20260709 13:07:48.754717 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.741600 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:48.727633 26627 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:48.739856 26584 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:48.744469 26625 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:48.765530 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 142487us
I20260709 13:07:48.771157 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:48.782635 22606 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.008s
I20260709 13:07:48.783165 22606 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:48.783192 21949 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:48.707752 26183 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.761430 26313 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.788422 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:48.716619 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:48.790707 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:48.805025 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 687) took 1195 ms. Trace:
W20260709 13:07:48.791584 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.812196 21948 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:48.787129 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:48.813982 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:48.811900 22606 rpcz_store.cc:276] 0709 13:07:47.588238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.623109 (+ 34871us) service_pool.cc:224] Handling call
0709 13:07:48.783777 (+1160668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.824630 21949 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:48.721248 26562 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.784256 26559 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.814579 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:48.826661 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:48.805764 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:48.764384 26611 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:48.830549 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 293022us
I20260709 13:07:48.779189 26638 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:48.856142 21946 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:07:48.844213 21943 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:48.802615 26625 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:48.842836 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 108096us
I20260709 13:07:48.830322 26183 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:48.862691 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.859645 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:48.867990 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:48.778815 26627 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.785219 26473 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:48.786540 26634 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
W20260709 13:07:48.864428 22576 leader_election.cc:336] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.544s (SENT)
I20260709 13:07:48.791112 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:48.879805 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 216645us
I20260709 13:07:48.862082 26485 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:48.826615 26313 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.852511 26559 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:48.903106 26624 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:07:48.914634 26270 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:48.920799 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:07:48.961999 26570 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.962579 22019 raft_consensus.cc:606] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:48.923655 26622 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:48.927112 26534 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:48.928160 26633 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.928627 26647 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:48.929446 22015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1687) took 1667 ms (client timeout 2200 ms). Trace:
I20260709 13:07:48.969033 21950 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:48.929782 26634 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:48.930410 26384 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:48.960386 26479 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:48.931953 26545 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:48.927189 26617 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:07:48.932960 26623 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:07:48.933919 26313 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:48.934466 26610 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:48.935508 26627 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:48.937026 26639 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:48.940658 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:48.941174 26025 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:48.959086 26641 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:07:48.961119 26618 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:48.947088 26628 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.066100 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:07:49.067025 22019 raft_consensus.cc:606] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:49.067481 22019 raft_consensus.cc:614] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:48.867687 26638 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:48.975255 26633 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.055104 26604 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:49.001715 21949 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:48.967900 22015 rpcz_store.cc:269] 0709 13:07:47.261891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.262536 (+   645us) service_pool.cc:224] Handling call
0709 13:07:48.928502 (+1665966us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540025eed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:48.929373 (+   871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2317928960}
I20260709 13:07:49.003952 21941 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.931025 26625 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:48.892565 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.086488 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.886173 22576 leader_election.cc:336] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.557s (SENT)
I20260709 13:07:49.087211 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:48.999087 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 187471us
W20260709 13:07:49.088286 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 202134us
I20260709 13:07:48.958308 26584 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:07:48.966770 26534 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:49.014019 21947 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:49.088968 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:49.002630 26643 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:48.886569 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 599) took 1321 ms. Trace:
I20260709 13:07:49.020026 21916 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:49.004145 26570 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:48.888585 26611 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:49.011647 26384 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:49.097738 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 77803.2us
W20260709 13:07:49.097894 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 151316us
I20260709 13:07:49.105026 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:49.107338 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.109169 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1690) took 1788 ms. Trace:
I20260709 13:07:49.103138 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.109589 22024 rpcz_store.cc:276] 0709 13:07:47.320449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.320825 (+   376us) service_pool.cc:224] Handling call
0709 13:07:47.340774 (+ 19949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.342581 (+  1807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.342610 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.377131 (+ 34521us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.752882 (+375751us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:48.252200 (+499318us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.317436 (+ 65236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.317547 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.108951 (+791404us) raft_consensus.cc:1685] finished
0709 13:07:49.108972 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.109112 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78868,"prepare.queue_time_us":498989,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":66988,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":23854,"thread_start_us":354396,"threads_started":1,"wal-append.queue_time_us":1385185}
I20260709 13:07:49.112105 22019 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:49.009362 26634 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:48.859170 26619 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.959105 26626 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:49.002913 26647 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.013948 26479 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.091339 22018 rpcz_store.cc:276] 0709 13:07:47.580672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.623356 (+ 42684us) service_pool.cc:224] Handling call
0709 13:07:48.152851 (+529495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.153032 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:48.638084 (+485052us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.874975 (+236891us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.886230 (+ 11255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.886280 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:48.886328 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.886395 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.886510 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111380,"prepare.queue_time_us":148191,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":322,"raft.queue_time_us":231621,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":31424,"thread_start_us":603081,"threads_started":2,"wal-append.queue_time_us":436405}
I20260709 13:07:49.104519 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:49.113343 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 170004us
I20260709 13:07:49.133458 22020 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 8.
W20260709 13:07:49.084112 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 293108us
W20260709 13:07:49.117046 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 249159us
I20260709 13:07:49.134189 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.134944 21988 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.093112 26604 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:49.098232 26344 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.695s	user 0.016s	sys 0.000s
I20260709 13:07:49.074101 26628 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.098588 26183 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.110718 26654 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:49.134968 22017 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:07:49.097551 26534 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:49.148017 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:49.153072 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:07:49.158129 22020 raft_consensus.cc:606] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:49.158622 22020 raft_consensus.cc:614] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:49.136319 26622 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.105373 26384 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.133570 26025 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:49.101018 26611 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.141235 26562 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:49.152768 26183 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.169673 26643 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:49.194085 26652 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:07:49.196501 26611 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:49.198272 26384 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:49.201316 26651 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:07:49.202114 26605 consensus_meta.cc:287] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.004s
I20260709 13:07:49.202714 26604 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:49.171408 26622 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.203435 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2680) took 1595 ms. Trace:
I20260709 13:07:49.170145 26567 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:49.186455 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:49.185139 26025 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.205755 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:49.209446 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:49.209798 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.155435 26559 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:49.185560 26543 consensus_meta.cc:287] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.004s
I20260709 13:07:49.203953 21871 rpcz_store.cc:276] 0709 13:07:47.608520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.567958 (+959438us) service_pool.cc:224] Handling call
0709 13:07:48.568482 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.571155 (+  2673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.571235 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.595400 (+ 24165us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.826487 (+231087us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:48.856638 (+ 30151us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.856877 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.856966 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.203162 (+346196us) raft_consensus.cc:1685] finished
0709 13:07:49.203191 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.203360 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32888,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":116993,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":23918,"thread_start_us":182846,"threads_started":1,"wal-append.queue_time_us":373038}
I20260709 13:07:49.209137 21872 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:07:49.217938 21872 pending_rounds.cc:85] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 8
I20260709 13:07:49.218312 21872 pending_rounds.cc:107] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:49.218619 21872 raft_consensus.cc:2889] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.173660 26654 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:49.188580 26183 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.242525 21944 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:07:49.261664 22576 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.652s (SENT)
W20260709 13:07:49.261942 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44033.8us
I20260709 13:07:49.262286 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:49.204877 26567 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:49.201153 26659 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:07:49.174386 26619 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:07:49.221076 26485 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.240104 26618 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:49.299588 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 142527us
W20260709 13:07:49.303887 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 94555.9us
I20260709 13:07:49.304760 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:49.240010 26604 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:07:49.308279 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.269564 26344 raft_consensus.cc:2764] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:49.288340 26562 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:49.294319 26619 consensus_queue.cc:1243] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:07:49.301391 26653 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:07:49.213421 26662 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:07:49.307627 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:49.347196 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:49.317184 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.319175 26675 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:49.320643 26649 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:07:49.312655 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:49.359413 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46863.4us
W20260709 13:07:49.360893 21838 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.822s (SENT)
I20260709 13:07:49.361545 21838 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.305536 26485 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.310729 26658 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:49.364179 26655 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:07:49.313707 26545 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.314476 26543 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.324541 26618 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.366981 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:49.377197 26644 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:49.369621 26658 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:49.372118 26660 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:07:49.372833 26384 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:49.378942 26657 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:07:49.342686 26665 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:07:49.379150 26545 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.380195 26543 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:49.380338 26647 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:49.384338 22604 pending_rounds.cc:85] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 9
I20260709 13:07:49.449653 22604 pending_rounds.cc:107] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:07:49.450018 22604 raft_consensus.cc:2889] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.310215 26654 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.435290 26644 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:49.437914 26662 raft_consensus.cc:2764] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:49.386112 26634 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:49.388550 26563 raft_consensus.cc:993] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:07:49.390295 26622 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:49.375468 26344 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:49.357205 26567 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.358347 26605 raft_consensus.cc:2764] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:49.305898 26663 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:07:49.416927 26636 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.680s	user 0.005s	sys 0.002s
I20260709 13:07:49.418448 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 602) took 1809 ms. Trace:
I20260709 13:07:49.424543 26642 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:49.375499 26633 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:49.426429 26628 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:49.427515 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:49.428442 26025 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:49.429397 26672 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:07:49.429865 26649 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:49.370934 26638 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:49.517762 21841 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.651s (SENT)
W20260709 13:07:49.437111 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 70258.9us
I20260709 13:07:49.489192 26563 raft_consensus.cc:1081] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:07:49.435497 26486 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:49.287532 26534 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.474711 26658 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.539695 26658 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.539520 26486 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.541920 26486 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:49.441817 26479 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:49.474076 26405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.010s
I20260709 13:07:49.475520 26644 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.488268 22023 rpcz_store.cc:276] 0709 13:07:47.609828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.715174 (+105346us) service_pool.cc:224] Handling call
0709 13:07:48.138000 (+422826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.406365 (+268365us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:48.471744 (+ 65379us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.874048 (+402304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.874129 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:48.874196 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.418087 (+543891us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54001ef0d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:49.418153 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.418335 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65794,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":6048,"raft.queue_time_us":81685,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5402,"spinlock_wait_cycles":549827456,"thread_start_us":401837,"threads_started":2,"wal-append.queue_time_us":371082}
W20260709 13:07:49.490918 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 227760us
I20260709 13:07:49.472478 26543 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:49.496810 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 321970us
I20260709 13:07:49.518695 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:49.445624 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 98526.7us
I20260709 13:07:49.492012 26642 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:07:49.538548 21841 leader_election.cc:336] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.691s (SENT)
W20260709 13:07:49.525106 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.522456 26567 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.555688 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:49.586652 21946 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:49.555167 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:49.567507 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:49.568782 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.565402 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:49.580199 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:49.589133 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.545589 26405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.000s	sys 0.011s
I20260709 13:07:49.589011 21987 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:49.582823 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:49.591998 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73394.3us
I20260709 13:07:49.585263 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:49.592139 21942 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:49.592741 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.602035 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:49.602741 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64273.9us
W20260709 13:07:49.613729 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46316.2us
I20260709 13:07:49.579397 26643 raft_consensus.cc:697] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:49.637921 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 80623.2us
I20260709 13:07:49.638669 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:49.597379 26636 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:07:49.627494 21838 leader_election.cc:336] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.830s (SENT)
I20260709 13:07:49.639415 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:49.639523 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.614491 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:49.603988 26669 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:07:49.600044 26479 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:49.646147 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.649823 22019 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:49.646775 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.603418 26660 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.652338 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.650415 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:49.600214 26679 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.600126 26662 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.590128 26183 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:49.669239 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 54816.9us
I20260709 13:07:49.697602 21914 leader_election.cc:400] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10.
I20260709 13:07:49.697921 21914 leader_election.cc:403] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.698447 22019 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:49.695163 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.671777 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.637473 26638 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:49.704088 22019 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:49.705513 21943 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:07:49.706387 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 95731.9us
I20260709 13:07:49.643872 26486 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.670064 26642 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.651132 26663 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.707930 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.786180 26642 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.733843 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.706254 26543 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.695914 26662 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.787448 26662 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:49.789105 26682 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:07:49.727300 26545 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:49.790102 26686 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:49.780882 26605 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.769304 26643 consensus_queue.cc:237] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.773973 26183 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:49.755491 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 601) took 2120 ms. Trace:
I20260709 13:07:49.756814 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:49.774509 26680 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.792325 26605 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.799676 21916 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:49.800588 26681 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:07:49.801997 26605 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:49.797241 22022 rpcz_store.cc:276] 0709 13:07:47.608738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.677128 (+ 68390us) service_pool.cc:224] Handling call
0709 13:07:47.677512 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.284182 (+606670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.284226 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.284919 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.495321 (+210402us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:48.539034 (+ 43713us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.704890 (+165856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.704976 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.416133 (+711157us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:49.707873 (+291740us) raft_consensus.cc:1685] finished
0709 13:07:49.729329 (+ 21456us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.729518 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133585,"prepare.queue_time_us":92205,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":302091,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":6447,"spinlock_wait_cycles":17242368,"thread_start_us":372177,"threads_started":2,"wal-append.queue_time_us":400841}
I20260709 13:07:49.653103 26559 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:49.805316 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 96082.7us
I20260709 13:07:49.728366 21943 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:49.787087 26486 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.809170 26632 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:49.651456 26485 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:49.669937 26362 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.651988 26660 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:49.652884 26625 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:49.835664 26486 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.852198 26405 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.852874 26405 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.855235 21949 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:49.855324 26405 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:49.859661 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:49.870796 26644 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:49.871758 26673 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.552s	user 0.000s	sys 0.010s
I20260709 13:07:49.872964 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:49.866292 26660 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.859910 26625 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.885818 26376 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:49.888473 26644 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:49.889353 26384 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:49.889850 26384 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:49.886926 26486 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.892746 26486 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:49.882306 26625 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:49.911803 26229 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.928208 26229 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:49.929248 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:49.919138 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:49.930467 26229 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:49.932122 26473 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:49.932641 26473 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:49.933899 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 236406us
I20260709 13:07:49.934198 26025 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10.
I20260709 13:07:49.934787 26473 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:49.934916 26638 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:49.936044 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 136457us
I20260709 13:07:49.935858 26638 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.936502 26633 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.936883 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:49.937655 26485 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.938033 26485 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:49.938403 26485 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.938462 26679 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:49.934755 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:49.910480 21871 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:49.944450 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.918681 21773 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:49.948282 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 297920us
I20260709 13:07:49.949460 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:49.950562 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:49.951150 22015 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.951170 22022 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:49.961404 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:49.916263 26648 raft_consensus.cc:993] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:07:49.968408 21946 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:49.970861 21871 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:49.936924 26633 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:49.983440 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48765.5us
I20260709 13:07:49.981142 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:49.990592 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.957314 26679 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:49.963487 21867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:44780
I20260709 13:07:49.998037 21867 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:49.998409 21867 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.998543 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:49.912153 26662 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:49.999809 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.000027 26648 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.962864 26344 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:07:50.001802 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:49.985328 26633 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.982012 26543 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.010922 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:50.000383 26693 raft_consensus.cc:1081] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:07:49.996920 26545 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.017422 22023 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:50.012521 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:49.984304 26641 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:07:50.002132 26683 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.925539 26384 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.003046 26664 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.903424 26520 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.019697 26679 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.030575 21867 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.002269 26670 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:07:50.019493 26650 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:50.059715 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47308.3us
I20260709 13:07:50.070855 26486 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:50.009692 26654 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:50.017505 26684 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:50.084937 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.076157 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.014011 26639 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.071911 26643 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:50.013746 26543 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.110263 21867 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:50.112708 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.059226 26647 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:07:50.122592 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.056686 26664 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.083290 26486 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:50.086910 26650 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:50.088974 26639 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:50.135720 26639 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.136353 26664 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:50.141150 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 153466us
I20260709 13:07:50.134646 26486 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.134155 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.123348 26668 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.146145 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.126256 26362 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:50.115043 26643 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:50.122203 26684 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:50.147516 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.148524 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2928) took 1044 ms. Trace:
I20260709 13:07:50.127621 26570 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.144088 26183 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.162886 22021 rpcz_store.cc:276] 0709 13:07:49.103787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.104728 (+   941us) service_pool.cc:224] Handling call
0709 13:07:50.148270 (+1043542us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400019d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:50.148452 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674971520}
I20260709 13:07:50.170219 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.170627 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:50.156282 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 168219us
W20260709 13:07:50.166136 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 166409us
I20260709 13:07:50.173630 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.174357 22017 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.178992 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.179620 21866 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:07:50.153003 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 157710us
I20260709 13:07:50.180558 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.180981 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.181553 21871 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:50.181596 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.182200 21866 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:50.182824 21872 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:50.183059 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.183728 21873 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:50.183923 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.184535 21870 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:50.185451 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.185997 21868 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:50.186769 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.187287 21874 raft_consensus.cc:2376] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13. Re-sending same reply.
I20260709 13:07:50.188342 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.189191 21869 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:50.194023 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.194466 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.195283 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.195580 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.196416 22018 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:07:50.196019 22019 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:50.200714 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.203473 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.204244 21874 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:50.206039 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.206662 21874 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:50.208022 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.208643 21874 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:50.210548 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.211897 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.212634 21868 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
W20260709 13:07:50.225863 21914 connection.cc:256] RPC call timeout handler was delayed by -1.3820371159998786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:07:50.225924 22020 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:50.226574 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2560371159999022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:07:50.227126 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2452371159998847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:07:50.211186 21874 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:50.190594 26697 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.227775 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.227864 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.249701 22024 raft_consensus.cc:2410] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:50.250229 26707 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:50.250617 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.250849 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.226199 22019 raft_consensus.cc:2410] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:50.162750 26545 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.260222 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.260416 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.228556 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.229421 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.225219 26534 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.234865 22015 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:07:50.155802 26569 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.155512 26643 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.239383 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.264032 21870 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:50.237706 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.245412 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.265611 21868 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:50.266003 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.266980 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.267745 22015 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:50.246635 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.238953 22021 raft_consensus.cc:2376] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15. Re-sending same reply.
I20260709 13:07:50.252612 22017 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:50.253297 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.255705 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.256264 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.256630 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.140496 26650 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.259305 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.230782 26658 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.280680 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.281152 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.281533 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.281843 21945 raft_consensus.cc:2410] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:50.281227 21946 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:50.292776 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.295392 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.296903 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.155535 26668 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.306118 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.307240 22017 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.261905 26654 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.320242 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.315755 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.325070 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.325608 22019 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:50.316262 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.326937 22017 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:50.331808 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.332458 22024 raft_consensus.cc:2376] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9. Re-sending same reply.
I20260709 13:07:50.333920 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.334784 22016 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:50.308122 26705 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:50.328889 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.342496 22019 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.345216 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.346482 21869 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:50.347025 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:50.347657 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.333853 26479 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:50.350735 26479 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:50.351567 26479 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:50.353441 26708 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:07:50.319576 26569 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:50.354424 26701 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:07:50.354084 26569 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.356084 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.357304 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.357767 26569 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:50.358340 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.359197 21875 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:50.375128 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.323411 26545 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:50.295420 26658 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.376847 21872 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:50.348289 21869 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.368248 26668 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:50.404538 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.414420 22016 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.414275 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.415501 22024 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:50.336560 26706 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:50.385627 26694 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:07:50.426609 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.418781 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.382387 26569 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.338145 26705 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.427551 21942 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:50.406945 26362 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.505409 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.514011 21866 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.386122 26545 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.515477 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.526649 21869 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:50.530272 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.533905 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.526868 22019 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:07:50.537623 22018 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:50.539248 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:50.540679 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 193741us
I20260709 13:07:50.420229 26706 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:50.515559 26699 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
I20260709 13:07:50.543702 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.325026 26684 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.552546 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.550382 21988 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:50.513785 26705 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.520432 26545 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.557974 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:50.512321 26569 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.561960 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.548408 26706 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.563271 21866 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:50.564419 21841 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.518795 26362 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.565565 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.566511 21866 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:50.558889 26559 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.560477 26644 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.567085 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:50.567823 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 252146us
I20260709 13:07:50.579583 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.559836 26270 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.584887 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:50.563632 26605 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.589190 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:50.568882 26663 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.589504 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.590422 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.593613 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.593025 21942 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:50.566464 26543 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:50.556381 26648 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:07:50.598254 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.599435 21944 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.591562 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:50.559790 26680 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:07:50.599126 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.608115 21942 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:50.610270 21773 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 8 to 11, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 11 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.613703 26569 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:50.612004 21773 catalog_manager.cc:5697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 8 to 11, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 11 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.591822 21866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:07:50.601603 26707 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:50.601217 26709 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:50.617762 26707 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.618000 26709 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.618295 26707 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.618577 26709 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.602155 26543 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:50.619493 26711 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:07:50.619700 26543 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.620069 26543 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.620975 26362 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:50.622228 26658 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:50.600261 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:50.587982 26479 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:50.623878 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:50.624408 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.624431 21866 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:50.626394 21866 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.594771 26718 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.627274 26270 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.627691 26270 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.628028 26270 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.629947 26658 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.630383 26658 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:50.630756 26658 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:50.631480 26625 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.004s
I20260709 13:07:50.631933 26625 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.635504 26718 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:50.635967 21949 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 17: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:50.632776 26534 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:50.636911 26625 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:50.636685 26534 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.590606 26405 consensus_queue.cc:1059] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:07:50.638114 26405 raft_consensus.cc:3055] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:50.638463 26405 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:50.638729 26534 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:50.639256 26405 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.639511 21773 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:50.641649 21874 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:50.635916 26718 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.641126 21773 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.647936 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.599766 26720 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.594516 26604 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:50.654094 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.632771 26627 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:50.641315 26633 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.002s
I20260709 13:07:50.640412 26405 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:50.586261 26559 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.651881 26659 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:50.594659 26638 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:07:50.661259 21773 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.661520 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:50.665452 26625 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:50.669389 26660 consensus_meta.cc:287] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.786s	user 0.011s	sys 0.000s
W20260709 13:07:50.662441 26485 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.001s
I20260709 13:07:50.688038 21773 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:50.692315 26559 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:50.653081 26718 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.694556 21868 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:50.699783 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.695722 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.679215 21866 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.701782 21872 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:50.708947 21773 catalog_manager.cc:5697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:50.712741 21768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 276) took 23562 ms (client timeout 15000 ms). Trace:
I20260709 13:07:50.711654 21773 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:50.644279 26639 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.716419 21773 catalog_manager.cc:5697] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 8, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 8 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.680007 26659 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.721591 21773 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:07:50.713248 21768 rpcz_store.cc:269] 0709 13:07:27.111733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.161108 (+ 49375us) service_pool.cc:224] Handling call
0709 13:07:50.673551 (+23512443us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:41.089502 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:41.093975 (+  4473us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:41.096174 (+  2199us) write_op.cc:435] Acquired schema lock
0709 13:07:41.101689 (+  5515us) tablet.cc:662] Decoding operations
0709 13:07:41.193095 (+ 91406us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:41.201027 (+  7932us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:41.206713 (+  5686us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:07:41.235698 (+ 28985us) tablet.cc:701] Row locks acquired
0709 13:07:41.235714 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:07:41.235863 (+   149us) write_op.cc:270] Start()
0709 13:07:41.235999 (+   136us) write_op.cc:276] Timestamp: P: 1783602461235816 usec, L: 0
0709 13:07:41.236015 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:07:41.236738 (+   723us) log.cc:844] Serialized 7363 byte log entry
0709 13:07:41.790854 (+554116us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b1800315ac0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:42.341197 (+550343us) op_driver.cc:464] REPLICATION: finished
0709 13:07:42.360048 (+ 18851us) write_op.cc:301] APPLY: starting
0709 13:07:42.360113 (+    65us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:42.899896 (+539783us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:42.899963 (+    67us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:43.126093 (+226130us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:43.126590 (+   497us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:07:43.126638 (+    48us) write_op.cc:312] APPLY: finished
0709 13:07:43.127316 (+   678us) log.cc:844] Serialized 172 byte log entry
0709 13:07:43.199736 (+ 72420us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.237399 (+ 37663us) write_op.cc:454] Released schema lock
0709 13:07:43.247955 (+ 10556us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:43.248747 (+   792us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.248795 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1609095,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":17300,"apply.run_cpu_time_us":39411,"apply.run_wall_time_us":888530,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77441,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":56820,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":19,"prepare.queue_time_us":319429,"prepare.run_cpu_time_us":24293,"prepare.run_wall_time_us":301040,"raft.queue_time_us":312108,"raft.run_cpu_time_us":5220,"raft.run_wall_time_us":31302,"replication_time_us":1099003,"spinlock_wait_cycles":3124480,"thread_start_us":538233,"threads_started":4,"wal-append.queue_time_us":198783,"wal-append.run_cpu_time_us":22762,"wal-append.run_wall_time_us":2341850}]]}
I20260709 13:07:50.706714 26270 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.727778 26270 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:50.697077 26627 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:50.697777 26625 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.734501 21866 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:50.697958 26719 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:50.740974 26719 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.734354 26659 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.741413 26719 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.701038 26485 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.746523 26485 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:50.757758 26627 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.763047 26659 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.675148 26633 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.766244 26633 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:50.765451 21773 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 4 to 9, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 9 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.778652 26709 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.783563 21773 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 4 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 7 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:07:50.774288 26625 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.700963 26660 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.800158 26663 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:50.823896 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:50.824831 26344 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:50.826347 26344 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.826730 26344 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.827049 26344 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.829449 26639 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:50.830479 26639 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:50.831455 26639 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:50.831779 26639 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:50.832530 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.833161 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.833740 22016 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:50.834028 22016 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:50.834740 22016 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.835630 22016 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.836879 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.833189 22018 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.850193 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.878185 22016 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:50.885510 26709 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:50.885807 21942 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:50.886880 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.888999 26659 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:50.890609 26683 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:50.891140 26683 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.893572 26658 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.894343 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.895303 26660 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:50.895706 26658 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:50.897290 26543 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.899374 26543 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:50.899518 26643 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.002s
I20260709 13:07:50.832563 26639 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.895588 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.893951 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.902089 21941 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:50.902159 21944 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:07:50.903023 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.888264 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:50.906153 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.908512 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.909255 21870 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.910813 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:50.911594 21875 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.923072 22018 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:50.869549 26559 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.901361 26639 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:50.926620 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 753785us
W20260709 13:07:50.927274 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 746841us
I20260709 13:07:50.899974 26706 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:50.925786 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:50.935513 21875 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:50.945705 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:50.947785 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:50.899984 26643 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:50.953987 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.963231 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:50.957744 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:51.014699 21944 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.963948 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:51.014048 21942 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:51.016417 26659 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:51.016485 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 52627.4us
I20260709 13:07:51.016913 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:51.017031 26659 raft_consensus.cc:697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:51.025803 21870 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:50.980721 22015 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:50.982867 22016 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:07:51.029696 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 91514.9us
I20260709 13:07:51.031800 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:51.033061 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:51.034297 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:51.029778 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 699020us
I20260709 13:07:51.029829 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:51.037241 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 925) took 1158 ms. Trace:
I20260709 13:07:51.037503 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:50.955232 26662 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:50.953868 26543 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:50.956925 26643 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:51.037719 22607 rpcz_store.cc:276] 0709 13:07:49.879114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.879269 (+   155us) service_pool.cc:224] Handling call
0709 13:07:49.879603 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.879860 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:50.049781 (+169921us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.897807 (+848026us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b1800045ca0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:07:51.012901 (+115094us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.036824 (+ 23923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.036884 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:51.036967 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.037048 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.037168 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30838,"prepare.queue_time_us":133360,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1050,"raft.queue_time_us":872790,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":5880704,"thread_start_us":268467,"threads_started":2}
I20260709 13:07:50.939200 26559 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.980549 26658 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.042384 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 105001us
I20260709 13:07:51.043859 22015 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:51.052712 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:51.054021 21870 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:51.046164 26658 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.066164 26668 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.066699 26668 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:50.980484 26545 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.069065 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:51.069691 22607 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:51.069974 22607 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:51.070565 26545 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.070688 22607 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.071979 22607 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.075179 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:51.075814 22015 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:51.076845 22015 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:50.952553 26718 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.079793 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:51.042307 26633 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:50.959829 26707 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.103318 22017 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:51.105255 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:50.955541 26705 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.109421 21873 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:51.106613 22607 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:07:51.111117 26705 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.113606 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:51.117767 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.118468 22602 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:07:51.119884 22604 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:51.120636 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.123347 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.124099 22610 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:51.037830 26229 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:07:51.130432 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64747.6us
I20260709 13:07:51.131346 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:51.132372 21872 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:51.064589 26658 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.137403 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.074447 26543 raft_consensus.cc:697] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:51.146348 21942 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:51.144840 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:51.146391 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.044960 26563 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:07:51.147537 21943 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:51.149766 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.152299 22604 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:07:51.156545 22023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2931) took 1511 ms (client timeout 1710 ms). Trace:
I20260709 13:07:51.156962 22020 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:51.160637 22023 rpcz_store.cc:269] 0709 13:07:49.645259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.645843 (+   584us) service_pool.cc:224] Handling call
0709 13:07:51.156279 (+1510436us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540025eed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:51.156472 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727295744}
I20260709 13:07:51.136006 26633 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:51.094808 26641 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:07:51.164971 22604 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:51.161479 21987 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:51.162534 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:51.166541 21943 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:51.147975 26703 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.188488 21943 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.189801 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:51.191740 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:51.192579 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:51.198707 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:51.199554 22606 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:51.200500 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.211031 26717 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.651s	user 0.000s	sys 0.004s
I20260709 13:07:51.212590 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2941) took 1063 ms. Trace:
I20260709 13:07:51.212996 22022 rpcz_store.cc:276] 0709 13:07:50.149635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.150719 (+  1084us) service_pool.cc:224] Handling call
0709 13:07:50.151105 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.165020 (+ 13915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.165049 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.198501 (+ 33452us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.314542 (+116041us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:50.314582 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.314650 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.171021 (+856371us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:51.212244 (+ 41223us) raft_consensus.cc:1685] finished
0709 13:07:51.212266 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.212519 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4705,"raft.queue_time_us":16833,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":26396,"spinlock_wait_cycles":2815872,"thread_start_us":31510,"threads_started":1,"wal-append.queue_time_us":247467}
I20260709 13:07:51.219635 26559 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:51.220335 26559 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:51.220767 26559 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.221110 26559 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.227505 26718 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.241194 26706 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.243650 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:51.244031 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:51.164789 26668 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.244777 22015 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:51.244944 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:51.245054 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:51.249678 26743 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:51.263756 21947 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:51.265352 21947 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.251286 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:51.251516 21916 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:51.254884 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.272584 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:51.272912 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:51.273406 22610 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.275398 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:51.276018 21916 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:51.276368 22018 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:51.278291 21947 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:51.279778 21947 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:51.258131 21944 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:51.298064 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:51.163630 26376 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:07:51.206343 26660 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.304522 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:51.310402 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:51.312379 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:51.320896 22023 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 9.
W20260709 13:07:51.276858 26719 consensus_meta.cc:287] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.535s	user 0.004s	sys 0.007s
I20260709 13:07:51.331528 26719 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.317030 26705 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:07:51.311650 26677 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.332890 26025 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:51.296834 26675 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.334435 21943 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:51.335672 21838 connection.cc:256] RPC call timeout handler was delayed by -1.283004779999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
I20260709 13:07:51.168108 26659 consensus_queue.cc:237] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.326599 21868 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:51.300652 22606 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:07:51.298132 26639 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:51.333316 26025 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:51.340010 21838 connection.cc:256] RPC call timeout handler was delayed by -1.1381047799999351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
I20260709 13:07:51.199615 26703 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:51.329772 26721 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:07:51.367250 21838 connection.cc:256] RPC call timeout handler was delayed by -1.01213644500001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:07:51.319512 26660 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.296494 26706 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:07:51.274468 26344 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.379793 26025 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.381661 26025 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.382432 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2119) took 1042 ms. Trace:
I20260709 13:07:51.383000 21871 rpcz_store.cc:276] 0709 13:07:50.340154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.340269 (+   115us) service_pool.cc:224] Handling call
0709 13:07:50.340807 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.341161 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.341188 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.355747 (+ 14559us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.519931 (+164184us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:50.562338 (+ 42407us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.562573 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.562638 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.247637 (+684999us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18003b5fc0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:51.382039 (+134402us) raft_consensus.cc:1685] finished
0709 13:07:51.382158 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.382340 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1119,"prepare.queue_time_us":42090,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":331,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":2647,"spinlock_wait_cycles":5417344,"thread_start_us":163568,"threads_started":1,"wal-append.queue_time_us":233034}
I20260709 13:07:51.389446 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:51.317956 26658 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:07:51.361999 26639 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.403155 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:51.400360 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 210611us
I20260709 13:07:51.408671 21944 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:51.409282 21916 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:51.413282 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.388288 26660 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:51.422659 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.313302 26543 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.397794 26725 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.364120 26675 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.407429 26639 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.386672 26677 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:07:51.413861 26545 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.416188 26486 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.447041 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.447952 22604 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:51.336131 26633 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:51.453307 26740 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:07:51.453506 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1709) took 1191 ms. Trace:
I20260709 13:07:51.454061 22020 rpcz_store.cc:276] 0709 13:07:50.261999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.267043 (+  5044us) service_pool.cc:224] Handling call
0709 13:07:51.156693 (+889650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.161169 (+  4476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.453277 (+292108us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b540025eed0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:51.453443 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045144960}
I20260709 13:07:51.459355 26750 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.461233 26745 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:07:51.463008 26520 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.463876 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2382) took 1491 ms. Trace:
I20260709 13:07:51.442291 26628 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.465437 26628 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:51.465889 26628 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.471486 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:51.474443 26714 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.475400 26703 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.425491 26376 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:51.477278 26753 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:51.480126 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:51.481649 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:51.481778 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:51.482633 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 93332.8us
I20260709 13:07:51.483286 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:51.484154 21838 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:51.419827 26641 consensus_queue.cc:1059] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:07:51.489085 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:51.492875 22610 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:51.438263 26707 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.499828 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:51.464432 21950 rpcz_store.cc:276] 0709 13:07:49.972339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.972454 (+   115us) service_pool.cc:224] Handling call
0709 13:07:49.972795 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.107526 (+134731us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:50.163349 (+ 55823us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.045209 (+881860us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b1800114ee0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c1223a 00007f635607ca2a
0709 13:07:51.160172 (+114963us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.167666 (+  7494us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.167838 (+   172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:51.167875 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.167953 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.463387 (+295434us) raft_consensus.cc:1685] finished
0709 13:07:51.463551 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.463767 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32610,"prepare.queue_time_us":22080,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":87963,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":6418,"spinlock_wait_cycles":9882880,"thread_start_us":235895,"threads_started":3,"wal-append.queue_time_us":1073867}
I20260709 13:07:51.501681 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.505795 26610 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:51.511621 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.512459 21988 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:51.514405 26676 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:51.514946 26676 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:51.515753 26676 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.517900 26675 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:51.519281 26344 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:51.501916 26384 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.534641 22604 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:51.522925 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:51.521358 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:51.528326 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:51.540006 21874 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:51.543218 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:51.543902 22604 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:51.437100 26725 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.460215 26750 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.546386 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:51.546744 22573 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:51.549460 21870 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:51.550359 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:51.551535 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:51.563354 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:51.563990 21948 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:51.566726 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 155999us
I20260709 13:07:51.567050 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:51.571642 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:51.572693 21866 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:51.537293 26675 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.574481 21950 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:51.568807 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:51.580440 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:51.583855 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:51.584759 21870 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:51.498406 26642 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:51.521628 26693 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:07:51.545460 26457 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.593816 22602 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:51.596184 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49528.9us
I20260709 13:07:51.597239 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:51.580323 26626 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.576368 26658 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.580998 26719 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.586316 26486 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:51.585028 26025 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:51.612408 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:51.588563 26705 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:51.638705 26705 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.642042 26705 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:51.616761 26610 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:51.618984 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 134859us
I20260709 13:07:51.647133 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:51.601605 26704 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:51.609647 26683 consensus_meta.cc:287] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.718s	user 0.006s	sys 0.006s
I20260709 13:07:51.611982 26626 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.648736 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:51.632350 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 195273us
I20260709 13:07:51.608184 21948 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:51.616246 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2682) took 1439 ms. Trace:
I20260709 13:07:51.595671 26457 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:51.585498 26675 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.591593 26718 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:51.610242 26641 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:51.614789 26229 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.673898 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:51.611364 26650 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:07:51.649363 26665 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:51.683629 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:51.645010 26719 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.611725 26707 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:07:51.672032 26626 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.671136 21867 rpcz_store.cc:276] 0709 13:07:50.176921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.180099 (+  3178us) service_pool.cc:224] Handling call
0709 13:07:50.180393 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.180624 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:51.473594 (+1292970us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b1800462f40. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf
0709 13:07:51.473790 (+   196us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.615907 (+142117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.615958 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:51.616011 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.616085 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.616194 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65176,"prepare.queue_time_us":79977,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"spinlock_wait_cycles":2670464,"thread_start_us":210419,"threads_started":2}
I20260709 13:07:51.683555 21987 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:51.683190 26625 consensus_meta.cc:287] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.003s
I20260709 13:07:51.617441 26658 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:51.693053 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 146314us
I20260709 13:07:51.692997 21866 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:51.697605 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:51.690519 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:51.674568 26457 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.643560 26486 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.648615 26025 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.671250 26683 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.722415 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:51.728128 21944 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
W20260709 13:07:51.732034 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 163174us
W20260709 13:07:51.720783 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 123786us
I20260709 13:07:51.684784 26758 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:51.682884 26641 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.733551 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:51.734477 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:51.741612 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:51.741851 21941 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:51.727533 26313 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:51.710394 26625 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.747483 21916 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:51.758133 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 177801us
W20260709 13:07:51.745760 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 197620us
I20260709 13:07:51.759759 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:51.740609 26756 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:51.724985 26693 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:07:51.845913 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 197270us
W20260709 13:07:51.945638 26761 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:07:51.842717 26683 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.833999 26707 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.753638 26718 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.764498 26725 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.832953 26775 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:51.831346 26752 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:07:51.977825 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2945) took 1016 ms. Trace:
I20260709 13:07:51.978904 26683 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.920423 26755 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:07:51.978380 22019 rpcz_store.cc:276] 0709 13:07:50.961670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.961809 (+   139us) service_pool.cc:224] Handling call
0709 13:07:51.027690 (+ 65881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.107130 (+ 79440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.107160 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.131047 (+ 23887us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.428733 (+297686us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:51.428773 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.517024 (+ 88251us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54001f18d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:51.517080 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.977425 (+460345us) raft_consensus.cc:1685] finished
0709 13:07:51.977458 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.977743 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17154,"raft.queue_time_us":5416,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9265,"spinlock_wait_cycles":170628480,"thread_start_us":261066,"threads_started":1,"wal-append.queue_time_us":387769}
I20260709 13:07:52.014298 26641 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.934376 26750 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.842989 26626 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:52.025283 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 446656us
I20260709 13:07:51.765298 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:51.890129 21949 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:51.833073 26774 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:51.842695 26486 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:51.839866 26628 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:51.760169 26714 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:51.745270 26719 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.741267 26758 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:51.840741 26658 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:51.838873 26025 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:51.942162 26679 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:51.837291 26759 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:51.841293 26771 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:51.881505 26756 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:51.973512 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:52.020682 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 312628us
I20260709 13:07:52.062965 21988 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:52.032852 26774 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:07:52.031236 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 268965us
W20260709 13:07:52.054720 26559 consensus_meta.cc:287] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.003s
W20260709 13:07:52.025511 26676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.014s
W20260709 13:07:52.043871 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 278650us
I20260709 13:07:52.046087 21945 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:51.949210 26639 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.049593 22604 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.004136 26683 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.031147 26762 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:52.064273 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:51.746229 26763 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:07:52.038765 26675 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:52.032202 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 286085us
I20260709 13:07:52.044438 26725 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:52.035666 26313 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:52.049425 26486 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:52.077962 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:07:52.122148 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 44273.7us
I20260709 13:07:52.046087 26765 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.066664 26693 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.084530 26787 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:52.056311 26679 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:52.077466 26676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.014s	sys 0.015s
I20260709 13:07:52.074321 26774 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.106809 26658 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.048429 26714 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:52.170801 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 197408us
I20260709 13:07:52.107545 26025 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.107215 26719 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.081321 26559 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.175766 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 783) took 1126 ms. Trace:
I20260709 13:07:52.175617 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:52.177104 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 110172us
I20260709 13:07:52.178925 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:52.178148 21875 rpcz_store.cc:276] 0709 13:07:51.049197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.050049 (+   852us) service_pool.cc:224] Handling call
0709 13:07:51.050490 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:51.050976 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.051018 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:51.059393 (+  8375us) log.cc:844] Serialized 52 byte log entry
0709 13:07:51.451622 (+392229us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b1800376840. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:07:51.607409 (+155787us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:51.607463 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.607562 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.165612 (+558050us) raft_consensus.cc:1685] finished
0709 13:07:52.165631 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.175703 (+ 10072us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1061,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":31776000,"thread_start_us":155513,"threads_started":1,"wal-append.queue_time_us":665580}
I20260709 13:07:52.119184 26625 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.132701 26693 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:52.149379 26787 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.185729 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 686) took 1110 ms. Trace:
I20260709 13:07:52.190702 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:52.134877 26543 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.148942 26486 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:52.149866 26765 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:52.206072 26783 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:07:52.206362 26693 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.206830 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:52.134047 26642 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:07:52.092152 26762 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.208513 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:52.209970 26762 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.212549 26780 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:52.213106 26780 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.213472 26780 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.210003 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:52.214962 26628 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.215700 26313 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.181449 26658 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.208305 26758 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.219106 26658 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.118726 26725 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.221333 26784 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:52.221801 26786 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.222231 26784 consensus_queue.cc:1243] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:52.222460 26725 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.222723 26784 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.223078 26725 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.223483 26779 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.223280 26784 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.223940 26779 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:52.223613 26725 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:52.224231 26660 consensus_meta.cc:287] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.000s
I20260709 13:07:52.185184 26707 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:52.224963 26779 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.225970 26626 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.226243 26779 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.185699 26719 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:52.227982 26520 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.007s
I20260709 13:07:52.229010 26719 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.185930 26025 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.196877 26787 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.231714 26025 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.223284 26786 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.233775 26559 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:52.235522 26683 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.240164 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:52.193893 21947 rpcz_store.cc:276] 0709 13:07:51.075057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.290998 (+215941us) service_pool.cc:224] Handling call
0709 13:07:51.291354 (+   356us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:51.293052 (+  1698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.293084 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:51.293779 (+   695us) log.cc:844] Serialized 78 byte log entry
0709 13:07:51.436066 (+142287us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:51.449266 (+ 13200us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.449492 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.449567 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.185501 (+735934us) raft_consensus.cc:1685] finished
0709 13:07:52.185523 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.185669 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24488,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":4305,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":16838,"thread_start_us":103197,"threads_started":1,"wal-append.queue_time_us":296326}
I20260709 13:07:52.242561 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:52.243443 21947 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:07:52.248096 21947 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.132638 26750 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:52.251910 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:52.257903 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:52.260550 26628 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:07:52.262292 26643 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.224963 26707 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.263754 26774 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.264518 26714 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.250404 26670 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.266577 26639 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.253087 26660 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:52.266955 26772 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:07:52.267765 26765 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:52.268851 26742 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.059s	user 0.004s	sys 0.000s
I20260709 13:07:52.270205 26784 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.272310 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:52.188375 26344 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:07:52.279914 26683 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.274027 26486 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.292649 26707 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.280123 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:52.250451 26625 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:52.299371 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.331593 21947 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.278280 26315 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.184443 26756 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.309741 26754 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:07:52.310288 26780 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.311923 26660 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:52.289924 26543 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:52.289661 26520 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:52.279285 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 215095us
I20260709 13:07:52.357506 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:52.307174 26771 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:52.295821 26643 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.318393 26787 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.360240 21947 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:52.365260 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:52.365520 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:52.366291 21947 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.330711 26683 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.375495 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:52.376678 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:52.376794 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:52.378358 22024 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:52.377306 21871 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:52.355074 26776 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:52.382786 26795 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:52.400202 22018 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.383208 26763 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.383358 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:52.384020 26802 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.384073 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:52.384852 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:52.376086 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:52.346730 26315 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.389386 26643 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.390287 26771 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.392071 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:52.417973 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:52.419003 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:52.356822 26520 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.361734 26670 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.394959 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:52.395709 22020 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.380038 26801 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:52.403533 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:52.404902 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:52.408747 21868 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:52.401889 26725 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.423158 21916 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:52.437955 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 247322us
I20260709 13:07:52.398458 21947 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:52.454682 22022 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:07:52.406798 26457 consensus_meta.cc:287] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.003s
I20260709 13:07:52.391402 26660 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:52.402383 26344 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:52.407007 26791 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.423396 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:52.472494 22021 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.455683 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:52.432523 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:52.474732 22018 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:52.449083 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:52.457763 21987 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:52.458671 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:52.477269 21947 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:52.439040 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 263530us
I20260709 13:07:52.478895 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:52.468930 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47326.7us
I20260709 13:07:52.480564 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:52.435163 26520 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.425770 26765 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.438773 26643 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.497345 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:52.434543 26670 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:52.489823 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:52.459815 26025 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.491639 26559 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:52.445740 26543 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.494377 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2391) took 1623 ms. Trace:
I20260709 13:07:52.495635 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:52.433992 26802 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:52.452029 26801 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.504822 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:52.409206 26795 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.517099 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:52.528422 21872 raft_consensus.cc:2410] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:52.528134 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:52.410976 26763 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.495234 26313 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:52.525005 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:52.534515 21871 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.477715 26719 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:07:52.538059 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:52.470402 26788 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:52.406599 26776 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.544811 26663 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.545871 26790 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.519738 21942 rpcz_store.cc:276] 0709 13:07:50.870674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.038957 (+168283us) service_pool.cc:224] Handling call
0709 13:07:51.048460 (+  9503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.147811 (+ 99351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.494194 (+1346383us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b5400298954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:52.494332 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224633600}
I20260709 13:07:52.529852 26670 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.498793 26775 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.499800 26658 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.555392 21871 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:52.506167 26643 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.489506 26725 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.511021 26628 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.559862 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:52.482860 26758 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:52.539325 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:52.531002 26779 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.483436 26344 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.481024 26660 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.481647 26457 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.541972 21875 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.542619 26773 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.542670 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:52.543453 26763 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.543874 26313 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:52.544490 26788 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.538216 26025 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.537362 26774 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.564522 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:52.546736 26776 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.578797 21867 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.570838 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:52.560930 26643 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.546442 26790 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.561731 26718 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.594954 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:52.597245 21875 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:07:52.575675 26663 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.572194 26802 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.605571 21838 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:52.606772 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:52.607831 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:52.584664 26670 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.576713 26773 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.610769 22021 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:52.601958 22603 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.612941 26627 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.614318 26629 raft_consensus.cc:3055] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.614758 26629 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:52.585228 26025 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.593318 26780 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:52.615664 26629 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.617813 26809 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:52.618359 26800 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.598614 26787 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:52.609014 26683 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.616757 26663 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.627934 21867 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:52.631278 26790 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.639386 26795 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.619438 26773 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.620251 26025 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.611238 26774 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.632290 26313 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.634207 26457 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.637473 26801 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.623078 26809 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.624866 26800 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:52.602336 26718 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:52.646888 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2957) took 1404 ms. Trace:
I20260709 13:07:52.657225 22022 rpcz_store.cc:276] 0709 13:07:51.242742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.250708 (+  7966us) service_pool.cc:224] Handling call
0709 13:07:52.646645 (+1395937us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540017a7d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:52.646808 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729542400}
I20260709 13:07:52.641934 26629 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:52.672689 26805 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:52.674695 26344 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.676173 26788 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.663177 26800 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.680691 22606 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:52.655308 26809 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.681852 26707 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.683000 26660 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.695578 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:52.697759 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:52.689101 26718 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.704522 26520 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.697217 26670 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.726046 26789 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.577s	user 0.002s	sys 0.000s
I20260709 13:07:52.729190 26642 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.729852 26642 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:52.730944 26642 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.733604 26520 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:52.735150 26679 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.741339 26709 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.741652 26770 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.741896 26709 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:52.742059 26770 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:52.732533 26642 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.763613 26770 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.772080 26770 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.744930 26679 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.746995 26718 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.779826 26707 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:52.769044 26709 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.781776 26709 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.782001 26804 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:52.782565 26804 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:52.783471 26804 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.787256 26804 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.794605 26762 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.795934 26762 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:52.796931 26762 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.798434 26762 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.800640 26792 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:52.801192 26792 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:52.803555 26792 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:52.805431 26792 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.876744 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.824132 26809 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.919773 26809 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:53.028520 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.028703 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.029670 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.030553 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.810801 26773 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:52.816552 26800 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:53.097566 21916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.009s	sys 0.022s
I20260709 13:07:52.745240 26670 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:53.089315 21914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.016s	sys 0.003s
W20260709 13:07:53.101095 21916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.009s	sys 0.023s
W20260709 13:07:53.105432 21873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.003s	sys 0.011s
W20260709 13:07:53.106148 21914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.017s	sys 0.003s
I20260709 13:07:53.107000 26643 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:53.115302 21988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.018s
W20260709 13:07:53.115345 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 618002us
W20260709 13:07:53.116158 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.000s	sys 0.019s
I20260709 13:07:53.121025 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.121660 22023 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:53.122603 26665 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.406s	user 0.026s	sys 0.029s
W20260709 13:07:53.125903 26665 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.413s	user 0.026s	sys 0.029s
I20260709 13:07:53.126444 26773 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:53.126461 26665 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:53.127651 22024 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:53.127547 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:53.123517 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:53.135831 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 640222us
W20260709 13:07:53.136178 21987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.011s
W20260709 13:07:53.136581 21987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.009s	sys 0.012s
I20260709 13:07:53.137596 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 690) took 2060 ms. Trace:
I20260709 13:07:53.138085 21945 rpcz_store.cc:276] 0709 13:07:51.077007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.371523 (+294516us) service_pool.cc:224] Handling call
0709 13:07:51.379727 (+  8204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.077830 (+698103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.136855 (+1059025us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54000fdf54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:53.137284 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531967360}
I20260709 13:07:53.139287 26670 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:53.140640 26756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.023s	sys 0.031s
W20260709 13:07:53.141199 26756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.023s	sys 0.031s
I20260709 13:07:53.141968 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2389) took 2271 ms. Trace:
W20260709 13:07:53.135888 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 232766us
I20260709 13:07:53.145371 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.147811 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.148937 21867 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
W20260709 13:07:53.150753 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.151643 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.153322 26769 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.142915 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.142477 21941 rpcz_store.cc:276] 0709 13:07:50.870195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.963458 (+ 93263us) service_pool.cc:224] Handling call
0709 13:07:51.028375 (+ 64917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.753454 (+725079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.141371 (+1387917us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54003ffa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:53.141742 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640366464}
I20260709 13:07:53.105626 26725 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:53.116178 26643 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:53.182053 21941 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:53.182876 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2411) took 1008 ms. Trace:
I20260709 13:07:53.183236 21941 rpcz_store.cc:276] 0709 13:07:52.174345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.180857 (+1006512us) service_pool.cc:224] Handling call
0709 13:07:53.181453 (+   596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.182546 (+  1093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.182781 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.184170 26625 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:53.184506 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:53.185173 26625 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.188998 26703 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:53.189500 26779 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:53.189924 26703 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.190595 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.190421 26779 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.191463 22021 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:53.189703 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2408) took 1016 ms. Trace:
I20260709 13:07:53.185674 21870 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:53.199124 26725 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.199882 22601 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:07:53.201682 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.203577 26756 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.204454 26756 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.205299 26725 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:53.206125 21866 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:53.207773 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:53.208326 26796 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:53.192412 21947 rpcz_store.cc:276] 0709 13:07:52.173587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.482436 (+308849us) service_pool.cc:224] Handling call
0709 13:07:52.482784 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.483029 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:52.652246 (+169217us) log.cc:844] Serialized 14 byte log entry
0709 13:07:53.188970 (+536724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.189098 (+   128us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:53.189202 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.189277 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.189496 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86224,"prepare.queue_time_us":146584,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":89847,"thread_start_us":350665,"threads_started":2,"wal-append.queue_time_us":445371}
I20260709 13:07:53.209448 26796 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.213490 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:53.214499 21947 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:53.215806 26559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.022s	sys 0.023s
W20260709 13:07:53.192780 26486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.020s	sys 0.018s
I20260709 13:07:53.216809 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:53.332155 26486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.024s	sys 0.018s
I20260709 13:07:53.332518 21871 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
W20260709 13:07:53.225178 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.334237 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.337077 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:53.337479 21941 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:53.337939 22021 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.338248 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2412) took 1163 ms. Trace:
I20260709 13:07:53.338634 21941 rpcz_store.cc:276] 0709 13:07:52.174600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.184131 (+1009531us) service_pool.cc:224] Handling call
0709 13:07:53.267538 (+ 83407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.337961 (+ 70423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.338157 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.339792 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:53.341674 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 738) took 1895 ms. Trace:
I20260709 13:07:53.342116 22602 rpcz_store.cc:276] 0709 13:07:51.446391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.446538 (+   147us) service_pool.cc:224] Handling call
0709 13:07:51.446912 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.594320 (+147408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.341104 (+1746784us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400662e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:53.341479 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336760064}
I20260709 13:07:53.347191 21942 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:53.349020 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2409) took 1175 ms. Trace:
I20260709 13:07:53.349431 21942 rpcz_store.cc:276] 0709 13:07:52.173871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.570511 (+396640us) service_pool.cc:224] Handling call
0709 13:07:52.593836 (+ 23325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.347813 (+753977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.348689 (+   876us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54001405d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:53.348941 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731308288}
I20260709 13:07:53.350757 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:53.212627 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:53.205350 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:53.334239 26802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.012s	sys 0.023s
W20260709 13:07:53.353778 26802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.012s	sys 0.024s
I20260709 13:07:53.332566 26800 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:53.354991 26315 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:53.224452 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.174790 26670 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:53.324926 26779 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:53.336427 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:07:53.325768 26792 consensus_meta.cc:287] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.011s
W20260709 13:07:53.328904 26543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.008s	sys 0.024s
I20260709 13:07:53.329916 26756 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:53.342118 26703 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:53.355835 26820 consensus_queue.cc:1059] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:53.357717 26798 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:53.129153 26665 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.361729 26804 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.222553 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.404104 21947 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:07:53.301458 26625 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:53.371804 26559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.029s	sys 0.034s
W20260709 13:07:53.352144 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 224957us
W20260709 13:07:53.427371 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.443441 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2410) took 1260 ms. Trace:
W20260709 13:07:53.417101 26543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.009s	sys 0.024s
I20260709 13:07:53.423226 26780 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:53.409461 26376 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:53.430670 26725 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.460024 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:53.479974 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.461098 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:53.452711 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 196253us
I20260709 13:07:53.446317 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2974) took 1029 ms. Trace:
I20260709 13:07:53.460879 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:53.461938 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.506253 22018 rpcz_store.cc:276] 0709 13:07:52.408954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.475715 (+ 66761us) service_pool.cc:224] Handling call
0709 13:07:53.335994 (+860279us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b5800200498. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:07:53.437191 (+101197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12642048}
W20260709 13:07:53.502297 26709 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.720s	user 0.008s	sys 0.010s
I20260709 13:07:53.514834 26705 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:53.465770 26770 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.012s
I20260709 13:07:53.409461 26802 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:07:53.465174 26798 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:53.444034 21945 rpcz_store.cc:276] 0709 13:07:52.174118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.139691 (+965573us) service_pool.cc:224] Handling call
0709 13:07:53.140468 (+   777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.144786 (+  4318us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:53.145285 (+   499us) log.cc:844] Serialized 14 byte log entry
0709 13:07:53.408302 (+263017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.408527 (+   225us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:53.432504 (+ 23977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.434240 (+  1736us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.434477 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17324,"prepare.queue_time_us":9542,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":4120,"raft.queue_time_us":35798,"thread_start_us":226493,"threads_started":1}
I20260709 13:07:53.455402 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.470070 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:53.455152 26762 consensus_meta.cc:287] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.016s
I20260709 13:07:53.460170 26800 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:53.498939 26376 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:53.458156 26706 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:53.465247 26820 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:53.466336 26821 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.554194 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:53.555104 21871 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.439520 26643 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:07:53.562191 21941 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:53.533555 26798 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:53.565506 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:53.551682 26820 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:53.581312 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.585638 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.583177 21945 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:53.469760 26315 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:07:53.591156 21872 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:53.534468 26670 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.605865 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.611589 26709 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.568614 26625 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.614112 26709 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.579401 26773 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.624826 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:53.571393 26725 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.626447 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:53.589792 26762 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.638657 26625 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:53.643344 22023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2971) took 1241 ms (client timeout 1596 ms). Trace:
W20260709 13:07:53.643617 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.643946 21950 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:53.644407 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.582528 26804 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.653427 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2157) took 1121 ms. Trace:
W20260709 13:07:53.646829 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 176889us
I20260709 13:07:53.654462 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:53.650367 22023 rpcz_store.cc:269] 0709 13:07:52.402983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.403256 (+   273us) service_pool.cc:224] Handling call
0709 13:07:53.638893 (+1235637us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540017c5d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:53.643255 (+  4362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575957248}
I20260709 13:07:53.602728 26800 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.660254 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:53.665469 22018 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 8: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:53.656453 21866 rpcz_store.cc:276] 0709 13:07:52.523040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.532309 (+  9269us) service_pool.cc:224] Handling call
0709 13:07:53.205539 (+673230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.206741 (+  1202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.644734 (+437993us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54003764d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:53.644875 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511081856}
I20260709 13:07:53.585534 26705 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.623867 26792 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:53.635812 26796 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:53.674583 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.676013 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2973) took 1271 ms. Trace:
I20260709 13:07:53.676478 26625 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:53.677416 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2966) took 1299 ms. Trace:
I20260709 13:07:53.676416 22015 rpcz_store.cc:276] 0709 13:07:52.404787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.404902 (+   115us) service_pool.cc:224] Handling call
0709 13:07:52.405166 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.405370 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:52.409899 (+  4529us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.802305 (+392406us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b18004273c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f85557 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:53.675042 (+872737us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b18004273c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c1223a
0709 13:07:53.675424 (+   382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.675508 (+    84us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:53.675606 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.675699 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.675845 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5069,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":6828,"spinlock_wait_cycles":27141888,"thread_start_us":49424,"threads_started":1,"wal-append.queue_time_us":160332}
I20260709 13:07:53.677856 26709 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:53.677819 22020 rpcz_store.cc:276] 0709 13:07:52.377758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.379296 (+  1538us) service_pool.cc:224] Handling call
0709 13:07:52.379623 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.426253 (+ 46630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.676965 (+1250712us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b54004187d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:53.677243 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36418304}
I20260709 13:07:53.678903 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.679293 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.680492 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:53.681895 22015 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.682313 22606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 745) took 1131 ms. Trace:
I20260709 13:07:53.682776 22606 rpcz_store.cc:276] 0709 13:07:52.551199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.551396 (+   197us) service_pool.cc:224] Handling call
0709 13:07:53.681992 (+1130596us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54005d02d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:53.682137 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275895168}
W20260709 13:07:53.683951 26718 consensus_meta.cc:287] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.899s	user 0.004s	sys 0.021s
I20260709 13:07:53.686645 21942 raft_consensus.cc:2410] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:53.686992 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.688475 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.692131 26797 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:53.680809 26313 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:53.695082 26313 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:53.639355 26706 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.702409 26706 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:53.705209 21947 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:53.708446 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 247717us
I20260709 13:07:53.709544 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:53.710575 26804 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:53.710988 26676 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.711218 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:53.687851 26376 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.717301 26376 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.717818 26725 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:53.681452 26798 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.643692 26773 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.721621 26798 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.722771 26773 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:53.714380 26779 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.670650 26762 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:53.715441 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 73725.9us
I20260709 13:07:53.713449 26820 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.672549 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 698) took 1426 ms. Trace:
I20260709 13:07:53.772991 21941 rpcz_store.cc:276] 0709 13:07:52.240743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.608333 (+1367590us) service_pool.cc:224] Handling call
0709 13:07:53.658805 (+ 50472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.666299 (+  7494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.666335 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:53.666388 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:53.666427 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.666495 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.666603 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:53.773029 21872 raft_consensus.cc:2410] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:53.742312 22021 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:07:53.676190 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.757071 21871 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:53.658829 26770 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:53.680117 22020 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:53.634966 26315 consensus_queue.cc:1243] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:07:53.799109 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:53.803671 26818 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.722795 26650 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.804580 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.805431 26820 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.806744 26705 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:53.793798 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 126578us
I20260709 13:07:53.636829 26821 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:53.692169 26025 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.041s	user 0.007s	sys 0.007s
W20260709 13:07:53.812826 26642 consensus_meta.cc:287] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.031s	user 0.002s	sys 0.015s
I20260709 13:07:53.817857 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.816713 21868 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
W20260709 13:07:53.822106 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.696178 26313 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.785187 26770 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:53.832307 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:53.831835 26792 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:07:53.840854 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:53.831748 26025 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.841130 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:53.840448 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:53.853960 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.692976 26797 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:53.840363 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:53.834702 21916 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.596s (SENT) [suppressed 34 similar messages]
I20260709 13:07:53.778237 26779 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:53.868644 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:53.836220 26770 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.881085 22018 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.883425 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:53.888201 22606 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.844767 26703 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:53.804467 26818 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:53.903180 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.905417 21941 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:53.910478 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.911047 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.926612 21866 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:53.928117 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.928324 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.928453 22015 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:07:53.929270 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.933887 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:53.934351 22021 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:53.937610 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2141) took 2343 ms. Trace:
I20260709 13:07:53.939306 26818 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:53.938128 21874 rpcz_store.cc:276] 0709 13:07:51.541999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.547487 (+  5488us) service_pool.cc:224] Handling call
0709 13:07:51.547929 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.729073 (+181144us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:51.749504 (+ 20431us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.040387 (+290883us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.052070 (+ 11683us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.052261 (+   191us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.052314 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.234953 (+182639us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b18003cc1c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:53.829688 (+1594735us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b5400375fd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:53.839346 (+  9658us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.865729 (+ 26383us) raft_consensus.cc:1685] finished
0709 13:07:53.865753 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.885141 (+ 19388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7055,"prepare.queue_time_us":11226,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":269216,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":205,"spinlock_wait_cycles":92918272,"thread_start_us":417373,"threads_started":2,"wal-append.queue_time_us":304029,"wal-append.run_cpu_time_us":2984,"wal-append.run_wall_time_us":1150020}
I20260709 13:07:53.941256 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.943118 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:53.944411 26821 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:53.933907 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.954761 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.955204 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.956000 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.943128 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.936141 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:53.932478 21871 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:53.965492 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.968552 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.974377 21872 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:53.983280 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 50120.7us
I20260709 13:07:53.986565 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:53.967679 26642 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.999534 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.001358 26797 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.003412 22022 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:07:54.004850 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 137123us
I20260709 13:07:54.007167 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:54.007948 26797 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:53.963213 26796 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:54.008742 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.009068 26796 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.009572 21941 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:54.010615 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:54.011478 21941 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.011853 26825 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.012390 26825 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:54.012568 26823 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:53.964843 26703 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.013032 26823 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:54.008860 26670 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.014917 26703 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.014236 26823 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.017717 26823 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.019776 26780 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:54.012459 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.022498 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1724) took 3007 ms. Trace:
I20260709 13:07:54.023386 22018 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:54.012850 26825 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.023696 26559 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:54.024875 22015 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
W20260709 13:07:54.025313 21944 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2407) took 2237 ms (client timeout 2151 ms). Trace:
I20260709 13:07:54.025735 26642 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:54.026551 26545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.693s	user 0.009s	sys 0.032s
I20260709 13:07:54.001394 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:54.041774 22606 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:53.988199 26834 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:54.042976 21944 rpcz_store.cc:269] 0709 13:07:51.698174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.699100 (+   926us) service_pool.cc:224] Handling call
0709 13:07:53.899803 (+2200703us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5400279cd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:53.935380 (+ 35577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372992}
I20260709 13:07:54.050055 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.026582 26762 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.050899 22606 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:54.033331 26780 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:54.046857 26545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.785s	user 0.009s	sys 0.033s
I20260709 13:07:54.054489 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.042348 26559 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:54.063696 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.051631 26025 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.034065 22016 rpcz_store.cc:276] 0709 13:07:51.015432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.034129 (+ 18697us) service_pool.cc:224] Handling call
0709 13:07:51.036710 (+  2581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.657234 (+620524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.657284 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.674350 (+ 17066us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.229800 (+555450us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b180042fd60. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:07:52.333961 (+104161us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:52.337069 (+  3108us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.337286 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.021961 (+1684675us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540017b1d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:54.022044 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.022111 (+    67us) raft_consensus.cc:1685] finished
0709 13:07:54.022124 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.022306 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33054,"prepare.queue_time_us":3104,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":56117,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":27213,"spinlock_wait_cycles":1403174528,"thread_start_us":103968,"threads_started":1,"wal-append.queue_time_us":785789,"wal-append.run_cpu_time_us":3444,"wal-append.run_wall_time_us":1194848}
I20260709 13:07:54.058418 26650 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.071770 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.082665 22015 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:07:54.083283 22015 pending_rounds.cc:85] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 7
I20260709 13:07:54.064559 26762 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:54.095947 22606 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:54.090796 21941 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.091657 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.066690 26800 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.098272 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.094579 22607 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:07:54.102698 26559 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.104066 26559 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.087734 22015 pending_rounds.cc:107] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:07:54.105099 22015 raft_consensus.cc:2889] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.099066 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:54.086652 26756 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.111089 26642 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:54.111658 21948 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:54.113054 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.113873 21948 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:54.056841 26834 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.121573 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:54.122414 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.081317 26725 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:54.123971 21941 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:07:54.118145 26779 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.129594 22610 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:07:54.135051 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:54.136013 26796 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.137710 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2383) took 3235 ms. Trace:
I20260709 13:07:54.138162 21949 rpcz_store.cc:276] 0709 13:07:50.860396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.861266 (+   870us) service_pool.cc:224] Handling call
0709 13:07:50.861569 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.030828 (+1169259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.051929 (+2021101us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540012fa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:54.095890 (+ 43961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364817664}
I20260709 13:07:54.139955 21949 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:54.147795 26629 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.115993 26780 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.117120 26762 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.153539 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:54.129940 26679 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.261s	user 0.015s	sys 0.002s
I20260709 13:07:54.138162 21948 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:07:54.156340 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.155146 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2419) took 1756 ms. Trace:
I20260709 13:07:54.158149 21944 rpcz_store.cc:276] 0709 13:07:52.393033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.128209 (+1735176us) service_pool.cc:224] Handling call
0709 13:07:54.148423 (+ 20214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.148699 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.148727 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.148766 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:54.148801 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.148879 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.149027 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.161204 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.122915 26756 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.157658 21948 pending_rounds.cc:85] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 5
I20260709 13:07:54.166206 21948 pending_rounds.cc:107] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:54.136804 26662 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:54.166594 21948 raft_consensus.cc:2889] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.161990 21869 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:07:54.164989 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2420) took 1759 ms. Trace:
I20260709 13:07:54.167443 21949 rpcz_store.cc:276] 0709 13:07:52.393381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.139291 (+1745910us) service_pool.cc:224] Handling call
0709 13:07:54.139713 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.140438 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.153115 (+ 12677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.148423 26629 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.174129 21941 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.177090 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.180269 26796 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:54.181588 26796 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.181960 26796 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:54.183009 26796 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.184331 26796 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.176079 22017 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:54.185141 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.185778 26825 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.191558 26770 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.192885 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:54.199533 21869 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.192993 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.196916 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2418) took 1786 ms. Trace:
I20260709 13:07:54.197433 21866 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:54.196964 22607 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:54.204133 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.205180 21866 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.200289 21874 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
W20260709 13:07:54.202888 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 326309us
I20260709 13:07:54.201447 21948 rpcz_store.cc:276] 0709 13:07:52.392301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.114920 (+1722619us) service_pool.cc:224] Handling call
0709 13:07:54.137775 (+ 22855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.177917 (+ 40142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.178178 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.168342 26662 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:54.212422 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 377739us
I20260709 13:07:54.217432 22610 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:54.218904 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:54.195014 26780 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.210637 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.217705 22574 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:54.230369 22602 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.230674 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.199000 26792 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.232558 21941 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:54.198593 26679 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:54.234974 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.238935 21868 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.239529 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2426) took 1053 ms. Trace:
I20260709 13:07:54.239924 21941 rpcz_store.cc:276] 0709 13:07:53.185881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.175071 (+989190us) service_pool.cc:224] Handling call
0709 13:07:54.200869 (+ 25798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.239281 (+ 38412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.239476 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.239377 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:54.242274 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45949.5us
I20260709 13:07:54.194489 26725 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.247028 21948 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.248019 26629 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.248210 21874 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:54.248468 21948 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:54.249192 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2427) took 1063 ms. Trace:
W20260709 13:07:54.249974 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.251415 21874 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:54.253283 26662 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.254484 26662 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:54.256148 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.256536 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.257272 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.258399 26825 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.258613 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:54.260864 26770 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.241720 26818 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.262159 26818 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.264552 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.249567 21948 rpcz_store.cc:276] 0709 13:07:53.186232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.247772 (+1061540us) service_pool.cc:224] Handling call
0709 13:07:54.248133 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.248915 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.249111 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.252326 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.267714 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:54.267849 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 150285us
I20260709 13:07:54.271957 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:54.271916 22607 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:54.274369 21866 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:07:54.277110 21944 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:54.279286 21941 raft_consensus.cc:2393] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.280555 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2421) took 1886 ms. Trace:
I20260709 13:07:54.281034 21944 rpcz_store.cc:276] 0709 13:07:52.393729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.167867 (+1774138us) service_pool.cc:224] Handling call
0709 13:07:54.230047 (+ 62180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.280396 (+ 50349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.280517 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.272850 26642 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.238071 26792 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.294225 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:54.296934 26843 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:07:54.277858 26770 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.274813 26762 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.301802 21944 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.298017 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.298137 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.309165 21839 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:54.310977 26847 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:54.312901 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2405) took 2615 ms. Trace:
W20260709 13:07:54.313953 26850 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:07:54.314599 26779 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:54.315231 26779 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:54.315898 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:54.316299 26779 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.318166 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.320909 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.322268 26025 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:54.330181 26725 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.330626 21941 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:54.331058 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2424) took 1146 ms. Trace:
I20260709 13:07:54.331277 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2414) took 2136 ms. Trace:
I20260709 13:07:54.331357 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2430) took 1144 ms. Trace:
I20260709 13:07:54.332057 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 616) took 1210 ms. Trace:
I20260709 13:07:54.332512 22021 rpcz_store.cc:276] 0709 13:07:53.122166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.789498 (+667332us) service_pool.cc:224] Handling call
0709 13:07:53.929325 (+139827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.934802 (+  5477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.331860 (+397058us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540005d550. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:54.331979 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317492096}
I20260709 13:07:54.330214 21867 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:54.281258 26804 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.331864 21941 rpcz_store.cc:276] 0709 13:07:53.187336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.279884 (+1092548us) service_pool.cc:224] Handling call
0709 13:07:54.292828 (+ 12944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.331093 (+ 38265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.331286 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.334787 26834 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.335371 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.335521 26563 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:54.335973 26563 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:54.336352 26563 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:54.336802 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.339389 26650 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:54.339996 26650 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.342043 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.342137 22018 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:07:54.342644 22018 pending_rounds.cc:85] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 8
I20260709 13:07:54.343140 22018 pending_rounds.cc:107] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:54.343484 22018 raft_consensus.cc:2889] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.313328 21950 rpcz_store.cc:276] 0709 13:07:51.697480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.698363 (+   883us) service_pool.cc:224] Handling call
0709 13:07:51.698745 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.660724 (+1961979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.312640 (+651916us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400163354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:54.312842 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3509723008}
I20260709 13:07:54.346141 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.346771 21950 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:54.347316 26563 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.348423 22601 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 8.
I20260709 13:07:54.349227 26756 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:54.349146 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 49782.2us
I20260709 13:07:54.350349 26563 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.353837 21866 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:54.355460 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.268486 26679 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.359288 26679 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.285542 26705 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:07:54.360399 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2429) took 1173 ms. Trace:
I20260709 13:07:54.360989 21948 rpcz_store.cc:276] 0709 13:07:53.186943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.265918 (+1078975us) service_pool.cc:224] Handling call
0709 13:07:54.279198 (+ 13280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.359896 (+ 80698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.359940 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.360027 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.360078 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.360166 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.360313 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.342703 21942 rpcz_store.cc:276] 0709 13:07:53.185071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.350463 (+165392us) service_pool.cc:224] Handling call
0709 13:07:54.330802 (+980339us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b540019cb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:54.330974 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770328448}
I20260709 13:07:54.331738 21947 rpcz_store.cc:276] 0709 13:07:52.195323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.544445 (+1349122us) service_pool.cc:224] Handling call
0709 13:07:53.606709 (+ 62264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.705801 (+ 99092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.331050 (+625249us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b5400299854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:54.331216 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225868672}
W20260709 13:07:54.368984 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.369565 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.370043 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.370837 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.377542 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.381209 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.381664 21869 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:54.342636 21941 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:54.389384 21868 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:54.391494 21947 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:54.391523 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.395606 21871 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:54.391388 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.398442 21942 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:54.397199 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.390720 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:54.401927 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.405110 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:54.402839 21870 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:54.409409 21944 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:54.412680 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47491.8us
W20260709 13:07:54.419121 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.386873 26770 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:54.426329 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:54.427958 21948 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:54.429962 21942 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:54.411350 26563 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:54.423223 26825 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.436497 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 704) took 1343 ms. Trace:
I20260709 13:07:54.436858 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:54.437641 26828 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.500s	user 0.003s	sys 0.000s
I20260709 13:07:54.440696 26679 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:54.440974 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2150) took 1927 ms. Trace:
I20260709 13:07:54.441155 26679 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:54.441562 26679 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.441341 21873 rpcz_store.cc:276] 0709 13:07:52.513194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.513316 (+   122us) service_pool.cc:224] Handling call
0709 13:07:52.532883 (+ 19567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.553203 (+ 20320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.553253 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.565969 (+ 12716us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.112248 (+546279us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:53.112397 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.112582 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.437021 (+1324439us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:54.440687 (+  3666us) raft_consensus.cc:1685] finished
0709 13:07:54.440705 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.440914 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13761,"raft.queue_time_us":27560,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12537,"spinlock_wait_cycles":20440832,"thread_start_us":511496,"threads_started":1,"wal-append.queue_time_us":1361248}
I20260709 13:07:54.436959 22603 rpcz_store.cc:276] 0709 13:07:53.167930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.216222 (+ 48292us) service_pool.cc:224] Handling call
0709 13:07:53.396997 (+180775us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:53.453557 (+ 56560us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:53.654211 (+200654us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.048725 (+394514us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:54.081710 (+ 32985us) log.cc:844] Serialized 52 byte log entry
0709 13:07:54.081895 (+   185us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.083772 (+  1877us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.084095 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.084192 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.310317 (+226125us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:54.422315 (+111998us) raft_consensus.cc:1685] finished
0709 13:07:54.422369 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.422588 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2950,"prepare.queue_time_us":485084,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":3985,"raft.queue_time_us":48158,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":21962,"spinlock_wait_cycles":98015104,"thread_start_us":451315,"threads_started":2,"wal-append.queue_time_us":585167}
I20260709 13:07:54.445698 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:54.448712 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.451455 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:54.452446 26770 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:54.453785 26818 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.453992 26770 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:54.454502 26770 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:54.455133 26762 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.455662 26762 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:54.455394 26770 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.456108 26762 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.461516 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:54.464186 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:54.464751 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 166884us
I20260709 13:07:54.472227 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 693) took 2368 ms. Trace:
W20260709 13:07:54.473033 26846 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.214s	user 0.003s	sys 0.000s
I20260709 13:07:54.474213 26629 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.468883 26313 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:07:54.474639 22017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1728) took 1354 ms (client timeout 1520 ms). Trace:
I20260709 13:07:54.463131 26825 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.474936 26668 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.434437 26563 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:54.475674 21943 rpcz_store.cc:276] 0709 13:07:52.103709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.215613 (+111904us) service_pool.cc:224] Handling call
0709 13:07:52.215968 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.237774 (+ 21806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.237806 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.237853 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:52.237896 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.471802 (+2233906us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400298e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:54.471865 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.472050 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49698560}
I20260709 13:07:54.479916 21871 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 8.
W20260709 13:07:54.479739 22017 rpcz_store.cc:269] 0709 13:07:53.120261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.123012 (+  2751us) service_pool.cc:224] Handling call
0709 13:07:54.474452 (+1351440us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400418cd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:54.474569 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301164800}
W20260709 13:07:54.479280 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 162020us
I20260709 13:07:54.466212 26823 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.489934 22574 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:54.483235 26629 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.479549 26756 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:54.483587 26770 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.498652 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:54.482913 26825 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.487457 26563 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:54.493247 26025 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:54.490935 26313 consensus_queue.cc:1243] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:07:54.526064 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.520212 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:54.506937 26705 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.507325 26629 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:54.551318 26856 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:07:54.553840 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70126.1us
W20260709 13:07:54.554482 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 93091us
W20260709 13:07:54.554625 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 64840.3us
I20260709 13:07:54.557751 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:54.549387 26703 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:54.567233 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.509145 26668 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.571506 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.575258 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.576772 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.582571 22017 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:54.583091 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.589156 22018 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:54.584134 22022 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:54.588182 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:54.594525 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.601934 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44246.4us
I20260709 13:07:54.602109 21871 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:54.569867 26834 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:54.603585 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 83458.6us
I20260709 13:07:54.562227 26315 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:54.560907 26705 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.572453 26703 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:54.606541 22020 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.607493 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:54.611334 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.613814 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.612198 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.614990 26756 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.615419 26756 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:54.615814 26756 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.619835 26650 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.621671 26868 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:54.623517 26756 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.643776 26756 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.645640 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:54.647431 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.648958 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.604005 26860 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:54.578584 26679 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.605733 26763 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.134s
W20260709 13:07:54.626358 26858 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:54.627429 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:54.628093 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.629637 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.654023 22020 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:07:54.630306 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:54.611001 26025 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.614377 22022 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:54.623719 26762 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.649724 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2422) took 2255 ms. Trace:
I20260709 13:07:54.651760 22606 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:54.593782 26864 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 13:07:54.657640 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45906.3us
I20260709 13:07:54.659005 26693 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:54.659217 26812 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.455s	user 0.009s	sys 0.011s
I20260709 13:07:54.665681 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:54.657665 22017 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:07:54.660458 22018 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:54.661978 22606 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:07:54.665657 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.667372 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:54.668778 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.667061 22610 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:54.669651 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.673972 21838 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:54.651698 26800 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.651818 26780 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.677471 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:54.679708 22606 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.681699 22018 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:54.681828 22606 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:54.682615 26796 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.680141 26725 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.687435 22017 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:54.662240 21949 rpcz_store.cc:276] 0709 13:07:52.394029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.169218 (+1775189us) service_pool.cc:224] Handling call
0709 13:07:54.217672 (+ 48454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.230237 (+ 12565us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:54.424467 (+194230us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.649315 (+224848us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.649371 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:54.649429 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.649558 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.649668 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8682,"prepare.queue_time_us":227210,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":312346,"threads_started":3,"wal-append.queue_time_us":219941}
I20260709 13:07:54.659797 26313 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.690901 26662 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:54.695616 26662 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:54.697896 26662 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.685914 26756 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.699136 22606 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:54.705852 21950 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.700887 26705 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.708772 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2962) took 2327 ms. Trace:
I20260709 13:07:54.693874 26668 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.686978 26780 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.699431 26762 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.685506 26800 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.709303 22019 rpcz_store.cc:276] 0709 13:07:52.372631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.373804 (+  1173us) service_pool.cc:224] Handling call
0709 13:07:52.380197 (+  6393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.389464 (+  9267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.389497 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.389956 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.651595 (+261639us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.652675 (+  1080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.653126 (+   451us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.658482 (+2005356us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:07:54.685063 (+ 26581us) raft_consensus.cc:1685] finished
0709 13:07:54.685083 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.699633 (+ 14550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8906,"raft.queue_time_us":10017,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":76104064,"thread_start_us":261028,"threads_started":1,"wal-append.queue_time_us":753316}
I20260709 13:07:54.702222 26756 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:54.719170 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 699) took 2347 ms. Trace:
I20260709 13:07:54.722388 26747 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:54.722740 21874 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:54.699826 26315 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:54.725970 26756 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.729465 26315 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:54.726538 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.732441 26315 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.698704 26313 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:54.773000 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.775447 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.745447 22024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 2967) took 2351 ms (client timeout 1838 ms). Trace:
I20260709 13:07:54.745524 22023 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:54.755043 26802 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.756117 26679 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:54.776937 22024 rpcz_store.cc:269] 0709 13:07:52.394301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.394637 (+   336us) service_pool.cc:224] Handling call
0709 13:07:54.717988 (+2323351us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54001ee6d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:54.745339 (+ 27351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188230016}
I20260709 13:07:54.696395 26703 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:54.758191 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.797401 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.797930 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.759696 26642 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:54.762923 26641 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:54.764467 26866 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:54.764698 26780 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:54.723907 21945 rpcz_store.cc:276] 0709 13:07:52.372232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.615689 (+1243457us) service_pool.cc:224] Handling call
0709 13:07:53.665958 (+ 50269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.703348 (+ 37390us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:53.703757 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.212452 (+508695us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.213478 (+  1026us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.213526 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:54.213575 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.461726 (+248151us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b18002f8360. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:54.718831 (+257105us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b5400140fd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:54.718918 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.719094 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6597,"prepare.queue_time_us":382912,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":2127,"raft.queue_time_us":3518,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":25588,"spinlock_wait_cycles":107420928,"thread_start_us":498597,"threads_started":1,"wal-append.queue_time_us":589049}
I20260709 13:07:54.767560 26792 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:54.770649 26545 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:54.823228 26545 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:54.824630 26545 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.826392 26545 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.771315 26668 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.833698 26668 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:54.835150 26668 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.811196 26642 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:54.781869 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:54.786643 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 114145us
I20260709 13:07:54.745257 26650 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.837719 26642 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.802930 22606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:36026
I20260709 13:07:54.839218 26642 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.839381 22606 raft_consensus.cc:606] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.839813 22606 raft_consensus.cc:614] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:54.804183 26313 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:54.796541 26802 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.745797 26662 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.841950 26668 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.842892 26662 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.805630 26756 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.760429 26563 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.846163 26563 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:54.846448 26827 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.865s	user 0.001s	sys 0.002s
I20260709 13:07:54.847307 26563 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:54.736567 26629 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.850347 22606 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:54.852356 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.852785 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.853752 26629 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:54.854501 26629 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:54.854861 26629 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:54.855748 26629 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.856567 21874 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:54.812861 26641 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:54.857995 26756 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.859207 26641 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.866560 26825 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.868407 22015 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:54.869277 21874 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:07:54.869822 21874 pending_rounds.cc:85] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 3
I20260709 13:07:54.870098 21874 pending_rounds.cc:107] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:07:54.870371 21874 raft_consensus.cc:2889] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.872202 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:54.882691 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 67227.5us
I20260709 13:07:54.883006 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.883482 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.889505 21873 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:54.893353 21874 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:54.899907 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.900666 21874 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:54.898979 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.887461 26662 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.901813 21870 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:54.903054 22024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:07:54.903692 22024 raft_consensus.cc:606] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.906248 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.907298 21871 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 11: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:54.904819 26662 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.908428 26662 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.905665 26473 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.909169 26473 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.911479 26473 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:54.913334 26851 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.624s	user 0.000s	sys 0.004s
I20260709 13:07:54.914939 26800 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.894918 26797 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:54.915624 26797 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:54.916038 26797 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:54.921684 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 107591us
I20260709 13:07:54.919713 26662 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.888538 26804 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:54.923640 22024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:07:54.925850 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.929503 26662 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:54.931245 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.930397 22024 raft_consensus.cc:606] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.932961 22024 raft_consensus.cc:614] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:54.934373 26815 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 1.738s	user 0.001s	sys 0.014s
I20260709 13:07:54.934926 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 701) took 1481 ms. Trace:
I20260709 13:07:54.935339 21950 rpcz_store.cc:276] 0709 13:07:53.453766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.347440 (+893674us) service_pool.cc:224] Handling call
0709 13:07:54.347801 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.714160 (+366359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.934715 (+220555us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54001400d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:54.934876 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823031680}
I20260709 13:07:54.936126 22024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:07:54.936872 22024 raft_consensus.cc:606] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Received request to transfer leadership to TS 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:54.937258 22024 raft_consensus.cc:614] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:54.937518 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:54.939198 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:54.940459 26862 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:54.940929 26862 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.941282 26862 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.943001 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.944805 26859 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.945393 26859 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.947976 26859 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:54.948763 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 336624us
I20260709 13:07:54.950146 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.950623 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:54.952762 26747 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:54.953406 26747 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:54.953763 26802 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:54.952852 26863 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:54.954988 26863 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.955431 26863 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.953974 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 691) took 2851 ms. Trace:
I20260709 13:07:54.956389 26747 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.956835 26629 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.958161 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:54.958580 26780 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:54.958858 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:54.959038 26780 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:54.959419 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.959898 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.959043 21945 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:54.960786 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.960987 26860 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:54.961292 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:54.960078 21949 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:54.956738 21946 rpcz_store.cc:276] 0709 13:07:52.102870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.103078 (+   208us) service_pool.cc:224] Handling call
0709 13:07:52.125236 (+ 22158us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:52.128028 (+  2792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.128059 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:54.303798 (+2175739us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b2c00010da8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:07:54.314176 (+ 10378us) log.cc:844] Serialized 52 byte log entry
0709 13:07:54.415475 (+101299us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:54.855091 (+439616us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b18000cb620. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf
0709 13:07:54.855248 (+   157us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.953281 (+ 98033us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.953487 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.953605 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.953643 (+    38us) raft_consensus.cc:1685] finished
0709 13:07:54.953655 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.953800 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99343,"prepare.queue_time_us":95852,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":102762,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":34642,"spinlock_wait_cycles":53342592,"thread_start_us":227984,"threads_started":2,"wal-append.queue_time_us":192485}
I20260709 13:07:54.966076 21950 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:07:54.970762 21871 raft_consensus.cc:1217] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-13.9]   Dedup: 8.6->[9.7-13.9]
I20260709 13:07:54.970988 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.972834 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.973467 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 618) took 1850 ms. Trace:
I20260709 13:07:54.973893 22023 rpcz_store.cc:276] 0709 13:07:53.123173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.790152 (+666979us) service_pool.cc:224] Handling call
0709 13:07:54.723461 (+933309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.777530 (+ 54069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.973268 (+195738us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54001ee6d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:54.973411 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2095026048}
I20260709 13:07:54.974978 26313 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:54.948558 26859 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.973464 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.960103 26780 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.976998 21942 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:54.976810 26859 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:54.977674 26780 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:54.978909 26859 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:54.979743 26825 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:54.980333 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:54.980960 21945 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:54.980901 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:54.982102 21948 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:54.984696 21947 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:54.967341 26802 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:54.988392 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.992358 21869 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:54.988952 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:54.992545 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:54.989176 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.993688 21868 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:54.989751 21949 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:54.994511 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:54.989720 21914 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.990783 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.992794 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:54.994666 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:54.971305 21871 pending_rounds.cc:85] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 6
I20260709 13:07:54.995923 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:54.996460 21871 pending_rounds.cc:107] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:07:54.996486 22603 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.997148 21871 raft_consensus.cc:2889] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.994266 26025 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.999723 26025 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:54.999953 22607 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:55.000195 26025 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.999585 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:55.001166 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:54.998889 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:55.003566 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:55.001372 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49887.4us
I20260709 13:07:55.003434 22610 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:54.965934 26821 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:55.006274 22601 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:55.009723 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:54.964162 26563 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:55.007582 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70259.6us
I20260709 13:07:55.011322 21988 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:54.990669 26878 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:07:54.965325 26662 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.989508 26834 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.013006 21873 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:54.994477 26650 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:07:55.016052 26873 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:55.016688 26860 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.019088 26796 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:55.019268 26563 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.020469 26796 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:55.020869 26796 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:55.021028 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.021634 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:55.021739 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.022431 22021 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:55.022926 26872 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:55.023571 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.024353 22016 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:55.012744 26800 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:55.024848 26800 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.025255 26800 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.025267 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.028211 22015 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:55.033874 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:55.041042 21839 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:55.042753 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.043447 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.044350 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.045228 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.046536 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:55.047410 21869 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.040957 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.050414 22023 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:55.054471 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:55.054806 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 43672.1us
I20260709 13:07:55.055856 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:55.057538 22015 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:07:55.058348 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.004438 26802 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:55.009711 26859 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.055189 22019 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:07:55.015131 26747 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:55.006486 26313 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:07:55.085656 26725 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:54.972002 26862 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.087694 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.014571 26662 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:07:55.080226 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66274.7us
I20260709 13:07:55.079182 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:55.057960 22015 pending_rounds.cc:85] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 12
W20260709 13:07:55.088181 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 120238us
I20260709 13:07:55.052416 26473 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.052388 26650 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.102819 22022 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:55.078666 26818 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.106494 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 50758.5us
W20260709 13:07:55.107870 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54993.7us
I20260709 13:07:55.054483 26769 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.117790 22016 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:55.117983 22015 pending_rounds.cc:107] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:07:55.127687 22015 raft_consensus.cc:2889] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:55.049752 26756 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:07:55.021780 26796 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.104153 26867 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.104202 26873 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.105144 26747 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.130676 21869 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:55.113003 26825 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:55.131178 26860 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.125612 26662 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.142493 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:55.136855 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:55.147500 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:55.129112 26769 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.135973 26867 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:55.146577 26873 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.159247 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:55.160197 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:55.160890 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 55918.8us
I20260709 13:07:55.151914 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:55.162833 22574 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:55.157171 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:55.165093 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:55.165585 26890 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.167642 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:55.136147 26863 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:55.145056 26650 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:55.146893 26747 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.152446 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:55.174041 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.166570 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:55.151578 26871 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.139626 26818 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:55.205374 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68630.6us
I20260709 13:07:55.207648 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:55.161180 26867 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:55.193840 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.168269 26313 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:55.208835 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:55.220578 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.161866 26825 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:55.141023 26725 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.157824 26769 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.173516 26473 raft_consensus.cc:2804] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:55.183892 26629 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.224622 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:55.232214 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:55.225432 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:55.225400 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58895.6us
I20260709 13:07:55.182128 26796 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:55.227380 21948 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:55.206758 26863 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:55.241572 26863 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:55.242527 26863 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.222400 26313 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.236109 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.252279 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.234156 21987 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:55.219513 26804 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:55.239199 26825 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.210556 26868 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:07:55.240878 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:55.244903 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 114061us
I20260709 13:07:55.151597 26860 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.246126 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.248780 21943 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:55.253430 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.253880 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.273026 22023 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:07:55.256538 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:55.273944 22015 raft_consensus.cc:2376] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10. Re-sending same reply.
I20260709 13:07:55.225143 26763 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.253314 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:55.226725 26679 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.239782 26725 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:55.277133 22603 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:55.272430 22020 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:55.280850 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:55.180325 26802 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.293458 21914 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:55.257839 26313 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.290046 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:55.257656 26804 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:55.261996 26890 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:55.301699 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.305259 22020 raft_consensus.cc:2368] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9.
I20260709 13:07:55.245229 26629 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.335918 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:55.340000 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:55.335494 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:55.335181 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.284272 26679 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.345347 22017 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:55.291361 26725 raft_consensus.cc:476] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 13:07:55.289180 26891 raft_consensus.cc:2764] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:55.352422 26873 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:55.302141 26871 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:55.360776 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 67393.3us
I20260709 13:07:55.361617 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:55.356725 26315 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:55.285531 26763 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:55.353252 26886 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:55.343927 26872 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:55.362877 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 130773us
I20260709 13:07:55.348498 26679 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.369994 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:55.374639 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.377521 22019 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:55.355966 26800 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.307389 26804 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.360327 26871 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:55.360967 26862 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:55.397262 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:55.383118 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.398082 22017 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:07:55.377307 26873 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.407614 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.410403 22019 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:55.352317 26650 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.430205 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:55.433627 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.434902 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 200869us
I20260709 13:07:55.401743 21841 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:55.437574 21873 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 9: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:55.450528 26545 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:55.455688 22016 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:55.455940 26545 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:55.457155 26545 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.463516 26804 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.473062 26860 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:55.479415 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:55.481119 21872 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:55.488967 26563 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:55.489538 22576 leader_election.cc:400] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 8 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9.
W20260709 13:07:55.490317 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 55931.5us
I20260709 13:07:55.491283 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:55.492307 26804 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:55.498172 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68034.3us
I20260709 13:07:55.511749 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:55.516640 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:55.515760 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:55.512840 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:55.399648 26871 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:55.437114 26797 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.004s
W20260709 13:07:55.544739 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 143080us
I20260709 13:07:55.584734 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:55.586846 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:55.524430 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:55.558640 26900 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:55.559118 26629 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:55.562162 26642 consensus_meta.cc:287] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.722s	user 0.013s	sys 0.000s
I20260709 13:07:55.562644 26668 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:55.565245 26747 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:55.567859 26834 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.527s	user 0.000s	sys 0.008s
W20260709 13:07:55.580967 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 64226.5us
I20260709 13:07:55.588932 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:55.674136 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 85262.7us
I20260709 13:07:55.674837 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:55.675520 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:55.589461 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 304559us
I20260709 13:07:55.676340 22018 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:55.450747 26859 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.518102 26896 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:55.597183 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 79565.7us
W20260709 13:07:55.596238 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 72074.1us
W20260709 13:07:55.670746 21875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.017s	sys 0.031s
W20260709 13:07:55.683878 21875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.018s	sys 0.031s
I20260709 13:07:55.585183 26804 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.518594 26563 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:55.592873 26900 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.593977 26818 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:55.694701 21869 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:55.605230 26668 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.607342 26762 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.673094 26873 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.615204 26473 raft_consensus.cc:697] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:55.576339 26313 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.718981 26897 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.719554 26897 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:55.719950 26897 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.721261 26313 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:55.722780 26887 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:07:55.722374 26893 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:55.724037 26883 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:55.724738 26889 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:55.725162 26889 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:55.725572 26889 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:55.726505 26888 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:07:55.587529 26876 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.312s
I20260709 13:07:55.682909 26725 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.679996 26834 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.588397 26797 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.718588 26762 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:55.702342 26662 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.546s	user 0.015s	sys 0.008s
I20260709 13:07:55.596168 26779 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:07:55.756222 26762 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:55.616125 26629 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:07:55.729426 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:55.707221 26668 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:55.710692 26873 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.701131 26900 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:55.724515 26883 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.715296 26818 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:07:55.745692 26670 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:55.748566 26890 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.748858 26662 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.750661 22603 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:55.752076 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:55.711552 26896 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:55.703231 26862 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:07:55.748378 26025 consensus_meta.cc:287] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.000s
I20260709 13:07:55.744352 26313 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:55.771389 21916 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:07:55.856029 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 84770.8us
W20260709 13:07:55.851161 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 99155.2us
I20260709 13:07:55.775297 26873 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.777060 26883 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.857229 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:55.776726 26872 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.878655 22015 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:55.828962 26725 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:55.828987 26670 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:07:55.948316 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 340678us
I20260709 13:07:55.956099 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:55.956099 26670 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.958436 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:55.958822 26670 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.959069 21871 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.828991 26907 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.960278 26907 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.965111 26907 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:55.949980 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:55.855751 26313 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:55.992707 22021 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:55.995195 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 306488us
I20260709 13:07:55.873772 26860 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:55.875419 26763 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:55.879510 26872 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.931049 26901 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.855454 26882 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:56.002233 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:55.855611 26025 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.003451 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.011245 21871 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:07:56.011483 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:07:56.012389 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 56366.7us
W20260709 13:07:56.021862 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 322757us
I20260709 13:07:56.046036 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:56.046782 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:56.047405 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.108358 22602 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:56.111351 22016 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:55.999580 26890 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:55.997421 26821 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.122534 21869 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:56.125265 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.126108 22021 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:56.131953 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 128584us
I20260709 13:07:56.133020 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:56.135454 26825 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:56.138589 21987 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.042793 26860 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.140868 26860 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.141202 26911 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.135515 26876 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.142566 26876 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:56.143648 26679 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.000s
I20260709 13:07:56.051977 26747 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.144997 26876 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:56.042411 26907 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:56.145681 26907 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:56.145735 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:56.146193 26907 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.113444 26901 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.148527 26901 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.149161 26823 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.149544 26863 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:56.150024 26863 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.150173 22015 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:56.150379 26863 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.149616 26823 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.151444 26823 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.155937 26650 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:56.047156 26872 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.156921 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.157318 26901 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:56.162355 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.162739 26792 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:56.163000 22017 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:56.163376 26792 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:56.164836 26885 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:56.165621 26792 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:56.158468 26825 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:56.166549 26825 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:56.167685 26825 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:55.883596 26473 consensus_queue.cc:237] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:56.159060 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.158932 26763 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:07:56.160048 26909 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:07:56.160475 22022 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.109539 26913 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:56.160931 26902 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:07:56.161226 26313 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:56.158764 26908 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:07:56.196523 22019 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:56.144090 26679 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.149456 26641 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:56.186519 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.145931 26025 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.134475 26821 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:56.202195 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 345031us
I20260709 13:07:56.212081 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:56.221690 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:56.213737 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 342121us
I20260709 13:07:56.222445 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.214300 22016 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:56.234725 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.238404 22022 raft_consensus.cc:2368] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:56.233299 21916 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:56.241357 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.242149 22019 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:56.212522 26629 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.947751 26897 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.256560 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.257332 22016 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:07:56.258576 22016 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:56.257365 22021 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:07:56.199570 26862 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:07:56.194024 26725 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.236145 26797 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.267102 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.268370 22021 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.248488 26662 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.273223 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:56.276719 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 2998) took 1245 ms. Trace:
I20260709 13:07:56.245275 26915 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.181840 26890 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:56.282145 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 251904us
W20260709 13:07:56.283593 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.293218 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:56.175465 26896 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.281410 22024 rpcz_store.cc:276] 0709 13:07:55.030935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.051236 (+ 20301us) service_pool.cc:224] Handling call
0709 13:07:55.078904 (+ 27668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.111435 (+ 32531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.111482 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.124714 (+ 13232us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.596998 (+472284us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:55.597037 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.597108 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.276308 (+679200us) raft_consensus.cc:1685] finished
0709 13:07:56.276338 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.276542 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1934,"raft.queue_time_us":6375,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9147,"thread_start_us":471863,"threads_started":1,"wal-append.queue_time_us":652435}
I20260709 13:07:56.296866 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:56.295123 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.297842 21949 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.298470 22021 raft_consensus.cc:2393] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:56.280792 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 91366.8us
I20260709 13:07:56.230531 26913 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.259266 26629 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.291558 26882 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:56.317255 26762 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:56.320986 26903 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:07:56.292508 26802 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:56.325314 26922 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:56.294750 26915 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.341874 26897 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.320770 26912 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.305126 26025 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.342919 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:56.321200 26916 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:56.341866 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:56.343355 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:56.315908 26920 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:07:56.346396 22017 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:56.386505 22019 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:56.342933 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:56.353714 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 60571us
I20260709 13:07:56.353368 21949 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:56.388577 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:56.390288 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:56.351649 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 121708us
W20260709 13:07:56.359879 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78942.4us
I20260709 13:07:56.355777 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2187) took 1368 ms. Trace:
W20260709 13:07:56.343132 26796 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.089s	user 0.005s	sys 0.009s
W20260709 13:07:56.394754 26919 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:07:56.395807 26861 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:56.396904 26915 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.385804 26912 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.398577 26629 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:56.398970 26912 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.400039 26725 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:56.401113 26900 consensus_meta.cc:287] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.572s	user 0.002s	sys 0.007s
I20260709 13:07:56.401191 26823 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.401510 26821 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.401623 26900 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.403429 26823 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:56.386065 26025 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:56.405581 26889 consensus_meta.cc:287] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.002s
I20260709 13:07:56.405701 26025 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.406095 26889 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.406111 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:56.365556 26873 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.351999 26563 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:56.342739 26876 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:56.415961 26918 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.416574 26679 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:56.374329 26882 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.416951 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:56.416676 26918 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.377914 26913 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.379169 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:56.372730 26802 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:56.354748 26871 consensus_meta.cc:287] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.758s	user 0.006s	sys 0.004s
I20260709 13:07:56.418916 26802 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.419023 26871 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.416229 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:56.421129 22610 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:56.391443 21916 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:56.374158 26938 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:56.422019 26938 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.422426 26938 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.423270 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:56.409665 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:56.416333 26876 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.396209 26916 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.423619 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:56.378242 26860 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.411636 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:56.392637 21875 rpcz_store.cc:276] 0709 13:07:54.987004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.987152 (+   148us) service_pool.cc:224] Handling call
0709 13:07:55.005245 (+ 18093us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:55.014791 (+  9546us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:55.048824 (+ 34033us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.865135 (+816311us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:56.023508 (+158373us) log.cc:844] Serialized 52 byte log entry
0709 13:07:56.023708 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:56.287180 (+263472us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.287494 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.287623 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.355530 (+ 67907us) raft_consensus.cc:1685] finished
0709 13:07:56.355552 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.355712 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114152,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":105143,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":285,"thread_start_us":1015854,"threads_started":3,"wal-append.queue_time_us":770117}
I20260709 13:07:56.440724 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:56.396279 26861 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.449481 22601 raft_consensus.cc:2410] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:56.450487 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:56.415241 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.466948 21871 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:56.472265 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.416105 26563 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:56.479452 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:56.450397 26883 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.004s
I20260709 13:07:56.423892 26911 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:56.415931 26873 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.448275 26917 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:56.492733 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:56.504796 21871 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.499543 21869 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:07:56.502069 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.505586 22018 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:56.502861 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.504179 21942 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:56.488741 21873 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:56.506970 22016 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
W20260709 13:07:56.498379 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 107020us
I20260709 13:07:56.501137 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.507916 22017 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:56.470925 26861 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:56.469480 26912 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:56.513827 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.522356 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:56.522841 22020 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.523196 22024 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.523244 21869 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.476658 26641 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:56.524031 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.534405 22015 raft_consensus.cc:2368] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:56.535943 21871 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
W20260709 13:07:56.536586 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 95949us
I20260709 13:07:56.538053 21841 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.541903 21869 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:56.487937 26920 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.543797 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:56.544927 21875 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 14 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:56.463708 26913 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:07:56.548027 21841 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:56.551441 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:56.514001 26025 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.513103 26779 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:56.504951 26825 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:56.514575 26911 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:07:56.655973 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 187802us
I20260709 13:07:56.534547 26912 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.503736 26883 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.642465 26762 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:56.554827 26641 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:56.688628 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:56.549553 26756 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:56.653272 26025 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.654886 26889 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.642738 26780 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.554658 26834 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:07:56.694481 22601 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:56.554514 26873 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.127s
I20260709 13:07:56.658183 26936 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.700280 26025 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.712260 26936 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.713104 26906 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.262s
W20260709 13:07:56.704214 26872 consensus_meta.cc:287] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.016s
I20260709 13:07:56.714509 26937 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:56.715034 26937 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.715459 26937 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.716832 22023 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:56.554695 26897 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 13:07:56.659237 26871 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:56.680526 26867 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.448s	user 0.012s	sys 0.005s
I20260709 13:07:56.679661 26912 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.641880 26923 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.141s
W20260709 13:07:56.694795 26769 consensus_meta.cc:287] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.443s	user 0.008s	sys 0.009s
I20260709 13:07:56.680262 26762 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:56.710865 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 295680us
I20260709 13:07:56.691196 26563 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.714660 26872 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.692157 26890 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.691617 26915 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.768313 26941 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:07:56.768054 26915 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.710037 26918 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.770298 26915 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:56.698474 22607 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:07:56.770704 26943 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:07:56.704643 26670 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.007s
I20260709 13:07:56.731313 26940 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:56.772295 26940 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:56.772779 26940 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.772286 22020 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:07:56.641477 26920 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.778317 26920 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.714170 26906 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:56.780817 26906 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:56.781237 26873 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.709601 26473 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.781770 26873 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.782156 26473 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:56.703738 26668 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.871s	user 0.011s	sys 0.003s
I20260709 13:07:56.784535 26668 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.730388 26025 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:56.734634 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.783977 26873 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.789700 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:56.728102 26867 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.710201 26780 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.785387 26641 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.742712 26762 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.742516 26889 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:56.821400 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:56.802659 22604 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.805167 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:56.805251 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.805822 21875 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 16. Ops: []
W20260709 13:07:56.823553 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 272293us
I20260709 13:07:56.817248 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:56.824615 21868 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:56.804706 21872 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:56.806473 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:07:56.808538 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 297264us
I20260709 13:07:56.822659 21870 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:56.814141 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:07:56.790619 26863 consensus_meta.cc:287] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.640s	user 0.014s	sys 0.008s
W20260709 13:07:56.831017 26907 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.684s	user 0.014s	sys 0.007s
I20260709 13:07:56.838445 26907 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.839709 26873 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.840471 26873 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:07:56.841171 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 50882.9us
I20260709 13:07:56.841311 26873 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:56.842080 26662 raft_consensus.cc:993] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:07:56.842182 26873 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:56.842685 26662 raft_consensus.cc:1081] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:07:56.843250 26873 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.844583 26873 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.845044 26950 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:56.846823 21916 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:56.802357 26890 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:56.849303 26956 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:56.792284 26876 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.849754 26956 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.850117 26956 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.742856 26769 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.852514 26769 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.853163 26867 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.821532 26889 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:56.853845 26025 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.806715 26834 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.854023 26873 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:56.854398 26889 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.854656 26834 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.855168 26780 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:56.855487 26889 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.781791 26906 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.856774 21874 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:56.792109 26916 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.793506 26872 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.743144 26911 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.791922 26933 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:56.859910 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:56.860590 26933 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.861096 26933 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.849041 26890 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.791043 26670 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.792912 26936 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.792493 26883 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.822247 26929 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:56.829720 26863 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.882876 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:56.891088 21871 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:07:56.889251 26834 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:56.894699 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.893188 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.892942 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.896124 21871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:07:56.896976 22018 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:07:56.894131 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 104544us
I20260709 13:07:56.890304 21841 leader_election.cc:400] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:56.869127 26670 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.898288 21841 leader_election.cc:403] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:56.900215 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.901628 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.905915 22018 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.903247 22610 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:07:56.907968 22020 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:07:56.911259 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:56.912199 21867 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:07:56.904299 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:56.916169 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.916859 22023 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:56.829018 26937 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.919555 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:56.916491 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:56.920472 22017 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:56.915122 21870 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:07:56.918318 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.890259 26907 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.925573 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:56.922111 21841 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:56.928741 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.930626 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.898867 26867 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:56.946143 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.940732 26950 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:56.947245 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:56.948067 22023 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 13: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:56.948784 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.950273 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:56.920800 26834 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:56.902516 26861 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.964838 26942 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:56.947273 26950 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.966531 26861 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.967290 26861 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.967607 26950 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.944767 26872 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:56.968883 26890 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.969189 26679 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:56.920629 26762 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.971416 26762 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.937573 26936 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:07:56.974399 26961 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.975073 26961 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.977594 26936 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:56.978061 26936 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:56.978950 26936 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.980180 26936 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.888437 26940 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.957361 26873 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.982708 26940 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.984440 26961 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:56.938549 26867 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.987782 26867 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.988279 26957 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:56.992727 26959 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:56.993040 26933 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.993655 26959 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:56.994170 26939 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.994843 26939 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:56.994872 26959 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:56.996909 26892 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:07:57.001820 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 153621us
I20260709 13:07:57.002471 22018 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:57.003250 22017 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.002556 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:57.007525 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:57.012233 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 66347.2us
I20260709 13:07:57.017582 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:57.019060 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.028373 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.030666 26911 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:57.035235 21988 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:56.980485 26800 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.016335 26818 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:57.010592 26679 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.049774 21872 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:57.057206 26873 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.058238 26967 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:57.071760 26967 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:57.067446 21871 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.073153 21871 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.059499 26693 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:57.060989 26972 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:57.063617 21870 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.073840 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:57.081457 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:57.074681 22573 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:56.999653 26912 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:57.069542 26955 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:57.097342 22024 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:57.099956 26967 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.100589 26961 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:57.104898 22021 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:57.064870 26818 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:57.100845 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:57.099061 21871 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.103083 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:57.099893 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 134235us
I20260709 13:07:57.082290 26972 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.107095 22020 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:07:57.109858 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.110591 21870 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:57.110646 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.113093 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.113756 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.114193 21867 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:57.114606 21869 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:57.116684 26911 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:57.117095 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.117867 21875 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:57.118037 26911 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.120611 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.116143 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.123500 21870 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:07:57.127753 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.129979 21872 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:57.131331 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 96153.3us
I20260709 13:07:57.133205 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.134913 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:57.137909 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.138710 21868 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.135579 22024 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.103018 26770 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.145990 21867 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:07:57.147716 22602 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:57.075088 26679 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.151058 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:57.151912 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:57.152225 26873 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.152529 22023 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.152760 26873 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.154878 26873 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.105480 26693 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:57.157770 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:57.162622 22024 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:57.166642 21943 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:57.167301 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.167500 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.166673 21872 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:57.168797 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.169381 21870 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:57.170349 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.171641 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.172138 21872 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:57.172679 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:57.173146 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.174391 21872 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.177170 21866 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:57.133431 26972 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:57.189500 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:57.197166 21870 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:57.197868 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.173272 22602 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:07:57.146636 26915 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:57.168143 21947 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:57.178020 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.181388 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.181974 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:57.182197 26693 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.182848 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.183830 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.184589 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.184911 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.212316 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.185642 26974 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:57.186470 26971 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:57.186897 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:57.215710 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.203361 21866 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:57.221905 21841 leader_election.cc:400] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:57.222293 21841 leader_election.cc:403] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:57.222151 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.210546 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.223081 21866 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:57.223366 21870 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:57.224200 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.155421 26818 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.228196 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:57.228245 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:57.229521 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.214175 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.224242 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.230525 21870 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.207084 21868 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:07:57.225965 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.213140 26974 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.135556 26961 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.189500 26863 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.207736 26923 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.244849 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:07:57.245456 21949 raft_consensus.cc:606] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:57.245782 21949 raft_consensus.cc:614] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:57.208302 26939 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:57.257866 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.258651 21875 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:07:57.236217 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:57.237509 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.261261 21950 raft_consensus.cc:2368] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:57.239024 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.209434 26915 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.241195 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.241909 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.232882 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.231544 21866 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.218398 26762 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:57.267666 21868 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.270884 21941 raft_consensus.cc:2368] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:07:57.228930 26940 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:57.283901 21866 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:07:57.239142 26823 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:57.278422 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:57.286850 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.241166 26937 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.240718 26890 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:57.304981 22610 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:57.308097 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:57.309007 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.311564 21868 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:07:57.292639 26762 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:57.316057 22605 raft_consensus.cc:1240] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:57.260757 26770 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:57.277096 26915 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.317615 22573 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:57.293545 26971 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:07:57.389170 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.391144 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.450088 21943 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:57.290598 26940 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:57.277559 26834 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:57.305624 26823 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.462759 26912 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.462997 26823 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.442226 26883 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.463925 26883 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.466128 26883 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.465862 26762 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.446996 26863 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:57.459585 26890 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:57.429821 26873 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:57.484952 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:57.485800 22610 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.415871 22609 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:07:57.426419 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 129227us
I20260709 13:07:57.487634 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.272015 26923 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.492395 22023 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
W20260709 13:07:57.435288 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.442256 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:57.442631 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 125092us
I20260709 13:07:57.446425 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2459) took 1143 ms. Trace:
I20260709 13:07:57.454877 26960 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:57.462294 26834 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:07:57.489651 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 182468us
I20260709 13:07:57.501822 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:57.497099 22573 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:57.494551 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:07:57.478475 26978 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:07:57.506462 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:57.507318 22023 raft_consensus.cc:2368] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:57.462822 26668 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.518263 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:57.518970 21943 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.443856 26937 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.511729 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:57.531947 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:57.532727 22609 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:07:57.512116 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:57.513837 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:57.510288 21875 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:07:57.469807 26963 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:07:57.496783 21944 rpcz_store.cc:276] 0709 13:07:56.302582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.382265 (+ 79683us) service_pool.cc:224] Handling call
0709 13:07:56.405069 (+ 22804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.440635 (+ 35566us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:56.694167 (+253532us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.817933 (+123766us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.834147 (+ 16214us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.834612 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.834733 (+   121us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:56.834765 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.834823 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.859077 (+ 24254us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18003c44e0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f85522 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:57.446003 (+586926us) raft_consensus.cc:1685] finished
0709 13:07:57.446059 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.446318 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175913,"prepare.queue_time_us":252212,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":69416,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":37150,"spinlock_wait_cycles":6389504,"thread_start_us":303758,"threads_started":2,"wal-append.queue_time_us":233570}
I20260709 13:07:57.473762 26859 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:57.461303 26940 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.477455 26863 consensus_queue.cc:1243] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:57.476181 26679 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.535573 21914 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.476038 26900 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.543617 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:57.520130 26902 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:57.542501 21948 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:57.501078 26960 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.550669 22023 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:57.526120 26747 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:57.574168 26957 consensus_meta.cc:287] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.585s	user 0.004s	sys 0.006s
I20260709 13:07:57.574347 26747 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.574667 26957 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.575451 21946 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:57.507035 26967 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.572151 26961 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.547770 26980 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:57.573169 26937 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:57.478039 26890 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.502449 26025 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:57.581743 22610 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:07:57.526649 26872 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:57.545444 26867 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:07:57.638489 26867 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.640913 26867 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.576784 26897 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.491204 26770 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:57.570418 26936 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.004s
I20260709 13:07:57.507439 26873 consensus_queue.cc:1059] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 13:07:57.551910 26977 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:57.544903 26912 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:57.632301 21943 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:57.633178 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:57.569332 26974 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:57.457705 26876 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.151s
I20260709 13:07:57.666685 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.589184 21870 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:57.573344 26988 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:07:57.642697 22602 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:57.547998 26662 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:57.584650 26960 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.695680 21869 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:57.612284 26957 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:57.696549 26957 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:57.651554 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 115476us
I20260709 13:07:57.617919 26937 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:57.655830 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 142098us
I20260709 13:07:57.613988 26961 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.656438 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:57.668440 26956 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.815s	user 0.013s	sys 0.000s
I20260709 13:07:57.659979 21872 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:57.617450 26802 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:57.637439 26025 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.668759 21870 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:57.545838 26883 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:07:57.671183 21839 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:57.712298 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.710239 22023 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
W20260709 13:07:57.721022 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 49949.1us
I20260709 13:07:57.690667 26662 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.669019 26862 raft_consensus.cc:3055] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:57.661078 26936 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:57.649401 26989 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:57.617709 26967 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.663866 26912 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.655463 26897 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.721903 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:57.707456 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:57.738461 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 226780us
I20260709 13:07:57.749712 22023 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:57.746824 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 211319us
I20260709 13:07:57.719276 26025 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:57.762465 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.751176 22574 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:57.704324 26985 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:07:57.697996 26959 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:57.778748 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:57.779414 26959 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.754657 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.725099 26800 raft_consensus.cc:2764] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:57.726164 26862 raft_consensus.cc:740] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:57.781809 26959 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.782548 26862 consensus_queue.cc:260] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.782979 26957 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.783896 26862 raft_consensus.cc:3060] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.741775 26936 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.784897 26747 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.785035 26994 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:57.785699 26747 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:57.786401 26747 consensus_queue.cc:1243] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:57.786816 26936 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.786994 26994 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.723398 26937 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.787416 26994 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:57.778606 26923 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.788687 26823 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.788390 26994 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.790531 26770 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:57.795725 26770 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:57.796279 26770 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:57.797260 26889 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.941s	user 0.014s	sys 0.000s
I20260709 13:07:57.798574 26770 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.791225 22024 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:57.799017 26981 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:07:57.658674 26834 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.792224 26890 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.738461 26961 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.753427 26912 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.792387 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:57.803272 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48793us
I20260709 13:07:57.806774 21948 raft_consensus.cc:2410] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:57.807394 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.812803 22023 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:07:57.814344 21872 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:07:57.816136 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.817203 21870 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:57.756455 26883 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:57.824812 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:57.749774 26956 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.827948 26956 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.823082 26883 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.807271 26990 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:57.738680 26802 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.805646 26989 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:57.830874 21943 raft_consensus.cc:2368] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:57.829926 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:57.832432 21948 raft_consensus.cc:2368] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:07:57.830536 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:57.791241 26823 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:57.829070 26883 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.809355 26923 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:57.821084 26980 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:57.858721 26956 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:57.859195 26956 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.859572 26956 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:57.862089 26938 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.439s	user 0.023s	sys 0.000s
I20260709 13:07:57.862692 26938 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.865097 26545 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:57.865739 26545 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.866799 26937 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.868031 26545 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.868710 26923 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:57.869798 26923 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.831790 26990 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.872772 26980 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:57.873150 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:57.874457 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:57.874029 26980 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.875185 22606 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 18: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:57.875393 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:57.876029 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:57.877803 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.879340 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.818749 26859 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:57.894734 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:57.899010 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:57.899267 26563 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.905485 26956 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:57.908473 26956 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.909126 26989 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.910384 26938 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.892191 26990 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.911850 22606 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:57.917433 21839 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:57.893953 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 168533us
I20260709 13:07:57.921131 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.925007 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:57.927049 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 142479us
I20260709 13:07:57.935084 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.935940 21948 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:07:57.936151 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.936874 21869 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.937980 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:57.911864 26563 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:57.906337 26937 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:57.939590 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:57.946419 21872 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.950970 22609 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:57.956768 21872 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:57.959561 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:57.923000 26762 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:57.892124 26995 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:07:57.963181 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.918952 26992 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:57.967067 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:57.967578 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:57.967849 21872 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:07:57.995951 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:57.997196 21948 raft_consensus.cc:2393] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:57.958021 26915 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:57.957836 26770 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.009460 26770 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.010481 26915 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:58.013657 26972 consensus_meta.cc:287] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.000s
I20260709 13:07:58.014159 26972 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.014910 22020 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:58.015161 22022 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:58.016682 26883 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.019944 26662 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:58.020494 26967 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:57.915836 26025 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.025740 22574 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:58.032879 21869 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:58.034650 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:58.036352 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.037277 21869 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.965152 26762 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:57.984383 26703 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:58.058954 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.011925 26990 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.038362 26883 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:58.057431 26802 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:58.069005 26910 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.874s	user 0.008s	sys 0.000s
I20260709 13:07:58.038738 26960 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.058326 26762 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.072751 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:07:58.074812 22607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 765) took 2063 ms (client timeout 1727 ms). Trace:
I20260709 13:07:58.075487 22601 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:57.989004 26890 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:07:57.984576 26992 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.081615 26913 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:07:58.084177 22607 rpcz_store.cc:269] 0709 13:07:56.011466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.011590 (+   124us) service_pool.cc:224] Handling call
0709 13:07:58.074618 (+2063028us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54000b54d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.074744 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489319680}
I20260709 13:07:58.062359 27003 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:58.085831 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 255352us
I20260709 13:07:58.074869 26896 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:58.088747 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 54165us
I20260709 13:07:58.090358 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:58.091845 22610 raft_consensus.cc:2393] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:58.093119 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.089135 26913 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:58.088371 26890 consensus_queue.cc:1243] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:58.105077 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:58.106443 22607 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:58.089555 26770 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:58.107831 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:58.110314 21869 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:07:58.091303 27003 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.112179 22574 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:58.106717 26896 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:58.107604 26913 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.116211 26913 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.115877 26896 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.104202 26990 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:58.112377 26940 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.001s
I20260709 13:07:58.121469 26992 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.125411 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.126621 26025 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.113857 27003 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:58.119831 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.138700 21869 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:58.106102 26703 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:58.137120 21948 raft_consensus.cc:2368] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:58.118430 26883 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:58.140198 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:58.141131 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:58.144934 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3014) took 1070 ms. Trace:
I20260709 13:07:58.145328 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.146101 21869 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:58.128659 26972 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:58.145287 22022 rpcz_store.cc:276] 0709 13:07:57.074572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.074722 (+   150us) service_pool.cc:224] Handling call
0709 13:07:57.098284 (+ 23562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.015514 (+917230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.144730 (+129216us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b5400236754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:58.144881 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108190976}
I20260709 13:07:58.148748 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:58.142638 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.151532 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:58.157532 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:58.158071 22605 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:58.158236 21875 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:07:58.159116 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.159324 22605 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:58.159792 21947 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:58.160871 22574 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:58.161531 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 957) took 2412 ms. Trace:
I20260709 13:07:58.159204 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.161918 22604 rpcz_store.cc:276] 0709 13:07:55.749268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.749385 (+   117us) service_pool.cc:224] Handling call
0709 13:07:55.749672 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.830893 (+1081221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.161268 (+1330375us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540067f2d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:58.161442 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2421236480}
I20260709 13:07:58.166561 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1755) took 1981 ms. Trace:
I20260709 13:07:58.166937 22019 rpcz_store.cc:276] 0709 13:07:56.184887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.247867 (+ 62980us) service_pool.cc:224] Handling call
0709 13:07:56.386334 (+138467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.408003 (+ 21669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.166332 (+1758329us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001f09d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.166465 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291616128}
I20260709 13:07:58.169343 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:58.162206 21875 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.165931 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.171443 21869 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.173760 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 833) took 1357 ms. Trace:
I20260709 13:07:58.174256 21874 rpcz_store.cc:276] 0709 13:07:56.808043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.808143 (+   100us) service_pool.cc:224] Handling call
0709 13:07:58.165765 (+1357622us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b5400025154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.165859 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79636224}
I20260709 13:07:58.176934 26960 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:07:58.179250 26975 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.862s	user 0.002s	sys 0.002s
I20260709 13:07:58.178979 26762 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.180351 21870 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:58.141819 26703 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.182879 26762 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.183669 26025 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:58.184260 26025 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:58.185171 26025 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.185439 27008 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:58.185913 21872 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:58.186286 21872 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:58.187043 21872 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.187340 27008 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:58.188169 21872 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:58.188635 27008 raft_consensus.cc:3055] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:58.189049 27008 raft_consensus.cc:740] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:58.189246 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:58.170353 26883 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:58.190435 26883 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.197188 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.148495 27007 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:07:58.197990 21950 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:07:58.148447 26995 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:58.201632 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.135609 26940 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.142150 26897 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.202741 26770 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.229183 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:58.143477 26912 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:58.224687 27011 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:58.234856 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.231072 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.240851 21869 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:07:58.172874 26980 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.248858 21872 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:07:58.249285 21872 pending_rounds.cc:85] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 10
I20260709 13:07:58.249528 21872 pending_rounds.cc:107] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:58.249764 21872 raft_consensus.cc:2889] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.243360 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:58.230804 26989 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.228341 26770 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.254789 26957 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:58.273675 26957 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.276672 27022 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.277393 27022 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.279980 27022 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.282627 22607 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:58.285063 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.285807 21869 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.228812 26926 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:07:58.254650 26796 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:07:58.293984 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.295069 21948 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:58.288940 22604 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:07:58.291877 21874 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:58.233530 26861 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:07:58.254999 26862 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.251725 26980 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:58.255584 26859 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:58.252629 26872 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:58.251688 26995 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:58.255169 26956 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:58.271555 26937 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:58.281183 26770 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.354732 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.348425 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:58.363317 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 137060us
I20260709 13:07:58.255359 27015 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:07:58.345876 26980 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.357942 26762 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.373667 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2222) took 1198 ms. Trace:
I20260709 13:07:58.339794 26926 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.380817 21869 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:58.378134 21868 rpcz_store.cc:276] 0709 13:07:57.175219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.312270 (+137051us) service_pool.cc:224] Handling call
0709 13:07:57.321567 (+  9297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.726153 (+404586us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:57.926366 (+200213us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.088779 (+162413us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.089063 (+   284us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.096168 (+  7105us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.096436 (+   268us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:58.096481 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.096576 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.194311 (+ 97735us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b180046c0c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:07:58.373446 (+179135us) raft_consensus.cc:1685] finished
0709 13:07:58.373472 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.373612 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120776,"prepare.queue_time_us":318294,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":93,"raft.queue_time_us":196515,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":14681,"spinlock_wait_cycles":26944640,"thread_start_us":552832,"threads_started":3,"wal-append.queue_time_us":185195}
I20260709 13:07:58.368734 26937 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:58.354364 26862 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.355144 26859 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.383319 22574 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:58.400710 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:58.407164 22603 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:07:58.397715 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.360373 26872 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.408865 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:58.354877 26956 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.409611 26025 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:58.411633 26025 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.412042 26025 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.414322 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 651) took 1493 ms. Trace:
I20260709 13:07:58.414702 22017 rpcz_store.cc:276] 0709 13:07:56.921260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.922384 (+  1124us) service_pool.cc:224] Handling call
0709 13:07:57.003091 (+ 80707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.003781 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.414142 (+1410361us) spinlock_profiling.cc:243] Waited 80.4 ms on lock 0x7b54001f13d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.414269 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185012480}
I20260709 13:07:58.419135 21869 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:07:58.419544 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 715) took 1245 ms. Trace:
I20260709 13:07:58.419955 21946 rpcz_store.cc:276] 0709 13:07:57.165147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.165672 (+   525us) service_pool.cc:224] Handling call
0709 13:07:58.410559 (+1244887us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540009c4d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.410660 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836192000}
I20260709 13:07:58.422662 26926 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.422878 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:58.423563 22024 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.370651 26995 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.383591 26957 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.428728 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.407793 26868 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:58.393533 26859 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.445300 22019 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:07:58.446086 26872 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.446487 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:58.447731 26956 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.448994 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.450392 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.451508 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.452172 21948 raft_consensus.cc:2368] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:58.391148 26862 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.435536 26868 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:58.456084 26868 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.457998 26912 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:58.385027 26937 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.435756 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.459734 21944 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:07:58.437191 27018 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:58.438072 22022 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:58.382681 26762 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.461354 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.460934 21987 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:58.447768 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:58.463888 21875 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
W20260709 13:07:58.464797 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.458837 26940 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.478201 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.478072 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.479450 21868 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 16: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:58.466209 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:58.479528 22603 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:58.474710 27021 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.491055 22024 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:07:58.492347 21871 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.493928 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:58.494745 22019 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.493657 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50258 (request call id 2220) took 1610 ms. Trace:
I20260709 13:07:58.496650 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.495896 21871 rpcz_store.cc:276] 0709 13:07:56.894298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.895985 (+  1687us) service_pool.cc:224] Handling call
0709 13:07:58.490723 (+1594738us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54000dbe54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356069a3d 00007f635b039cd0 00007f63545be254 00007f63545be1e2 00007f63545be111 00007f63545be08c 00007f63545bd342 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.492828 (+  2105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392066432}
I20260709 13:07:58.504897 21944 raft_consensus.cc:2368] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
W20260709 13:07:58.496793 21838 connection.cc:256] RPC call timeout handler was delayed by -1.7874155089999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 13:07:58.499835 26770 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.519909 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 3029) took 1216 ms. Trace:
I20260709 13:07:58.520530 22020 rpcz_store.cc:276] 0709 13:07:57.303723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.778486 (+474763us) service_pool.cc:224] Handling call
0709 13:07:58.519652 (+741166us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400181ad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.519811 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541013888}
I20260709 13:07:58.525985 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:58.528236 26926 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:58.528700 26770 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:58.529163 26938 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:58.534570 26025 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.545276 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.553138 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.546060 21944 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:58.553903 21871 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.529754 26938 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:07:58.558185 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 48792.7us
W20260709 13:07:58.619407 21838 connection.cc:256] RPC call timeout handler was delayed by -1.3114970709999625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:07:58.623639 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.636149 21871 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:58.636830 26990 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:58.637310 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:58.637692 22574 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:58.638731 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:58.639519 21871 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:07:58.640548 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:58.641144 21871 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:58.540434 27003 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.617225 26940 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:58.644049 26025 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.637441 26990 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.655318 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.647930 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.622529 26897 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.643162 26868 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:58.628033 26992 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.668354 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.670809 22019 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:07:58.671557 26995 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.681988 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.682725 21944 raft_consensus.cc:2376] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13. Re-sending same reply.
I20260709 13:07:58.703433 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:58.706382 21874 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:58.655284 26940 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.642520 26938 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.678134 26868 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:58.671976 26904 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.718073 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:58.719152 21874 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:58.665407 26897 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.670850 26980 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:58.722016 27029 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:58.680959 26992 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.723944 26923 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:58.758316 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:58.759222 22605 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
W20260709 13:07:58.730938 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.737254 27027 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:07:58.736958 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:58.739164 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.777035 21947 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:58.717209 26762 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:58.740300 27017 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.590s	user 0.000s	sys 0.003s
I20260709 13:07:58.743611 26994 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.748052 22604 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:58.748929 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:58.786557 22602 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.750259 22606 raft_consensus.cc:1240] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:58.740338 21872 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:58.763072 21871 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.676265 26872 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:58.770587 26980 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:07:58.779655 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 145528us
I20260709 13:07:58.755252 26938 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.782434 26762 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:58.772109 26992 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.783234 26473 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:58.758363 26923 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:58.784364 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:58.820868 22605 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.784466 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.798138 26872 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:58.821986 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.816157 21839 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:58.818615 27003 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.819747 26990 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.769170 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.821355 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:58.754354 26904 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:58.829269 26982 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 1.267s	user 0.003s	sys 0.003s
I20260709 13:07:58.827216 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.837244 21944 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:58.837958 21871 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:58.840056 22605 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 14 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:07:58.828269 26872 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.841760 22602 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:07:58.843264 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:58.846163 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:58.847067 22605 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:58.805888 26940 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.851183 21838 leader_election.cc:400] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:07:58.853190 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.853763 21947 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.856848 26923 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.858253 26923 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:58.845924 26904 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.861441 26897 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.808800 26868 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.865094 21947 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:07:58.866663 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.866912 26992 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.851073 26990 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:58.868497 26990 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:58.869493 26990 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.870832 26867 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:58.871266 26867 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:07:58.875690 27040 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:07:58.877528 26962 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 1.833s	user 0.002s	sys 0.003s
I20260709 13:07:58.879739 21838 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:58.881064 21838 leader_election.cc:400] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:07:58.882299 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.885627 21944 raft_consensus.cc:2410] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:07:58.885728 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.887315 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.888137 21949 raft_consensus.cc:2410] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:58.886389 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:58.890317 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:58.892302 27037 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.894452 21838 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:58.895051 21988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.4:41571 timed out after 1.727s (SENT) [suppressed 20 similar messages]
I20260709 13:07:58.883253 26992 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.872211 26867 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:07:58.897231 21873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 2209) took 2477 ms (client timeout 2209 ms). Trace:
I20260709 13:07:58.898095 21838 leader_election.cc:400] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
W20260709 13:07:58.897940 21873 rpcz_store.cc:269] 0709 13:07:56.418169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.423027 (+  4858us) service_pool.cc:224] Handling call
0709 13:07:58.895603 (+2472576us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b54003ad754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.895729 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147865472}
I20260709 13:07:58.899019 21838 leader_election.cc:400] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:58.897044 27037 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.902926 21838 leader_election.cc:400] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:58.903584 21838 leader_election.cc:403] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:58.896243 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.896037 21867 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:58.909121 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:58.912698 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:58.891317 27041 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.916522 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:07:58.917615 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.918229 26940 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:58.918392 21945 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:07:58.918884 26940 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:58.919502 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.913793 26762 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.920292 26762 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.919891 26940 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:58.920754 26762 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.922648 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:58.917547 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.916162 26897 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.924187 21947 raft_consensus.cc:2376] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14. Re-sending same reply.
I20260709 13:07:58.925554 27036 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.924203 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.929025 27036 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.930603 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.931602 22608 raft_consensus.cc:2410] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:07:58.936926 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.937065 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.937992 21948 raft_consensus.cc:2410] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:07:58.939255 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.940099 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 968) took 1284 ms. Trace:
I20260709 13:07:58.940515 22610 rpcz_store.cc:276] 0709 13:07:57.655978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.656148 (+   170us) service_pool.cc:224] Handling call
0709 13:07:58.939910 (+1283762us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54005deb54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.940043 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852140800}
I20260709 13:07:58.941776 26959 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:58.942332 26959 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:58.943259 26959 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.944591 26961 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.914170 26992 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:58.946429 21866 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2780) took 1682 ms (client timeout 2062 ms). Trace:
W20260709 13:07:58.946834 21866 rpcz_store.cc:269] 0709 13:07:57.264395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.286613 (+ 22218us) service_pool.cc:224] Handling call
0709 13:07:58.946247 (+1659634us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400219b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.946372 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208193792}
W20260709 13:07:58.948663 21943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1639) took 1721 ms (client timeout 1725 ms). Trace:
W20260709 13:07:58.949231 21943 rpcz_store.cc:269] 0709 13:07:57.227359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.666347 (+438988us) service_pool.cc:224] Handling call
0709 13:07:58.948405 (+1282058us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54001ac2d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:58.948577 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375399808}
I20260709 13:07:58.931514 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.940534 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.953045 21948 raft_consensus.cc:2368] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:58.951684 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1768) took 2058 ms. Trace:
I20260709 13:07:58.951439 27033 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:58.940852 21947 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:58.954710 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:58.954195 22015 rpcz_store.cc:276] 0709 13:07:56.893036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.893147 (+   111us) service_pool.cc:224] Handling call
0709 13:07:56.910495 (+ 17348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:56.934439 (+ 23944us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:58.018794 (+1084355us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800170440. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf 00007f635608c038
0709 13:07:58.084511 (+ 65717us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.930668 (+846157us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b1800170440. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287
0709 13:07:58.932451 (+  1783us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.932570 (+   119us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:58.933187 (+   617us) log.cc:844] Serialized 52 byte log entry
0709 13:07:58.933364 (+   177us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:58.950936 (+ 17572us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.951277 (+   341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.951391 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.951444 (+    53us) raft_consensus.cc:1685] finished
0709 13:07:58.951462 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.951617 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17109,"prepare.queue_time_us":141515,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":60531,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":19477,"spinlock_wait_cycles":158605824,"thread_start_us":251711,"threads_started":3,"wal-append.queue_time_us":191797}
W20260709 13:07:58.961490 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 66465.5us
I20260709 13:07:58.952766 26926 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.963016 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:58.965251 21943 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:07:58.966372 27042 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.967881 26800 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.968827 27042 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.971108 27042 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.968146 26926 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:07:58.986847 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.987941 21841 leader_election.cc:400] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:58.988363 21841 leader_election.cc:403] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:58.987964 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:58.990473 26800 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:58.996259 26800 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:58.998435 26800 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:58.994047 26762 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.000957 26762 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:58.958850 27033 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.003655 26762 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.007079 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:59.009025 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:58.989475 27036 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:59.011231 21841 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:59.004559 26867 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:59.080248 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46253.5us
I20260709 13:07:59.084677 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.085546 21943 raft_consensus.cc:2376] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16. Re-sending same reply.
I20260709 13:07:59.095233 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:59.096900 27032 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:59.098284 27032 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.101533 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:59.102973 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:59.105532 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.106549 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.081962 26876 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:07:59.111559 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 104577us
W20260709 13:07:59.112378 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 101218us
I20260709 13:07:59.112999 21838 leader_election.cc:400] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:59.113081 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:07:59.114382 21838 leader_election.cc:400] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:07:59.109695 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:59.117447 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:59.115119 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:59.123560 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.124955 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.125648 21873 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:59.026364 26792 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:07:59.130771 21873 pending_rounds.cc:85] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 6
I20260709 13:07:59.137506 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.128123 21943 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:59.162358 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.082566 26967 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:07:59.164567 21873 pending_rounds.cc:107] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:07:59.162783 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.168174 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.169202 21872 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:59.161677 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:59.224797 27043 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:07:59.228281 27044 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:59.230876 21869 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 7.
I20260709 13:07:59.190901 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1632) took 1969 ms. Trace:
I20260709 13:07:59.127075 26990 raft_consensus.cc:2764] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:07:59.232076 21943 rpcz_store.cc:276] 0709 13:07:57.222165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.127546 (+1905381us) service_pool.cc:224] Handling call
0709 13:07:59.127818 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.165742 (+ 37924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.190750 (+ 25008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.127024 27038 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.233026 21866 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:59.233098 21873 raft_consensus.cc:2889] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.119287 26940 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
W20260709 13:07:59.237841 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76248.6us
I20260709 13:07:59.119892 27032 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:59.159390 26825 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:59.159622 26936 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.243465 21875 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:59.160530 26992 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:07:59.120229 26762 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.239215 26792 consensus_queue.cc:1243] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:59.262144 22015 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:59.239995 27038 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:07:59.267201 21942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2450) took 2973 ms (client timeout 1565 ms). Trace:
I20260709 13:07:59.251178 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:59.270574 21942 rpcz_store.cc:269] 0709 13:07:56.294540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.294669 (+   129us) service_pool.cc:224] Handling call
0709 13:07:59.266969 (+2972300us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54000fc654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:59.267124 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249834368}
I20260709 13:07:59.255961 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.193872 26802 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:07:59.249739 21943 raft_consensus.cc:1275] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:07:59.281399 21943 pending_rounds.cc:85] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 9
W20260709 13:07:59.273015 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 139130us
I20260709 13:07:59.274896 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.127584 26876 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.131541 26897 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.277108 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.251430 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.290808 22019 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:59.290653 22017 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:59.243767 27036 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:59.271368 27038 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.285698 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:59.295373 22024 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:59.295814 22024 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:59.276067 22020 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:59.296417 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:59.245918 26936 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:59.244524 26825 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.287597 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:59.302121 22015 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 9: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:59.300240 21874 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:59.293844 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 725) took 2046 ms. Trace:
I20260709 13:07:59.284194 21943 pending_rounds.cc:107] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:07:59.302868 21943 raft_consensus.cc:2889] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.304672 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 724) took 2070 ms. Trace:
I20260709 13:07:59.304978 21943 rpcz_store.cc:276] 0709 13:07:57.234706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.242357 (+2007651us) service_pool.cc:224] Handling call
0709 13:07:59.249293 (+  6936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.304433 (+ 55140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.304619 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:59.305783 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.305648 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:59.244091 27032 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.307268 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.307636 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.302737 21942 rpcz_store.cc:276] 0709 13:07:57.247460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.271487 (+2024027us) service_pool.cc:224] Handling call
0709 13:07:59.285082 (+ 13595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.288776 (+  3694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.288818 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.293525 (+  4707us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:59.293581 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.293665 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.293780 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1203,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5266}
I20260709 13:07:59.309540 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:59.310176 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.291829 26973 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.311161 22021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 3022) took 2202 ms (client timeout 1745 ms). Trace:
I20260709 13:07:59.348224 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.315919 22024 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.361208 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:59.315464 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.365684 22602 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:59.365926 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.367126 22024 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.307297 26825 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.314348 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2463) took 1090 ms. Trace:
I20260709 13:07:59.374325 21942 rpcz_store.cc:276] 0709 13:07:58.223927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.313567 (+1089640us) service_pool.cc:224] Handling call
0709 13:07:59.313886 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.314055 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.314084 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.314121 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:59.314158 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.314206 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.314297 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.375411 22024 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:07:59.347770 26780 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:59.310345 26762 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:07:59.390625 26780 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.347002 26860 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:07:59.363380 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 53915us
W20260709 13:07:59.346688 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.362579 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:59.397061 26762 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:59.397511 21944 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:59.398113 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2465) took 1173 ms. Trace:
I20260709 13:07:59.398429 21944 rpcz_store.cc:276] 0709 13:07:58.224587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.396901 (+1172314us) service_pool.cc:224] Handling call
0709 13:07:59.397196 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.397890 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.398063 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.399223 26780 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:59.377827 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.378194 21872 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.400831 21872 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:59.401139 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2473) took 1169 ms. Trace:
I20260709 13:07:59.401906 21872 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:59.401494 21948 rpcz_store.cc:276] 0709 13:07:58.232031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.400458 (+1168427us) service_pool.cc:224] Handling call
0709 13:07:59.400687 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.400841 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.400871 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.400910 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:59.400942 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.400995 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.401090 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.403752 26821 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:59.404636 21948 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:59.405257 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2474) took 1164 ms. Trace:
I20260709 13:07:59.405822 26670 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:59.406162 21874 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:07:59.382323 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2464) took 1152 ms. Trace:
I20260709 13:07:59.386227 26925 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:59.407338 26925 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.409499 26925 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:59.386924 26973 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.410663 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 839) took 1476 ms. Trace:
I20260709 13:07:59.411027 21870 rpcz_store.cc:276] 0709 13:07:57.933959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.934782 (+   823us) service_pool.cc:224] Handling call
0709 13:07:57.958476 (+ 23694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.180742 (+222266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.410445 (+1229703us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54001b7454. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:07:59.410606 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509835008}
I20260709 13:07:59.411774 26973 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:59.399557 21944 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:59.412449 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 718) took 2276 ms. Trace:
I20260709 13:07:59.412961 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2470) took 1186 ms. Trace:
I20260709 13:07:59.413296 21944 rpcz_store.cc:276] 0709 13:07:58.226098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.399119 (+1173021us) service_pool.cc:224] Handling call
0709 13:07:59.399406 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.412706 (+ 13300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.412911 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.414168 21950 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 13:07:59.414741 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2488) took 1018 ms. Trace:
I20260709 13:07:59.415011 21950 rpcz_store.cc:276] 0709 13:07:58.396491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.413627 (+1017136us) service_pool.cc:224] Handling call
0709 13:07:59.413959 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.414528 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.414694 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.416673 21942 rpcz_store.cc:276] 0709 13:07:58.224270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.375493 (+1151223us) service_pool.cc:224] Handling call
0709 13:07:59.376109 (+   616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.376291 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.376321 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.376365 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:59.376404 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.376459 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.376578 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.427083 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:59.428020 22024 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:59.429134 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.429867 22024 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:07:59.429965 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.430591 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.431191 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:07:59.432639 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.433125 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.433763 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:59.436041 26904 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:59.436451 26904 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:59.437223 26904 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.438623 26904 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.441042 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:59.308223 27031 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:59.445297 26917 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:59.445076 27031 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.445701 26917 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:59.446574 26917 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.447742 27031 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:59.448037 26917 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.451651 26762 raft_consensus.cc:2764] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:59.452530 26762 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:59.453431 27033 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:59.356323 21869 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:59.349272 26876 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:59.432466 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.460062 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.462604 27008 consensus_queue.cc:260] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.465050 26933 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:59.467216 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:59.294670 27036 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:59.480145 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:59.468439 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:59.405678 21948 rpcz_store.cc:276] 0709 13:07:58.240859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.404179 (+1163320us) service_pool.cc:224] Handling call
0709 13:07:59.404443 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.405007 (+   564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.405204 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.456099 26313 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.471521 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:59.472293 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.472114 21945 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:59.486344 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:59.474045 22015 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:59.474362 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.412819 22601 rpcz_store.cc:276] 0709 13:07:57.136330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.136590 (+   260us) service_pool.cc:224] Handling call
0709 13:07:58.075277 (+938687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.086214 (+ 10937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.412251 (+1326037us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b54000b54d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:59.412396 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2157847296}
I20260709 13:07:59.477289 21949 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.310123 27041 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.479143 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:59.480214 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.481365 21941 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 16: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:07:59.470202 22607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 975) took 1368 ms (client timeout 1761 ms). Trace:
I20260709 13:07:59.481686 22605 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:59.492187 22607 rpcz_store.cc:269] 0709 13:07:58.101664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.107564 (+  5900us) service_pool.cc:224] Handling call
0709 13:07:59.470007 (+1362443us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54006d1354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:59.470145 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397429120}
I20260709 13:07:59.482630 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:59.495411 21948 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.501073 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.501896 21945 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:59.328276 22610 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:59.324555 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.506976 22017 raft_consensus.cc:2393] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:07:59.504953 22021 rpcz_store.cc:269] 0709 13:07:57.108317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.109083 (+   766us) service_pool.cc:224] Handling call
0709 13:07:59.310967 (+2201884us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400198f54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:59.311091 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370289536}
I20260709 13:07:59.508802 22019 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:59.509644 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 730) took 1502 ms. Trace:
I20260709 13:07:59.513648 21943 rpcz_store.cc:276] 0709 13:07:57.810615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.312648 (+1502033us) service_pool.cc:224] Handling call
0709 13:07:59.312926 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.313081 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.313103 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.313141 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:59.313176 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.313223 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.313316 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:59.512220 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:59.511103 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:59.524179 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:07:59.508982 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.502810 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.490165 27036 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.560680 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:07:59.547084 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 59761.9us
I20260709 13:07:59.555372 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:59.492033 26821 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:59.529230 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:07:59.532945 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.527392 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:07:59.556583 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:59.557292 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.301384 26936 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.529922 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:59.571475 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:07:59.571941 22610 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:07:59.572820 21945 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:07:59.572989 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.580081 21949 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:07:59.477200 26872 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:59.314414 27032 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.581202 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:59.603940 22610 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:07:59.573762 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:07:59.582727 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.605167 21943 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.605715 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:59.508092 26889 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.583146 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.607378 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.585513 22015 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:59.482631 26956 consensus_queue.cc:1059] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:07:59.557996 26950 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.547176 26992 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.590989 26860 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.557735 26988 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:59.557657 26762 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.611490 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.611613 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:59.621616 26860 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:59.622522 26860 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.623939 26934 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:59.610206 26889 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.624774 26876 consensus_queue.cc:1048] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:59.616933 27022 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.625854 27022 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.624373 26934 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:59.619445 26992 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.627013 26934 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.627864 27022 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:59.632905 26762 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.633344 26823 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.633867 26823 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.635048 22016 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
W20260709 13:07:59.614939 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.591820 26873 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:59.635732 26873 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:07:59.636554 26873 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:07:59.642495 26934 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.645202 26934 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:59.650424 21869 raft_consensus.cc:2410] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:59.651580 27003 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.652096 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.652175 27003 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.655177 27003 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:07:59.617326 26825 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.656327 22020 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:07:59.658782 26825 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:07:59.661413 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.614799 26950 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:59.662142 26950 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.662640 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.664964 21987 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:59.665817 26825 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:59.668136 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 426775us
I20260709 13:07:59.617941 26867 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:59.669099 26867 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:59.669556 26867 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:59.675195 22609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 726) took 1721 ms (client timeout 2052 ms). Trace:
W20260709 13:07:59.675763 22609 rpcz_store.cc:269] 0709 13:07:57.954094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.989296 (+ 35202us) service_pool.cc:224] Handling call
0709 13:07:59.674933 (+1685637us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54000b1b54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:59.675119 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946286464}
I20260709 13:07:59.679910 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2765) took 2515 ms. Trace:
I20260709 13:07:59.680480 21867 rpcz_store.cc:276] 0709 13:07:57.164335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.164724 (+   389us) service_pool.cc:224] Handling call
0709 13:07:58.895790 (+1731066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.905880 (+ 10090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.679618 (+773738us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54003ad750. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:07:59.679829 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3980330880}
I20260709 13:07:59.681452 21868 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:59.684827 21866 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:59.686657 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:59.687461 21868 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:59.687561 21771 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 11 to 14, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 14 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.690052 21771 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.607749 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:59.694392 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:59.692555 21771 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 7 to 8, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 8 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:07:59.734642 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:59.704067 21866 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:59.736022 21948 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:59.708276 21874 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:59.737895 21948 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:59.704473 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.739240 21870 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:07:59.739599 21949 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:07:59.740075 21949 pending_rounds.cc:85] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 7
I20260709 13:07:59.693756 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:07:59.740556 21949 pending_rounds.cc:107] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:07:59.740954 21949 raft_consensus.cc:2889] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.707379 21867 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:59.743204 21947 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:07:59.754436 22602 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:59.755992 22605 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:59.756814 22601 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:59.759060 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:59.770769 22606 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:07:59.757382 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.745479 21868 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:07:59.745219 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:59.774920 21987 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:07:59.770520 22574 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:59.769639 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:07:59.599170 26872 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:07:59.783782 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:59.746935 26825 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.810824 21948 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:59.812565 21948 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:59.776467 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:59.815296 21987 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:07:59.831585 21943 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:07:59.753858 26823 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:07:59.733846 26662 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.752058 26912 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:07:59.804409 26993 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.820883 27008 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.819648 27031 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.804811 27016 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:59.805531 26940 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:59.804430 26959 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:07:59.804826 21839 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:07:59.783305 26899 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:59.800853 26935 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:07:59.769104 26642 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:59.802500 26872 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.801203 26933 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:07:59.832158 21947 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.829447 21987 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:59.888243 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58939us
I20260709 13:07:59.889117 27037 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:59.889768 27037 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:07:59.890254 27037 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.783531 26915 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.833686 21948 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:59.892163 21948 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:59.801613 22574 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:07:59.893018 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 91471.6us
I20260709 13:07:59.880489 27003 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.836184 21943 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:59.894742 27003 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.879995 26990 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:59.897209 26990 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:07:59.818449 26825 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.897902 26825 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.898260 26990 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.899987 26990 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.818158 26893 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:59.877662 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 72909.9us
I20260709 13:07:59.881352 26670 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:07:59.905532 27055 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:59.905247 26670 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:07:59.907337 27055 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:59.907969 27055 consensus_queue.cc:1243] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:59.908161 26915 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:07:59.870623 26993 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:07:59.914395 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:07:59.911926 21988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.028s	sys 0.048s
W20260709 13:07:59.917526 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 388367us
W20260709 13:07:59.917727 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.029s	sys 0.048s
I20260709 13:07:59.926613 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:07:59.822547 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 267235us
I20260709 13:07:59.931576 21875 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:59.907969 26933 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:59.947194 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.932926 21875 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:59.952950 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.953886 21875 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:07:59.955812 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.936335 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:59.981506 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 45281.4us
W20260709 13:07:59.982024 21950 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.016s
W20260709 13:07:59.982501 21950 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.014s	sys 0.016s
I20260709 13:07:59.939261 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:07:59.916014 26993 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.908439 27055 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:07:59.987875 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:07:59.988772 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 49604.6us
I20260709 13:07:59.918848 27033 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:59.994077 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:07:59.985320 26862 consensus_queue.cc:1059] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:08:00.003167 27022 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:00.006453 22016 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 3025) took 2849 ms (client timeout 1790 ms). Trace:
W20260709 13:08:00.006887 22016 rpcz_store.cc:269] 0709 13:07:57.157004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.157518 (+   514us) service_pool.cc:224] Handling call
0709 13:08:00.006268 (+2848750us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b5400333454. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:00.006374 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5681730816}
W20260709 13:08:00.009495 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.011832 26889 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:00.022116 22608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 967) took 2399 ms (client timeout 1649 ms). Trace:
W20260709 13:08:00.022751 22608 rpcz_store.cc:269] 0709 13:07:57.622461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.875061 (+252600us) service_pool.cc:224] Handling call
0709 13:08:00.021747 (+2146686us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400650ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:00.021970 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2427117312}
I20260709 13:08:00.023437 26762 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.026039 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:00.026356 22607 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:00.027225 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:07:59.936051 26961 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:59.998560 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:07:59.914918 26940 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:07:59.980162 27041 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.992722 26956 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.999507 27033 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:00.036178 26913 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:00.040977 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.917155 26823 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:08:00.078974 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:00.040263 21872 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.935351 26915 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.049263 26670 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.049918 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:00.038921 26917 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:00.033977 26933 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:00.053948 26926 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.055262 26992 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.106204 22609 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:00.070066 27003 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.061489 26867 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.146407 26867 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.093348 26936 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.150985 21869 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:00.151422 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2801) took 1021 ms. Trace:
I20260709 13:08:00.151829 21873 rpcz_store.cc:276] 0709 13:07:59.129855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.130097 (+   242us) service_pool.cc:224] Handling call
0709 13:07:59.130515 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:59.505299 (+374784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.505353 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:59.512947 (+  7594us) log.cc:844] Serialized 52 byte log entry
0709 13:07:59.928784 (+415837us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:59.928843 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.928940 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.151190 (+222250us) raft_consensus.cc:1685] finished
0709 13:08:00.151211 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.151365 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":754,"raft.queue_time_us":19622,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2955,"thread_start_us":604999,"threads_started":2,"wal-append.queue_time_us":543687}
I20260709 13:08:00.062952 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2496) took 1232 ms. Trace:
W20260709 13:08:00.073740 21942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.052s
W20260709 13:08:00.154337 21942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.008s	sys 0.052s
I20260709 13:08:00.154192 21949 rpcz_store.cc:276] 0709 13:07:58.830273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.589015 (+758742us) service_pool.cc:224] Handling call
0709 13:07:59.592052 (+  3037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.777718 (+185666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.062621 (+284903us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400163354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:00.062868 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338289408}
I20260709 13:08:00.155316 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2491) took 1722 ms. Trace:
I20260709 13:07:59.979473 26973 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 13:08:00.076874 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.985744 26937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.231s	user 0.012s	sys 0.006s
I20260709 13:08:00.046476 26650 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.078127 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2493) took 1290 ms. Trace:
I20260709 13:08:00.212980 21945 rpcz_store.cc:276] 0709 13:07:58.787351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.577977 (+790626us) service_pool.cc:224] Handling call
0709 13:07:59.589750 (+ 11773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.589990 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:59.602418 (+ 12428us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.076384 (+473966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.077802 (+  1418us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:00.077868 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.077936 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.078066 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":334,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3490,"thread_start_us":473620,"threads_started":1}
I20260709 13:08:00.056100 27037 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.086315 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:00.095819 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:00.103220 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.104447 21872 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:08:00.107259 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:00.237782 22609 raft_consensus.cc:2410] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:08:00.057096 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3019) took 2968 ms. Trace:
I20260709 13:08:00.111569 27031 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.249082 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 162891us
W20260709 13:08:00.116232 27032 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:08:00.069299 26988 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:00.125114 27056 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:00.066517 26968 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:00.131879 27033 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.095639 26917 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:00.063048 26925 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:00.080281 26956 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.140924 27061 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.311380 22604 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:00.161229 22021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.010s	sys 0.015s
W20260709 13:08:00.314683 22021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.010s	sys 0.015s
W20260709 13:08:00.094616 26821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.019s	sys 0.030s
I20260709 13:08:00.066148 27041 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:00.228543 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.112916 26933 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.272630 27021 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.250751 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:00.328011 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 77348.2us
I20260709 13:08:00.329011 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:00.165455 27038 consensus_meta.cc:287] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.002s
W20260709 13:08:00.165838 26860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.025s
W20260709 13:08:00.336054 26860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.001s	sys 0.025s
W20260709 13:08:00.161082 26873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.023s
W20260709 13:08:00.164638 26937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.414s	user 0.013s	sys 0.007s
W20260709 13:08:00.336772 26873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.003s	sys 0.023s
W20260709 13:08:00.236117 26629 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.018s	sys 0.046s
W20260709 13:08:00.337513 26629 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.019s	sys 0.046s
I20260709 13:08:00.338380 21947 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:00.281883 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 355362us
I20260709 13:08:00.297396 26917 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:00.298593 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 310794us
I20260709 13:08:00.155752 21942 rpcz_store.cc:276] 0709 13:07:58.432469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.417594 (+985125us) service_pool.cc:224] Handling call
0709 13:07:59.417887 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.418067 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:07:59.572343 (+154276us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.154923 (+582580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.154996 (+    73us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:00.155059 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.155129 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.155252 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":152317,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"thread_start_us":734084,"threads_started":2}
I20260709 13:08:00.278393 26899 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:00.351081 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:00.331341 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:00.331759 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:00.332088 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:00.291569 27056 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:00.292800 26984 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.237541 27036 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
I20260709 13:08:00.345715 21916 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:00.248411 26650 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.298530 27054 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:08:00.350726 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:00.350876 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:00.238230 22018 rpcz_store.cc:276] 0709 13:07:57.089132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.089658 (+   526us) service_pool.cc:224] Handling call
0709 13:07:57.089993 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.202574 (+112581us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:57.226291 (+ 23717us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.530140 (+303849us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.530872 (+   732us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.531073 (+   201us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:57.531125 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.817645 (+1286520us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18004b51a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:08:00.056785 (+1239140us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540025f8d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:00.056841 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.056889 (+    48us) raft_consensus.cc:1685] finished
0709 13:08:00.056903 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.057037 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37377,"prepare.queue_time_us":23685,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":42052,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":17013,"spinlock_wait_cycles":282085120,"thread_start_us":210701,"threads_started":1,"wal-append.queue_time_us":455265,"wal-append.run_cpu_time_us":2182,"wal-append.run_wall_time_us":1003461}
I20260709 13:08:00.366074 22017 raft_consensus.cc:2410] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:00.345965 26662 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:00.334352 26904 consensus_meta.cc:287] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.887s	user 0.014s	sys 0.001s
I20260709 13:08:00.353143 22016 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 16: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:00.280977 27055 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:08:00.316390 26821 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:00.271940 27031 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.355222 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:00.381884 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:00.382122 22023 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.382175 22015 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:00.327036 27021 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.280452 27032 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:00.360188 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 329789us
W20260709 13:08:00.351672 26950 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.003s
I20260709 13:08:00.345166 27022 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.366840 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:00.393747 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:00.316988 26792 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.344732 26992 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:00.376083 21945 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:08:00.377058 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2489) took 1974 ms. Trace:
I20260709 13:08:00.377105 22019 raft_consensus.cc:2410] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:08:00.358146 26940 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:00.380582 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:00.368963 26897 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 1.062s	user 0.011s	sys 0.002s
I20260709 13:08:00.346428 27038 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.386067 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:00.368407 26662 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.415997 26662 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.367272 27036 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.416276 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:00.403403 26872 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:08:00.389204 27021 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.321753 27061 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.418330 22021 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:08:00.423097 21916 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:00.424918 22016 raft_consensus.cc:2368] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13.
I20260709 13:08:00.387224 26936 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.392094 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:00.400876 21944 rpcz_store.cc:276] 0709 13:07:58.402310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.414324 (+1012014us) service_pool.cc:224] Handling call
0709 13:07:59.414569 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.414753 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:59.821497 (+406744us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.375330 (+553833us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.375384 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:00.376750 (+  1366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.376826 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.376985 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155406,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":127374,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":2996,"thread_start_us":959692,"threads_started":3,"wal-append.queue_time_us":491665}
I20260709 13:08:00.396266 26899 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:00.440106 26899 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:00.441303 26650 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.443096 22016 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:00.435250 21942 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:00.444355 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:00.444492 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:00.429463 22023 raft_consensus.cc:2410] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:00.430572 22024 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:00.364990 26984 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.432410 26862 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:00.452503 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:00.438380 27038 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:00.419396 27060 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.418916 26897 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.466845 21866 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:00.468328 21866 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:00.447098 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:00.520231 22015 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:00.533996 22016 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
W20260709 13:08:00.447624 22610 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.033s
W20260709 13:08:00.534969 22610 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.000s	sys 0.033s
I20260709 13:08:00.419186 26940 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:00.454416 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:00.458964 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 56852.3us
I20260709 13:08:00.539608 21871 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.469254 21872 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:00.396731 26950 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.419269 26925 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.480896 27041 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.482610 27061 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.457556 26821 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.484854 27037 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.487824 22018 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:08:00.563987 22018 pending_rounds.cc:85] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 8
I20260709 13:08:00.564303 22018 pending_rounds.cc:107] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:08:00.564824 22018 raft_consensus.cc:2889] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.489562 27084 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:00.490145 27074 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:08:00.490550 26899 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:00.491786 27070 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:08:00.497180 21771 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 8 to 9, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 9 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:00.499439 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.456535 26915 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:08:00.502712 26906 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.460078 26913 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:00.525812 26984 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.431021 26872 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.560936 27055 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.529568 27036 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:00.421710 26992 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.445981 26860 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:08:00.543416 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:00.550336 21988 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:00.552071 27038 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:08:00.613561 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 70224.1us
I20260709 13:08:00.614432 21838 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:00.457103 26650 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:00.477818 27008 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.001s
W20260709 13:08:00.488637 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 65583us
I20260709 13:08:00.556836 27071 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.501792 26825 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.603s	user 0.002s	sys 0.009s
I20260709 13:08:00.480984 26961 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:00.557600 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:00.565508 26990 consensus_meta.cc:287] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.004s
I20260709 13:08:00.593415 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:00.597326 22602 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:00.615684 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:00.617321 21916 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:00.625320 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:00.626363 21838 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:00.627204 26993 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
W20260709 13:08:00.628629 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78402us
I20260709 13:08:00.584802 27042 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:00.630465 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 73222.9us
I20260709 13:08:00.631678 21946 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:00.633893 27077 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.635236 27071 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.634402 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:00.637576 21941 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:00.658900 26992 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.659210 27071 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.659566 27008 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.661408 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:00.662631 21916 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:00.662972 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1669) took 1164 ms. Trace:
I20260709 13:08:00.663334 21947 rpcz_store.cc:276] 0709 13:07:59.498490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.888100 (+389610us) service_pool.cc:224] Handling call
0709 13:07:59.888494 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.338861 (+450367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.662743 (+323882us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540019d054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:00.662916 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034139008}
I20260709 13:08:00.664155 21916 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:00.656735 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.664475 27084 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.638022 27078 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.667343 26926 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:00.674110 27056 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.614537 27055 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.684123 27040 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:00.719849 27040 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:00.684154 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49881.4us
I20260709 13:08:00.722906 27053 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:00.723935 27077 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:00.724445 27040 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.685197 26792 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:00.686760 26650 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.562554 26925 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:00.693473 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 46689.4us
W20260709 13:08:00.731104 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.732906 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:00.628949 26796 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.632352 26897 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.702028 22606 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:00.622669 26988 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.622836 26899 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:00.638211 26961 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.664453 27097 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.632771 26936 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.707762 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:00.710350 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:00.648147 26904 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:00.586287 27089 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:08:00.768784 27038 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:00.769239 27085 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.769508 26872 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.588905 26913 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.770227 26872 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:00.771486 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:00.723927 27053 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:00.742969 26650 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.772130 22607 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:00.629223 26862 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:08:00.772317 27053 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:00.773581 26913 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.645593 27042 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:00.774987 27042 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.775959 27042 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:00.725195 27069 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:08:00.621169 27037 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:08:00.733566 21944 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:00.769291 27038 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.778147 27038 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.778508 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:00.777717 27037 consensus_queue.cc:1243] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:00.779264 21944 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:00.780037 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:00.734229 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:00.781248 27092 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:00.781498 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:00.782620 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:00.756808 26990 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:08:00.703521 27078 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.783870 26990 consensus_queue.cc:1243] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:00.784210 27078 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.784410 27037 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:00.784884 27037 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:00.767115 27084 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:08:00.785895 27037 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.787281 27037 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:00.705296 27096 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:00.647315 26940 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.788789 27096 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:00.708513 27031 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:00.742082 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:00.743208 21839 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:00.790444 27087 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:08:00.790963 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47844.2us
I20260709 13:08:00.746912 26959 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:00.715680 27061 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.705281 26926 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:00.791615 26959 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.637420 26825 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.766424 27071 consensus_queue.cc:1059] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:08:00.748831 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:00.793895 27091 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 13:08:00.794271 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.750218 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:00.795779 22605 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:00.718145 27032 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.691191 26993 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.798452 26993 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:00.799873 21869 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:00.802119 26662 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:00.804260 27051 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:00.757094 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:00.757225 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:00.826864 21942 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
W20260709 13:08:00.761641 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51409.6us
W20260709 13:08:00.767272 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 59621.2us
I20260709 13:08:00.774075 26650 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:00.839809 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2494) took 2048 ms. Trace:
I20260709 13:08:00.840256 21941 rpcz_store.cc:276] 0709 13:07:58.791277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.581153 (+789876us) service_pool.cc:224] Handling call
0709 13:07:59.581426 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.658454 (+1077028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.839544 (+181090us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003d31d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:00.839743 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428342656}
I20260709 13:08:00.717338 27034 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:08:00.791541 26984 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:00.753671 26988 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.806059 22022 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.806519 22020 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:00.807188 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2499) took 1204 ms. Trace:
I20260709 13:08:00.875033 21946 rpcz_store.cc:276] 0709 13:07:59.602390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.662407 (+ 60017us) service_pool.cc:224] Handling call
0709 13:08:00.807040 (+1144633us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54000fd054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:00.807136 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226576640}
I20260709 13:08:00.809342 27055 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:00.809866 26904 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:00.810850 26950 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.813215 22602 pending_rounds.cc:85] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 9
W20260709 13:08:00.813627 27080 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.154s	user 0.003s	sys 0.000s
I20260709 13:08:00.753557 21947 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:00.878523 22602 pending_rounds.cc:107] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:08:00.815300 26933 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.815383 27090 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:00.816033 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:00.816978 26959 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.817145 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:00.819963 27033 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.821046 21873 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:00.839236 27031 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.829942 21916 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:00.841131 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:00.858978 27021 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:00.861209 26917 consensus_meta.cc:287] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.002s
I20260709 13:08:00.862048 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:00.862696 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:00.863313 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:00.866569 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1673) took 1358 ms. Trace:
I20260709 13:08:00.893151 21943 rpcz_store.cc:276] 0709 13:07:59.514732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.895671 (+380939us) service_pool.cc:224] Handling call
0709 13:07:59.896081 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:59.896466 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.896497 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:59.897116 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 13:08:00.291905 (+394789us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:00.327786 (+ 35881us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.665344 (+337558us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b18003080e0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:08:00.796194 (+130850us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b18003080e0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf 00007f635608c038
0709 13:08:00.796391 (+   197us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.866152 (+ 69761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.866252 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.866305 (+    53us) raft_consensus.cc:1685] finished
0709 13:08:00.866326 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.866500 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231119,"prepare.queue_time_us":514497,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":146737,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":28307,"spinlock_wait_cycles":33883648,"thread_start_us":394325,"threads_started":1,"wal-append.queue_time_us":428978}
W20260709 13:08:00.871937 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46350us
W20260709 13:08:00.872805 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 44257.2us
I20260709 13:08:00.878993 22602 raft_consensus.cc:2889] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.881870 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2490) took 2477 ms. Trace:
W20260709 13:08:00.887069 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 71128.3us
I20260709 13:08:00.839548 27054 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.824349 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.901849 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:00.896574 21988 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:00.872915 26662 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.877578 26860 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.873631 27051 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:00.880867 27022 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.888967 27090 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:00.919477 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 89589.3us
I20260709 13:08:00.985276 21916 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:00.910175 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:00.986510 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 76421.7us
I20260709 13:08:00.919842 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:00.923612 22603 raft_consensus.cc:2410] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:08:00.911166 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:00.945910 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:00.906123 27034 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.906065 26825 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:00.891521 26936 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:00.886404 26937 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:08:00.992282 21943 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:00.920197 26792 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.995738 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 872) took 1085 ms. Trace:
I20260709 13:08:01.008412 21868 rpcz_store.cc:276] 0709 13:07:59.910781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.911199 (+   418us) service_pool.cc:224] Handling call
0709 13:07:59.924102 (+ 12903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.934378 (+ 10276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.934423 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.979955 (+ 45532us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.368145 (+388190us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.368185 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.368258 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.813035 (+444777us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:00.995432 (+182397us) raft_consensus.cc:1685] finished
0709 13:08:00.995459 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.995679 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9873,"raft.queue_time_us":66190,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":37772,"spinlock_wait_cycles":40785664,"thread_start_us":350926,"threads_started":1,"wal-append.queue_time_us":585513}
I20260709 13:08:00.976493 26950 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.994952 21941 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:00.925824 26823 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:08:00.997759 21946 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
W20260709 13:08:01.025743 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.909117 27054 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.903273 27031 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.905889 26917 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.888913 26933 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.011719 26936 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.012277 27022 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:01.112664 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 127455us
W20260709 13:08:01.001502 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 105082us
I20260709 13:08:00.996729 26935 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.929028 27036 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:08:01.123176 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:01.128154 27021 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:01.130788 27054 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:01.132244 27105 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:08:01.114571 27090 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:01.134207 27101 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:08:01.130370 27078 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.138922 27078 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.140905 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 870) took 1233 ms. Trace:
I20260709 13:08:01.141335 21874 rpcz_store.cc:276] 0709 13:07:59.907545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.909202 (+  1657us) service_pool.cc:224] Handling call
0709 13:07:59.909521 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.921651 (+ 12130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.921696 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.922283 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.514813 (+592530us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b48000801d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:08:00.568292 (+ 53479us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b1800355e40. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:08:00.745533 (+177241us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:00.745573 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.745640 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.140680 (+395040us) raft_consensus.cc:1685] finished
0709 13:08:01.140700 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.140844 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5556,"raft.queue_time_us":17451,"raft.run_cpu_time_us":4145,"raft.run_wall_time_us":579840,"spinlock_wait_cycles":104547456,"thread_start_us":177023,"threads_started":1,"wal-append.queue_time_us":1005057}
W20260709 13:08:01.145123 27106 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 13:08:01.153451 27104 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:08:01.155171 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 873) took 1242 ms. Trace:
I20260709 13:08:01.155750 21867 rpcz_store.cc:276] 0709 13:07:59.913173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.913300 (+   127us) service_pool.cc:224] Handling call
0709 13:07:59.913606 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.921526 (+  7920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.921571 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:59.979791 (+ 58220us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.665956 (+686165us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b1800311ec0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:08:00.765798 (+ 99842us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:00.765857 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.765937 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.154705 (+388768us) raft_consensus.cc:1685] finished
0709 13:08:01.154733 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.155074 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11835,"raft.queue_time_us":9909,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3071,"spinlock_wait_cycles":15802112,"thread_start_us":99632,"threads_started":1,"wal-append.queue_time_us":864156}
I20260709 13:08:01.159608 26862 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:01.116449 26937 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:01.161194 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 44361.3us
I20260709 13:08:01.161665 26937 raft_consensus.cc:2764] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:01.162123 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:01.021428 26825 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:08:01.163219 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:01.163729 27097 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:01.164570 27097 consensus_queue.cc:1243] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:01.164331 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:01.165107 27097 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:01.165470 27097 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.165784 27097 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.160723 27060 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:01.168785 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:01.168951 27060 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.169781 21838 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:01.171557 27040 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:01.171952 27040 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.172293 27040 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.173049 22024 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:01.174401 22018 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:01.178109 27114 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:01.178640 22023 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:01.179280 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:01.179872 22017 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
W20260709 13:08:01.044109 27107 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:08:01.004036 27034 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.180449 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:01.180513 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:01.182399 22016 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:01.184540 22024 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:08:01.297823 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.366389 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:01.198691 26925 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.181612 22021 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:01.186837 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:01.187422 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:01.374117 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:01.374924 21948 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:01.375851 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:01.376536 21948 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.308384 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:01.112879 26936 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.116228 26959 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.309448 21941 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:08:01.180616 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:01.386622 22017 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:01.387856 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:01.388687 21944 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:01.358626 21873 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:01.180692 21942 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:01.363895 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:01.003239 26904 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.405459 27053 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.193961 26917 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.406910 27053 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.197942 27031 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:01.183930 27089 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.198s
W20260709 13:08:01.311483 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 335808us
I20260709 13:08:01.412731 27051 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:01.414708 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.188140 27032 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:01.416672 27032 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:01.417394 27034 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:01.417850 27032 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:01.422710 27042 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.001s
I20260709 13:08:01.422811 26940 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:01.360848 26872 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:08:01.423457 26940 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.425768 26940 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:01.426600 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.364107 26984 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:08:01.198303 26933 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.373128 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:01.361061 27060 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:08:01.431994 26893 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:01.432559 26893 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:01.392052 26861 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:08:01.433629 26893 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.396260 26959 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.435297 26893 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.437680 26959 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.114010 27022 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.440140 27022 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.159608 26988 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.182061 26796 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.397420 21944 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:01.168812 27086 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:01.444196 27086 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.444622 27086 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:01.445375 27096 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.446655 27096 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.447600 26933 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:01.449805 27061 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:01.450222 27061 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:01.401854 21943 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:01.403564 21947 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:01.451011 21947 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:01.452080 27056 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.451795 21947 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.184154 26926 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.464366 21947 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.465337 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 655) took 1134 ms. Trace:
W20260709 13:08:01.199163 27111 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:01.467167 22020 rpcz_store.cc:276] 0709 13:08:00.331138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.331261 (+   123us) service_pool.cc:224] Handling call
0709 13:08:00.331550 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.874699 (+543149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.465042 (+590343us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b5400366354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:01.465259 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091922304}
W20260709 13:08:01.490878 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.493897 21988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.017s	sys 0.047s
W20260709 13:08:01.392880 26961 consensus_meta.cc:287] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
W20260709 13:08:01.494247 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.017s	sys 0.047s
W20260709 13:08:01.499220 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 575304us
W20260709 13:08:01.500394 21869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.007s	sys 0.021s
W20260709 13:08:01.500825 21869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.007s	sys 0.021s
I20260709 13:08:01.501629 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:01.455926 27099 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.445s	user 0.001s	sys 0.000s
W20260709 13:08:01.457240 27108 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.461s	user 0.001s	sys 0.000s
W20260709 13:08:01.458511 27113 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260709 13:08:01.461565 27102 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.453s	user 0.001s	sys 0.000s
W20260709 13:08:01.460075 27109 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.481s	user 0.000s	sys 0.001s
I20260709 13:08:01.529297 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:01.541096 21943 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:01.514534 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:01.530612 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:01.382594 27078 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:08:01.495739 26933 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.393851 26925 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 13:08:01.550427 26915 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:01.531932 26899 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.000s
I20260709 13:08:01.508702 26862 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.498656 27003 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:01.554510 21948 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:01.513861 26926 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.412396 27040 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.558831 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1796) took 1118 ms. Trace:
I20260709 13:08:01.564703 22019 rpcz_store.cc:276] 0709 13:08:00.440448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.482687 (+ 42239us) service_pool.cc:224] Handling call
0709 13:08:00.483040 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.692406 (+209366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.692450 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.701770 (+  9320us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.755617 (+ 53847us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:00.755983 (+   366us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.756252 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.906534 (+150282us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540017cad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:00.906593 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.459335 (+552742us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:01.558520 (+ 99185us) raft_consensus.cc:1685] finished
0709 13:08:01.558551 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.558747 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7232,"prepare.queue_time_us":171,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":7949,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":10227,"spinlock_wait_cycles":482950144,"thread_start_us":27702,"threads_started":1,"wal-append.queue_time_us":146325}
W20260709 13:08:01.568507 21987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.028s	sys 0.050s
W20260709 13:08:01.568918 21987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.028s	sys 0.050s
W20260709 13:08:01.569608 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 582310us
I20260709 13:08:01.571257 22576 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:01.493512 27086 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.573828 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:01.574654 21873 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:01.574909 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.452401 26668 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:08:01.585574 22608 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:01.187258 26935 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.577209 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:01.596578 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:01.597455 21948 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:01.601902 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:01.606220 21838 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:01.609865 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2504) took 1234 ms. Trace:
I20260709 13:08:01.599627 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:01.610350 21949 rpcz_store.cc:276] 0709 13:08:00.375684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.375859 (+   175us) service_pool.cc:224] Handling call
0709 13:08:00.389233 (+ 13374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.565944 (+176711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.566029 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.598682 (+ 32653us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.965149 (+366467us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:00.965205 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.965308 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.198489 (+233181us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:01.578698 (+380209us) raft_consensus.cc:1685] finished
0709 13:08:01.578729 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.609792 (+ 31063us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34797,"raft.queue_time_us":95406,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"spinlock_wait_cycles":139357952,"thread_start_us":392343,"threads_started":2,"wal-append.queue_time_us":480130}
I20260709 13:08:01.613652 21947 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:01.614177 21947 pending_rounds.cc:85] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 10
I20260709 13:08:01.614408 21947 pending_rounds.cc:107] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:01.614645 21947 raft_consensus.cc:2889] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:01.616730 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.551839 27034 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:01.625102 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:01.628664 21943 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:01.514892 26961 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.561564 26796 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:01.633580 21987 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:01.451048 27061 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:01.639060 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 265705us
I20260709 13:08:01.649322 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:01.650378 21873 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
W20260709 13:08:01.630434 27085 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:08:01.644794 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:08:01.692011 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 47312.3us
I20260709 13:08:01.631508 27071 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:01.623669 26940 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:01.690127 21875 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.615826 26959 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:01.561600 26933 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.704036 26973 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:01.704712 26933 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.642910 26796 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:00.898622 21950 rpcz_store.cc:276] 0709 13:07:58.404677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.415701 (+1011024us) service_pool.cc:224] Handling call
0709 13:07:59.415969 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.416562 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:59.982920 (+566358us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.517083 (+534163us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b18004007e0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:08:00.800828 (+283745us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.869908 (+ 69080us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.870122 (+   214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.870179 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:00.870249 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.870341 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.881776 (+ 11435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":511483,"prepare.queue_time_us":545559,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":2861,"raft.queue_time_us":134064,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":8424,"spinlock_wait_cycles":37475328,"thread_start_us":864309,"threads_started":2,"wal-append.queue_time_us":408588}
I20260709 13:08:01.702608 26940 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.578035 26862 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.707626 21948 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:01.588191 27003 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.709189 22021 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:01.636402 27034 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:01.717468 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2815) took 1178 ms. Trace:
I20260709 13:08:01.726167 21871 rpcz_store.cc:276] 0709 13:08:00.539057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.540463 (+  1406us) service_pool.cc:224] Handling call
0709 13:08:00.540787 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.541012 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.541039 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.555197 (+ 14158us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.728957 (+173760us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:00.728995 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.729068 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.460783 (+731715us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:01.701271 (+240488us) raft_consensus.cc:1685] finished
0709 13:08:01.701290 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.717369 (+ 16079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22835072,"thread_start_us":146175,"threads_started":1,"wal-append.queue_time_us":315575}
I20260709 13:08:01.700531 27037 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:01.700774 26915 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:01.743016 27120 log.cc:927] Time spent T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:01.740684 26668 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:01.722299 26940 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.708452 26959 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:01.757930 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:01.749950 26668 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.759483 26668 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:01.760237 26961 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:01.760779 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:01.761454 21872 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:01.762315 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:01.762576 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:01.762856 21872 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.763243 21873 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:01.763595 27038 consensus_meta.cc:287] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.985s	user 0.008s	sys 0.003s
I20260709 13:08:01.764030 27038 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:01.765942 27003 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.766721 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:01.768452 21874 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:08:01.769385 26917 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:01.777628 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:01.755115 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:01.786119 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:01.783887 21942 raft_consensus.cc:2376] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13. Re-sending same reply.
I20260709 13:08:01.789752 21873 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:01.744866 27037 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:01.757082 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:01.791340 22019 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:01.791733 21871 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:01.773823 21872 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:01.747781 26915 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:01.718720 27071 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.792891 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:01.790270 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.773005 26959 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.794543 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:01.794678 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:01.788885 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:01.974571 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.917793 22015 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:01.854138 21867 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:08:01.949050 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.849573 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:01.795253 27119 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 13:08:01.802721 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.782238 26917 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:01.946175 26893 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.000s
I20260709 13:08:01.988807 21871 raft_consensus.cc:2410] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:08:01.891232 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.880728 21946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.014s	sys 0.028s
W20260709 13:08:02.001605 21946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.024s	sys 0.028s
W20260709 13:08:01.985126 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 196353us
I20260709 13:08:01.910013 27040 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.853989 27032 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.004205 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:01.992349 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:01.994015 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:02.005998 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:02.007047 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:01.794626 27037 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.010630 21942 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:01.797827 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:01.927397 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1793) took 1549 ms. Trace:
I20260709 13:08:01.793093 27121 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:01.985199 21941 raft_consensus.cc:2376] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12. Re-sending same reply.
I20260709 13:08:02.014219 22022 rpcz_store.cc:276] 0709 13:08:00.384987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.431546 (+ 46559us) service_pool.cc:224] Handling call
0709 13:08:00.451450 (+ 19904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.884253 (+432803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.927038 (+1042785us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400209c54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:01.927309 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815009536}
W20260709 13:08:01.979997 27033 consensus_meta.cc:287] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.078s	user 0.006s	sys 0.003s
I20260709 13:08:02.015728 27042 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.831838 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2821) took 1013 ms. Trace:
I20260709 13:08:02.014442 27121 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.016719 21875 rpcz_store.cc:276] 0709 13:08:00.818199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.825278 (+  7079us) service_pool.cc:224] Handling call
0709 13:08:00.825620 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.701130 (+875510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.831499 (+130369us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540044f054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:01.831754 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987741440}
W20260709 13:08:02.017462 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 219736us
I20260709 13:08:02.013098 26862 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.018640 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:01.935528 26904 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.798252 26915 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.928098 27086 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.023121 21916 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:02.029868 21943 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:08:01.985725 27054 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:01.917768 26796 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:01.830441 27034 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:01.803733 27038 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:01.988204 27021 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.046408 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1683) took 1275 ms. Trace:
I20260709 13:08:01.858397 26973 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.052066 27121 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:02.016198 27042 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.061154 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2816) took 1513 ms. Trace:
I20260709 13:08:01.826524 26872 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.206s
I20260709 13:08:02.030463 26861 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.036410 27125 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:02.066036 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.066412 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.063167 21945 rpcz_store.cc:276] 0709 13:08:00.770677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.783422 (+ 12745us) service_pool.cc:224] Handling call
0709 13:08:00.783719 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.838007 (+ 54288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.838053 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.838695 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.346483 (+507788us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b1800390640. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:08:01.613661 (+267178us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:01.613716 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.613810 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.017569 (+403759us) raft_consensus.cc:1685] finished
0709 13:08:02.017587 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.046343 (+ 28756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4618,"raft.queue_time_us":53842,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":26052,"spinlock_wait_cycles":5036416,"thread_start_us":266943,"threads_started":1,"wal-append.queue_time_us":1086828}
I20260709 13:08:02.095882 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:02.060220 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 487508us
I20260709 13:08:02.036562 26893 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.069491 21866 rpcz_store.cc:276] 0709 13:08:00.547835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.548420 (+   585us) service_pool.cc:224] Handling call
0709 13:08:00.548922 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.549736 (+   814us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:00.549767 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.990581 (+440814us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b2c000014c8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:08:00.991001 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.032900 (+ 41899us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:01.032948 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.033018 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.060883 (+1027865us) raft_consensus.cc:1685] finished
0709 13:08:02.060906 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.061094 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":399,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":7477,"spinlock_wait_cycles":51231488,"thread_start_us":41590,"threads_started":1,"wal-append.queue_time_us":376565}
W20260709 13:08:02.064733 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 415473us
I20260709 13:08:02.092998 27051 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:02.069998 26796 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.112135 22573 leader_election.cc:336] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.240s (SENT)
I20260709 13:08:02.099797 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:02.037715 27033 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:08:02.131151 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.145162 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:02.147603 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:02.148525 22608 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.160269 22608 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:02.089758 27053 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.072140 27021 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.164182 27053 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.165998 27021 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.047470 26904 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.162993 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:02.168318 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:02.176362 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:02.177640 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:02.178761 21945 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:02.179174 21943 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.181262 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:02.183965 26904 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.185315 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:02.191061 26935 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.191787 26935 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:02.193260 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:02.185444 26926 consensus_meta.cc:287] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.002s
I20260709 13:08:02.193300 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:02.144869 27003 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.089696 26973 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:02.209214 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 209804us
I20260709 13:08:02.102239 27078 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:08:02.221989 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:02.226769 22019 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.176200 27053 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.089902 26917 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:02.239708 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 235567us
W20260709 13:08:02.242347 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.242842 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:02.161136 26796 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.144435 27051 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.252342 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:02.254134 22602 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:02.255486 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:02.256052 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75702.7us
I20260709 13:08:02.238930 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:02.257884 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.210215 26961 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.210695 27040 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.261473 22020 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:08:02.286119 22020 pending_rounds.cc:85] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 11
I20260709 13:08:02.286368 22020 pending_rounds.cc:107] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:08:02.286633 22020 raft_consensus.cc:2889] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.287853 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:02.272522 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:02.290760 22022 raft_consensus.cc:2410] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:02.292868 22020 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:02.294521 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:02.250850 27053 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.272284 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:02.211158 26668 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.247653 27135 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:02.302383 22603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 977) took 3580 ms (client timeout 2903 ms). Trace:
I20260709 13:08:02.303206 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:02.302843 22603 rpcz_store.cc:269] 0709 13:07:58.722539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.724506 (+  1967us) service_pool.cc:224] Handling call
0709 13:08:02.299045 (+3574539us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54006c2854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:02.302316 (+  3271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4939538688}
I20260709 13:08:02.305883 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:02.282572 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:02.283535 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 183804us
I20260709 13:08:02.223459 27003 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.309629 22576 leader_election.cc:400] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13.
I20260709 13:08:02.246537 27008 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:08:02.271090 26917 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:02.328523 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 90948us
I20260709 13:08:02.260524 21943 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:02.279228 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:02.336496 21872 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:08:02.337039 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:02.311662 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:02.280275 22016 raft_consensus.cc:2410] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:02.338912 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:02.246717 26904 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:08:02.319250 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:02.313002 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:02.342823 21867 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:02.273815 27097 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.108s	user 0.006s	sys 0.007s
I20260709 13:08:02.268617 22018 raft_consensus.cc:2368] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13.
W20260709 13:08:02.330229 27022 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.889s	user 0.008s	sys 0.005s
I20260709 13:08:02.326366 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:02.278903 22019 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:02.312618 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 216835us
I20260709 13:08:02.360776 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.299907 26961 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.279628 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:02.339537 22016 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:08:02.343945 22608 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.308276 27135 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:02.367832 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:02.368566 21943 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:02.342113 27008 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:02.369656 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:02.348397 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:02.277251 26936 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.881s	user 0.013s	sys 0.000s
W20260709 13:08:02.349045 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 76802.6us
I20260709 13:08:02.277347 27134 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:08:02.296722 27071 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.383266 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:02.362948 22021 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
W20260709 13:08:02.372360 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 89892.9us
I20260709 13:08:02.398494 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:02.393832 22608 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:02.400164 21943 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:02.403144 21943 pending_rounds.cc:85] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 6
I20260709 13:08:02.403515 21943 pending_rounds.cc:107] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:02.403849 21943 raft_consensus.cc:2889] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.401734 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.401693 22018 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:02.414523 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:02.417028 21873 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:02.329234 27053 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.430886 22019 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
W20260709 13:08:02.370131 26792 consensus_meta.cc:287] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.352s	user 0.008s	sys 0.005s
W20260709 13:08:02.436575 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 53381.1us
W20260709 13:08:02.438503 27136 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:02.397918 26936 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.441809 26915 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.442276 27037 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.369310 27008 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:02.475898 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 74249.4us
I20260709 13:08:02.476325 22022 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:08:02.476881 22022 pending_rounds.cc:85] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 10
I20260709 13:08:02.369498 27135 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.355535 27097 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.477172 22022 pending_rounds.cc:107] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:08:02.570331 22022 raft_consensus.cc:2889] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.361518 27022 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.371345 27142 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:02.507658 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.574355 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.476892 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.577337 27153 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:02.572459 27096 consensus_meta.cc:287] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.125s	user 0.016s	sys 0.007s
W20260709 13:08:02.578495 21941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.002s
W20260709 13:08:02.579677 21941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.006s	sys 0.003s
W20260709 13:08:02.580082 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 103284us
W20260709 13:08:02.582024 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 259410us
W20260709 13:08:02.582873 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.477787 27078 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:02.586464 26862 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.579286 26821 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.563876 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 203195us
I20260709 13:08:02.564920 21870 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:08:02.566762 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.567219 21867 raft_consensus.cc:2410] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:08:02.500061 26904 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.477300 26792 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:02.569490 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 97508.9us
I20260709 13:08:02.598258 21987 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:02.564124 27032 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:02.592888 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 138502us
I20260709 13:08:02.448199 27021 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.127s
I20260709 13:08:02.608291 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:02.587803 26940 consensus_meta.cc:287] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.009s
W20260709 13:08:02.600633 26860 consensus_meta.cc:287] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.675s	user 0.013s	sys 0.000s
I20260709 13:08:02.607177 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:02.586935 27125 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.587268 27154 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.600201 27078 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.592314 26821 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.609184 27040 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.626889 26940 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.573544 26935 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:02.607805 27054 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:02.641345 27165 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:02.648312 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:02.630576 27148 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:08:02.655618 26893 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.657050 27135 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.660245 27171 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.611255 27149 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:02.661252 27149 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:02.660990 27171 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.661749 27149 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.663825 27171 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.665345 26961 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.638692 26936 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.669128 26936 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:02.669699 26936 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:02.634225 27144 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:08:02.645907 27154 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.602547 26904 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.591365 27161 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:08:02.652012 27054 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.680475 27078 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.640892 27051 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.640686 27040 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.678763 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:02.629299 26860 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:02.600529 27008 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.634181 27003 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.638175 26821 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.641341 27169 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:02.714600 27169 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:02.715571 27169 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:02.688944 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 349928us
I20260709 13:08:02.690342 26940 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.664516 27171 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.718426 27171 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.692309 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:02.720218 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:02.676103 26668 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.628721 27163 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:08:02.704909 27053 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.705163 27090 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.705778 26915 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.707381 27040 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.708514 27022 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:02.691534 27037 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.709754 27097 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.709868 27034 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:02.629439 27125 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.701078 27078 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:02.737560 27033 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.710644 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3081) took 1040 ms. Trace:
I20260709 13:08:02.711351 26662 raft_consensus.cc:3055] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:02.712093 27154 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.692728 27168 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:08:02.672621 27165 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.720371 21947 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:02.672005 26936 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.722024 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:02.700266 27055 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:02.738452 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 130214us
W20260709 13:08:02.737080 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 134766us
I20260709 13:08:02.693228 27054 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:02.741827 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 141241us
I20260709 13:08:02.825385 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:02.826535 21867 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:02.827814 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:02.742237 26959 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.002s
I20260709 13:08:02.737622 27143 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:02.755034 22023 rpcz_store.cc:276] 0709 13:08:01.670343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.731537 (+ 61194us) service_pool.cc:224] Handling call
0709 13:08:01.731981 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.737511 (+  5530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.737542 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.747803 (+ 10261us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.131401 (+383598us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:02.131439 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.131505 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.710414 (+578909us) raft_consensus.cc:1685] finished
0709 13:08:02.710436 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.710583 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":644,"raft.queue_time_us":8400,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2308,"thread_start_us":340189,"threads_started":1,"wal-append.queue_time_us":787557}
I20260709 13:08:02.759816 27176 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.829486 26959 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.832182 26959 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.760143 27078 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:02.812944 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.745769 26915 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.744576 26650 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:02.835264 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:02.758054 26662 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:02.752436 27034 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:02.837796 21866 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:02.839654 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:02.839704 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:02.840468 21872 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.849242 21875 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:02.849531 21943 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.758715 27032 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:02.817312 27142 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.844349 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:02.845808 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:02.846359 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:02.846967 21941 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:02.849654 21949 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:08:02.835717 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 113772us
I20260709 13:08:02.852563 22603 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 15: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:02.854246 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:02.855625 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:02.855189 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:02.857558 26662 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.847527 27161 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:08:02.842167 27143 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:02.863466 27143 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.867143 27055 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:02.868299 27055 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.836838 26936 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:02.839316 27033 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.879613 27053 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:02.881127 26904 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:02.881788 26904 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:02.887310 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:02.888084 22602 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:02.890807 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:02.888371 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.894950 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:02.899225 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:02.899709 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:02.896297 21943 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:02.919646 22610 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:02.919932 22602 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.921090 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:02.921264 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:02.922940 21839 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:02.920363 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:02.937139 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 176047us
I20260709 13:08:02.938838 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3065) took 1760 ms. Trace:
I20260709 13:08:02.883229 27154 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.940011 22015 rpcz_store.cc:276] 0709 13:08:01.178520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.182573 (+  4053us) service_pool.cc:224] Handling call
0709 13:08:01.182946 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.983558 (+800612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.938570 (+955012us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400236754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:02.938777 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689241472}
I20260709 13:08:02.882550 27165 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.942185 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.942934 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:02.944423 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 225364us
I20260709 13:08:02.944588 27179 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.945267 26959 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.889778 26940 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:02.890662 26893 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:02.961719 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:02.962030 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.954917 22574 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:02.845789 26915 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.945267 27161 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:02.966557 21875 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:02.924701 26792 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.924906 27021 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.970467 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:02.974582 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.998974 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:02.926244 27003 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:02.996860 27178 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.001178 21867 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:02.891273 27142 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.002722 27178 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:02.960857 26959 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.003396 26915 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.003633 26959 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.003963 27161 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.004766 27142 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:02.938267 27174 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:08:03.006145 27161 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.006327 21867 pending_rounds.cc:85] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 8
I20260709 13:08:03.006916 21867 pending_rounds.cc:107] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:03.007360 21867 raft_consensus.cc:2889] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.008775 27032 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:03.009879 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.997761 27176 raft_consensus.cc:2764] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:08:03.013372 27054 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:02.952308 26825 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:02.946092 26936 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:08:02.961112 27179 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:02.964866 26940 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:03.043713 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 69982.3us
W20260709 13:08:03.045022 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 102929us
I20260709 13:08:02.973286 26917 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:02.969257 27177 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:03.020244 27170 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:02.998796 27154 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:03.052538 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:03.020439 27165 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:03.014564 26792 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:03.017776 27175 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.020181 27033 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.049542 26936 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:03.087248 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:03.024470 27179 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.055941 26825 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:03.063409 27134 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:03.069878 27154 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:03.077215 26792 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.085498 27178 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:03.098913 26936 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.070331 26917 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.111054 26917 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.111846 26825 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.091401 26940 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.114256 26940 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.093695 27149 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.091903 27188 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.108575 27078 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.105273 27154 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.117249 27149 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:02.970254 27034 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.098737 27168 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:03.111084 26936 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:03.130362 27123 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 1.393s	user 0.001s	sys 0.003s
I20260709 13:08:03.133339 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2823) took 2314 ms. Trace:
I20260709 13:08:03.133877 21868 rpcz_store.cc:276] 0709 13:08:00.818832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.034801 (+215969us) service_pool.cc:224] Handling call
0709 13:08:01.122453 (+ 87652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.122949 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.122993 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.135459 (+ 12466us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.489767 (+354308us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:01.489809 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.489890 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.129736 (+1639846us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:03.132869 (+  3133us) raft_consensus.cc:1685] finished
0709 13:08:03.132906 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.133246 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8458,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":16881920,"thread_start_us":353912,"threads_started":1,"wal-append.queue_time_us":500258}
I20260709 13:08:03.138306 27167 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.138796 26940 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:03.138826 27167 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:03.139525 26940 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.140024 27096 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.140215 27167 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.142102 26940 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.140659 27096 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.142499 27167 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.143159 27042 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:03.145074 21868 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.110718 26959 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.158258 26650 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:03.158951 26650 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.160756 27154 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.163551 27154 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.117841 27033 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:03.124090 27193 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:03.148291 21868 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:03.149555 27096 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.150394 26973 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.151307 26899 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:03.176403 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.190814 26899 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:03.191905 26899 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.176403 27034 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:03.165766 27132 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.970s	user 0.001s	sys 0.000s
W20260709 13:08:03.196697 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.211833 21871 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:03.193485 26796 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.226558 27160 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:03.227214 27160 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:03.230487 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 290707us
I20260709 13:08:03.169755 27154 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:03.242172 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.243055 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.244730 21949 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:03.196424 27125 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.210709 27135 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.249857 26899 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.251758 26650 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:03.255290 27157 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.691s	user 0.000s	sys 0.003s
I20260709 13:08:03.256219 26650 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:03.261425 27061 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.193077 26792 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.273995 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.275068 21949 raft_consensus.cc:2410] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:08:03.278959 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.279623 22021 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:03.281116 22023 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:03.281592 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.282497 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.283059 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:03.283277 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.283952 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:03.282521 22015 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:08:03.284615 22022 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.284801 22015 pending_rounds.cc:85] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 8
I20260709 13:08:03.285104 22015 pending_rounds.cc:107] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:08:03.284984 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.285413 22015 raft_consensus.cc:2889] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.285625 22023 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:03.286456 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.286543 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.286852 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:03.287014 22023 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:08:03.287575 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.284240 22018 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:03.283255 22019 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:03.253146 27154 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.288852 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:03.266175 27054 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.252724 27160 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.292579 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:03.618989 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.303126 22022 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:03.288729 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.622390 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:03.287215 22015 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:03.625144 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.626024 22016 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:03.626264 22015 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:03.622574 21949 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:08:03.329193 26906 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:03.624292 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:03.536588 27129 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 1.359s	user 0.000s	sys 0.004s
W20260709 13:08:03.615029 21839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.009s	sys 0.009s
W20260709 13:08:03.640973 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.010s	sys 0.010s
I20260709 13:08:03.650640 26961 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:03.576670 27159 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.014s	sys 0.001s
I20260709 13:08:03.651798 26961 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:03.652972 27159 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.016s	sys 0.001s
I20260709 13:08:03.538818 27008 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:03.654731 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.326704 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 744) took 2508 ms. Trace:
I20260709 13:08:03.657094 26862 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.658068 26862 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.360375 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:03.657648 22605 rpcz_store.cc:276] 0709 13:08:00.818176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.823767 (+  5591us) service_pool.cc:224] Handling call
0709 13:08:00.824191 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.824411 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:00.886250 (+ 61839us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.466662 (+580412us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b180026ae80. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c1223a 00007f635607ca2a
0709 13:08:03.153505 (+1686843us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b180026ae80. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf 00007f635608c038
0709 13:08:03.165159 (+ 11654us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:03.325813 (+160654us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.326124 (+   311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.326196 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:03.326265 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.326464 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.326625 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52230,"prepare.queue_time_us":1244804,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":10971,"raft.queue_time_us":221,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":8358,"spinlock_wait_cycles":29488640,"thread_start_us":605602,"threads_started":2,"wal-append.queue_time_us":1214045}
I20260709 13:08:03.505458 27051 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.629307 26936 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:03.287467 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:03.440683 26792 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:02.995494 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:03.665760 27031 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.684852 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:03.667850 27051 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:03.685914 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:03.687752 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:03.687311 27051 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.688555 22606 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:03.339651 27198 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 13:08:03.669312 22020 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:03.463734 27156 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.893s	user 0.001s	sys 0.005s
W20260709 13:08:03.382576 27158 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.002s	sys 0.007s
W20260709 13:08:03.703858 27158 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.008s	sys 0.023s
I20260709 13:08:03.704304 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 761) took 1584 ms. Trace:
I20260709 13:08:03.668947 22021 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
W20260709 13:08:03.554898 27141 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.914s	user 0.007s	sys 0.002s
I20260709 13:08:03.713544 21874 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:03.713967 22607 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.715008 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1689) took 2092 ms. Trace:
I20260709 13:08:03.715480 21947 rpcz_store.cc:276] 0709 13:08:01.622563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.633821 (+ 11258us) service_pool.cc:224] Handling call
0709 13:08:01.635773 (+  1952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.765510 (+1129737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.714538 (+949028us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540032a354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:03.714800 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493449088}
I20260709 13:08:03.676651 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:03.720744 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.444550 26821 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.724625 26821 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.725754 26961 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.726538 21948 raft_consensus.cc:2410] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:08:03.670805 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 378180us
I20260709 13:08:03.726653 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:03.727651 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:03.728046 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:03.728570 22607 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.721318 21869 raft_consensus.cc:2410] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:08:03.682101 21873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 2289) took 1404 ms (client timeout 1532 ms). Trace:
I20260709 13:08:03.679883 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:03.733127 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.455587 26662 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:03.676748 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:03.735687 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:03.729461 21873 rpcz_store.cc:269] 0709 13:08:02.277348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.279317 (+  1969us) service_pool.cc:224] Handling call
0709 13:08:03.681630 (+1402313us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b5400217d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:03.681864 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117683584}
I20260709 13:08:03.743793 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:03.744819 26872 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:03.745620 26872 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:03.746917 21869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 2269) took 1985 ms (client timeout 1526 ms). Trace:
W20260709 13:08:03.747295 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.747427 21869 rpcz_store.cc:269] 0709 13:08:01.750579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.752686 (+  2107us) service_pool.cc:224] Handling call
0709 13:08:03.676124 (+1923438us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:08:03.735662 (+ 59538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39747968}
I20260709 13:08:03.748222 26872 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.748891 26988 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:03.291949 27196 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.744843 22602 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.724462 26862 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:03.744454 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.317924 26959 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.761947 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:03.763697 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2285) took 1487 ms. Trace:
I20260709 13:08:03.773518 21943 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.764926 26988 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.435281 27033 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.503130 27171 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.781754 27176 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:03.783699 22608 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:03.668617 26936 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.705020 21945 rpcz_store.cc:276] 0709 13:08:02.119927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.196355 (+ 76428us) service_pool.cc:224] Handling call
0709 13:08:02.196720 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.205015 (+  8295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.205060 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.205651 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.342799 (+137148us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:02.433275 (+ 90476us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.445567 (+ 12292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.445658 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.366704 (+921046us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:03.703406 (+336702us) raft_consensus.cc:1685] finished
0709 13:08:03.703609 (+   203us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.703991 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11996,"prepare.queue_time_us":296423,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":24103,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":37464,"spinlock_wait_cycles":17176064,"thread_start_us":226525,"threads_started":2,"wal-append.queue_time_us":208352}
I20260709 13:08:03.771723 27051 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.752487 21987 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:03.772753 21866 rpcz_store.cc:276] 0709 13:08:02.275949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.280499 (+  4550us) service_pool.cc:224] Handling call
0709 13:08:02.281125 (+   626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.848511 (+567386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.763189 (+914678us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54000e10d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:03.763518 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271385856}
I20260709 13:08:03.796521 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 752) took 2042 ms. Trace:
I20260709 13:08:03.797184 21948 rpcz_store.cc:276] 0709 13:08:01.754150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.754289 (+   139us) service_pool.cc:224] Handling call
0709 13:08:03.787713 (+2033424us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400299354. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:03.796406 (+  8693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4524307840}
I20260709 13:08:03.798817 26796 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:03.802175 22607 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
I20260709 13:08:03.811690 21941 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:03.674283 21771 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 8 to 11, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 11 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:03.822000 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:03.799685 27176 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.799710 26796 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:03.832572 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 80521.5us
I20260709 13:08:03.822799 26862 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.554332 27179 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.858793 26861 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.837028 26872 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.851634 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:03.853232 26825 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:03.881906 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:03.874049 27031 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:03.861112 26861 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.867332 27040 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:03.891188 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:03.900811 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:03.902256 27084 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:03.903183 26796 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.903064 27084 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.903270 26861 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.893074 27031 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.906844 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:03.892306 27196 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:03.907260 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 43702.8us
W20260709 13:08:03.913115 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 185389us
I20260709 13:08:03.892712 26862 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:03.907353 22573 leader_election.cc:336] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.713s (SENT)
I20260709 13:08:03.914770 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:03.914700 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.906780 27031 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.906368 26821 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.918813 21869 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:03.925824 27003 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.904678 26872 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.923185 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:03.928141 27003 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.931360 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.932826 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 756) took 2137 ms. Trace:
I20260709 13:08:03.934098 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 884) took 1082 ms. Trace:
I20260709 13:08:03.933226 21950 rpcz_store.cc:276] 0709 13:08:01.795351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.795477 (+   126us) service_pool.cc:224] Handling call
0709 13:08:01.805057 (+  9580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.805541 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.805586 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.833627 (+ 28041us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.227636 (+394009us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:02.227691 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.227785 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.548807 (+1321022us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:03.926553 (+377746us) raft_consensus.cc:1685] finished
0709 13:08:03.930643 (+  4090us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.932670 (+  2027us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":839,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":25520,"spinlock_wait_cycles":9472384,"thread_start_us":308262,"threads_started":1,"wal-append.queue_time_us":762636}
I20260709 13:08:03.934456 21874 rpcz_store.cc:276] 0709 13:08:02.851644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.884220 (+ 32576us) service_pool.cc:224] Handling call
0709 13:08:03.712664 (+828444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.714099 (+  1435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.929473 (+215374us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400217d50. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:03.934039 (+  4566us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858874624}
I20260709 13:08:03.935165 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2272) took 2183 ms. Trace:
I20260709 13:08:03.935598 27176 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.935529 21870 rpcz_store.cc:276] 0709 13:08:01.751685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.753630 (+  1945us) service_pool.cc:224] Handling call
0709 13:08:01.765608 (+ 11978us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800010e98. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b04bfc0 00007f635b036929 00007f635b0363d2 00007f63545adbd4
0709 13:08:01.765806 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.595555 (+829749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.928306 (+1332751us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400218254. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:03.934986 (+  6680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687943424}
I20260709 13:08:03.936484 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:03.937425 21869 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:03.938330 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:03.942028 21942 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:03.928448 27196 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.946146 21866 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:03.926672 26988 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:03.948361 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:03.953087 21945 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:03.957212 27061 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:03.965466 21867 raft_consensus.cc:2368] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14.
I20260709 13:08:03.943620 27040 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:03.959641 26936 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.959529 27084 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.970995 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.959383 27061 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:03.976343 21942 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:03.978896 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:03.979748 21950 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.980096 21870 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.982841 26872 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:03.985173 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 111709us
I20260709 13:08:03.986380 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:03.988965 27154 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:03.979120 27061 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:03.993304 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:03.975806 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:03.973663 21771 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 7 to 10, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 10 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.995090 21867 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:03.991329 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 744) took 2723 ms. Trace:
I20260709 13:08:04.006126 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.006923 21941 raft_consensus.cc:2468] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:04.007730 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.013772 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:04.014263 27146 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.014971 27146 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:04.011478 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58622.4us
I20260709 13:08:04.018476 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:03.972337 26988 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:03.995548 21946 rpcz_store.cc:276] 0709 13:08:01.196490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.198174 (+  1684us) service_pool.cc:224] Handling call
0709 13:08:01.198500 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.198912 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.198939 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.199398 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.717789 (+2518391us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800174a00. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1
0709 13:08:03.718250 (+   461us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:03.718935 (+   685us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.894237 (+175302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.901808 (+  7571us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.906142 (+  4334us) raft_consensus.cc:1685] finished
0709 13:08:03.911060 (+  4918us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.919332 (+  8272us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":301,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":62,"raft.queue_time_us":8669,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":46975,"spinlock_wait_cycles":35454208,"thread_start_us":968883,"threads_started":2,"wal-append.queue_time_us":998455,"wal-append.run_cpu_time_us":1833,"wal-append.run_wall_time_us":1002400}
I20260709 13:08:04.033104 21949 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
W20260709 13:08:04.034507 21773 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 253) took 31206 ms (client timeout 15000 ms). Trace:
I20260709 13:08:04.037106 27160 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.040776 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:04.041988 21872 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.043035 27159 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:04.044117 21838 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.852s (SENT) [suppressed 15 similar messages]
I20260709 13:08:04.044024 26906 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:04.055927 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.056905 21875 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:08:04.057428 27146 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:04.059046 27003 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.063268 27179 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.021423 27154 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.065201 27154 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.067595 27154 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.068761 27033 raft_consensus.cc:2764] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:04.070118 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.070307 26862 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.071810 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:04.074054 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.074775 22606 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:04.074842 21941 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:04.075416 27176 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.077036 21944 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:04.079162 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.080818 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.088038 27040 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.090152 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:04.091432 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 149314us
I20260709 13:08:04.093111 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:04.094201 27160 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.096853 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.097131 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.097816 22017 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:04.098965 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:04.104321 27217 log.cc:927] Time spent T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.152s	user 0.003s	sys 0.000s
W20260709 13:08:04.106949 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.106829 27196 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.059865 21771 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.113300 21943 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:04.118129 22602 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:04.118856 21950 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
W20260709 13:08:04.136861 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 148717us
W20260709 13:08:04.147374 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.148149 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.152808 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:04.153745 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:04.154464 21945 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.159999 21949 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:04.161309 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.021593 26821 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 13:08:04.178210 26959 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.178915 26959 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.179708 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:04.181404 26933 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:04.181803 26933 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:04.182152 26933 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.182319 26959 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.185252 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.185565 21839 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:04.186121 22606 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:04.178285 26796 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:04.189853 27037 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:04.189687 26796 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.190507 27037 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:04.191704 27037 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.196349 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:04.196393 27176 consensus_queue.cc:1059] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:04.197846 27176 raft_consensus.cc:3055] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.198318 27176 raft_consensus.cc:740] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:04.199601 27176 consensus_queue.cc:260] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.141235 26988 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.167573 27154 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.046479 21773 rpcz_store.cc:269] 0709 13:07:32.828181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.828766 (+   585us) service_pool.cc:224] Handling call
0709 13:07:32.918988 (+ 90222us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdc090 00007f635607af3a 00007f635be311cc 00007f635bf2f37e 00007f635a3f02a4 00007f635a3f0232 00007f635a3f0161 00007f635a3f00dc 00007f635a3ef392 00007f63543ad48c 00007f63543ac8c6
0709 13:08:04.034226 (+31115238us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:51.162280 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:51.237623 (+ 75343us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:51.237700 (+    77us) write_op.cc:435] Acquired schema lock
0709 13:07:51.237728 (+    28us) tablet.cc:662] Decoding operations
0709 13:07:51.239298 (+  1570us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:51.239403 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:51.239431 (+    28us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:51.272390 (+ 32959us) tablet.cc:701] Row locks acquired
0709 13:07:51.317707 (+ 45317us) write_op.cc:260] PREPARE: finished
0709 13:07:51.362921 (+ 45214us) write_op.cc:270] Start()
0709 13:07:51.400968 (+ 38047us) write_op.cc:276] Timestamp: P: 1783602471334648 usec, L: 0
0709 13:07:51.404045 (+  3077us) op_driver.cc:348] REPLICATION: starting
0709 13:07:51.466676 (+ 62631us) log.cc:844] Serialized 5850 byte log entry
0709 13:07:52.316204 (+849528us) op_driver.cc:464] REPLICATION: finished
0709 13:07:52.622214 (+306010us) write_op.cc:301] APPLY: starting
0709 13:07:52.634572 (+ 12358us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:52.783400 (+148828us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635606f32a 00007f6355ff4f14 00007f6355ff4ec3 00007f6355ff4e38 00007f6355ff4df3 00007f6355ff40dc 00007f635601de16 00007f6356005cbb 00007f6355ff039d 00007f6355ff3d75
0709 13:07:52.820190 (+ 36790us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:52.820230 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:53.463937 (+643707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:53.464454 (+   517us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:07:53.464526 (+    72us) write_op.cc:312] APPLY: finished
0709 13:07:53.693587 (+229061us) log.cc:844] Serialized 139 byte log entry
0709 13:07:54.061395 (+367808us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:54.155214 (+ 93819us) write_op.cc:454] Released schema lock
0709 13:07:54.165864 (+ 10650us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:54.192754 (+ 26890us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:54.192782 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4773876,"reported_tablets":48,"spinlock_wait_cycles":9969920,"child_traces":[["op",{"apply.queue_time_us":279602,"apply.run_cpu_time_us":70830,"apply.run_wall_time_us":1575924,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66917,"num_ops":15,"prepare.queue_time_us":216880,"prepare.run_cpu_time_us":15990,"prepare.run_wall_time_us":530085,"raft.queue_time_us":249944,"raft.run_cpu_time_us":80251,"raft.run_wall_time_us":514803,"replication_time_us":894932,"spinlock_wait_cycles":54537472,"thread_start_us":765192,"threads_started":5,"wal-append.queue_time_us":869307,"wal-append.run_cpu_time_us":22604,"wal-append.run_wall_time_us":2407782}]]}
I20260709 13:08:04.206076 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.201241 26933 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.202557 26936 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:04.166664 27040 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.219821 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.171212 27179 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.222204 27176 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.221880 21771 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 5 to 8, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 8 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:04.203374 27146 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.238879 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:04.239702 22015 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.240911 27171 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:04.241063 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:04.241602 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.242036 22024 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 15: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:04.241811 27171 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.242336 22023 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:04.243016 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.243388 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.244135 27171 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.244170 22023 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:04.218206 26796 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.223652 26936 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:04.249058 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 205059us
I20260709 13:08:04.244227 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.261164 22015 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
W20260709 13:08:04.263590 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.263876 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.264309 22024 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:04.280778 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.280684 27146 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.281683 22015 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:04.227949 27154 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.283669 22021 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:04.261392 26936 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.289615 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:04.306370 27216 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
W20260709 13:08:04.315217 22020 consensus_meta.cc:287] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.002s
I20260709 13:08:04.316128 22020 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:04.316836 22023 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:08:04.318611 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 81701.3us
I20260709 13:08:04.318668 22022 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.278218 27040 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.282752 27179 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.321766 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:04.324661 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.322177 21987 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:04.333633 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.329903 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1828) took 1041 ms. Trace:
I20260709 13:08:04.334875 22020 rpcz_store.cc:276] 0709 13:08:03.285502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.360007 (+ 74505us) service_pool.cc:224] Handling call
0709 13:08:04.322328 (+962321us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:04.336617 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 128295us
I20260709 13:08:04.341002 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:04.354460 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.355876 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.356966 27054 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:04.357237 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.358428 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.358584 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.359125 21946 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:04.359879 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:04.360944 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:04.360417 21942 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.336755 27146 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.368754 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:04.369066 21944 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:04.358493 27003 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.346530 26933 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.386610 21948 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:04.337546 27031 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.366348 27054 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:04.393502 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:04.398011 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 60409.1us
I20260709 13:08:04.381618 27158 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.401562 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.402237 21941 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:04.403137 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.404239 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.442910 22020 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:04.383044 27003 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:04.445744 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.395964 27160 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:04.447741 21916 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.457137 27031 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.457599 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.458285 21950 raft_consensus.cc:1240] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:04.459007 22017 raft_consensus.cc:2368] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 16. Current term is 17.
I20260709 13:08:04.459834 21950 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:04.460686 27054 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:04.463533 27051 consensus_meta.cc:287] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.000s
I20260709 13:08:04.464722 27008 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.465108 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.465332 27008 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.466269 22020 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:04.467584 27008 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.464743 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.469532 21943 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:04.445889 26862 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:04.475666 21869 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:08:04.476554 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:04.478325 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.480551 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:04.481765 21872 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:08:04.482692 21949 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 15: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:04.483006 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:04.488426 21870 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:04.440688 26821 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:04.491204 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 43548.2us
I20260709 13:08:04.494738 22020 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:04.445921 27040 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.502794 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:04.516314 21869 raft_consensus.cc:2410] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:08:04.516048 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.496284 27219 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:04.520464 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:04.521154 22018 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.527493 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:04.528155 21872 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.528754 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:04.529608 22015 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:04.499359 26872 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.531788 26872 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.532265 26872 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:04.532799 27230 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.224s	user 0.000s	sys 0.003s
I20260709 13:08:04.535748 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:04.536947 21866 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:04.537621 27154 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.540030 27179 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.540961 21941 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 8: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:04.541798 27003 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.543530 27003 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.545894 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:04.547042 27232 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:08:04.547214 26933 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:04.548105 26933 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:04.548466 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.549237 22606 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:04.549108 26933 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:04.552835 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.558156 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 156953us
I20260709 13:08:04.558689 21839 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:04.559494 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 190792us
W20260709 13:08:04.560249 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.557621 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.561862 21872 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:04.563320 21943 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.564522 21945 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:04.567883 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:04.573526 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 75508.1us
I20260709 13:08:04.490855 27160 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.575737 22020 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:04.565785 27154 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.517017 26821 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.579164 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.576043 26862 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:04.587320 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:04.580971 27154 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.591802 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.596038 26861 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:04.598444 22606 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:08:04.587467 26862 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.606480 21866 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:04.519551 27219 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.595255 27154 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.610003 21943 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:04.612275 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.616283 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.607224 26862 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.618136 26861 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:04.621443 26861 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.628765 22602 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:04.634640 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:04.635089 21869 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:04.636904 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:04.638192 27159 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:04.638615 27159 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.638981 27159 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.639169 26936 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.640807 26961 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:04.641422 26961 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:04.642372 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 166975us
I20260709 13:08:04.643539 26961 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.643692 21987 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.639325 21875 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.609436 27084 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:08:04.646037 27219 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.646668 27219 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.647015 27219 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:04.644824 21875 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:04.648038 21875 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.649438 21875 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.662940 22018 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:04.667449 21942 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:04.635433 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:04.676234 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.647856 27219 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:04.684844 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49609.8us
I20260709 13:08:04.688637 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.689576 22018 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:04.695117 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:04.695667 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:04.698916 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:04.700207 22602 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:04.703692 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.707425 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.717338 21866 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:04.705967 21988 connection.cc:256] RPC call timeout handler was delayed by -1.5306529950000822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:08:04.696624 26961 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:04.731916 22020 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:04.736244 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.746073 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.746802 22605 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 15: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:08:04.746697 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 73201.2us
W20260709 13:08:04.754894 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.794984 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 199899us
W20260709 13:08:04.793808 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49908.4us
W20260709 13:08:04.797520 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 52226.2us
I20260709 13:08:04.798143 21987 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.806818 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.807849 22602 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:04.729749 26961 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:04.811106 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.812777 27247 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.806207 26936 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.813381 27247 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.799081 26872 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.813865 27247 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.815554 26872 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.813508 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:04.815264 27154 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:04.818071 22608 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.734923 27179 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:08:04.825582 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:04.828809 27038 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 13:08:04.829464 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:04.852622 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.828758 21871 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:04.852705 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.837486 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:04.823231 21916 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.844949 21869 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:04.830168 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.855139 22605 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:04.860332 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 112539us
W20260709 13:08:04.856705 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 55986.1us
I20260709 13:08:04.830528 22020 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:08:04.854458 22603 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:04.861361 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.828689 27183 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:04.844766 27176 consensus_meta.cc:287] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 13:08:04.743327 27040 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.118s
I20260709 13:08:04.887732 21875 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:08:04.889576 22017 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:04.890623 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:04.888306 21875 pending_rounds.cc:85] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 8
W20260709 13:08:04.845767 27227 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.554s	user 0.003s	sys 0.001s
I20260709 13:08:04.867841 21916 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:04.837152 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:04.896209 22610 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.820276 26961 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.873557 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:08:04.881142 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 186098us
I20260709 13:08:04.882845 26821 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.883463 22608 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:04.821931 27033 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:04.881175 22607 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:04.866166 27061 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:04.897323 22608 pending_rounds.cc:85] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 8
I20260709 13:08:04.901765 22017 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:04.876590 27008 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:04.828689 27122 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.188s
I20260709 13:08:04.876623 27183 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.895134 21875 pending_rounds.cc:107] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:08:04.915861 21875 raft_consensus.cc:2889] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:04.902048 22608 pending_rounds.cc:107] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:04.916587 22608 raft_consensus.cc:2889] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:04.912727 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44997us
W20260709 13:08:04.914320 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 107824us
I20260709 13:08:04.923085 26862 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:04.903007 27061 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:04.925099 27061 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:04.926177 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:04.928469 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:04.927244 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 74766.1us
I20260709 13:08:04.904585 27176 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:04.925700 26862 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.907241 27008 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.926556 27183 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.910501 27033 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:04.948637 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:04.905968 27158 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:08:04.946537 27176 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.950837 27008 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.952476 26821 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.966370 27239 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:04.967737 26988 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:04.967903 27233 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.968284 27246 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:04.968762 26662 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:04.969138 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76607.6us
I20260709 13:08:04.971061 27154 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:04.973229 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:05.013316 22608 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.975680 27219 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.981105 27071 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:04.982079 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.962322 27176 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.983187 27040 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:04.986367 26825 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.989961 27229 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.713s	user 0.003s	sys 0.006s
I20260709 13:08:04.957208 26936 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:04.994172 27031 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:05.004845 22605 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:05.036067 22610 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:05.037736 22602 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:05.041481 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:05.043946 27246 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:05.044457 27246 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:05.045125 26862 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.045588 26862 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.045404 27246 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.046074 26862 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.046814 27246 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.037070 27031 consensus_queue.cc:1243] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:05.048787 27084 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:05.049718 27159 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.051105 26821 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:05.051498 26821 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:05.052006 27159 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:05.046866 26933 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.029614 26936 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.052990 22606 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:05.052866 26933 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.052903 26936 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.057803 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:05.055790 22574 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:05.062247 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76326.1us
W20260709 13:08:05.063858 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 119974us
I20260709 13:08:05.066854 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:05.068032 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:05.070436 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:05.021493 27071 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:05.080013 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 60743.2us
I20260709 13:08:05.051144 27160 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:05.029307 26825 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.072579 27037 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:05.142035 22608 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
W20260709 13:08:05.150271 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78606.1us
I20260709 13:08:05.080103 27071 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.151721 21839 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:05.087528 27223 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:05.183740 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:05.194514 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.198038 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:05.185102 27154 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:05.212306 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 81796.3us
I20260709 13:08:05.131121 27054 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:08:05.182641 27037 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:05.218762 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 151999us
I20260709 13:08:05.192575 26933 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:05.186492 26872 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:05.234377 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78752.8us
I20260709 13:08:05.208292 26662 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:05.238504 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:05.225143 27258 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:05.100208 27033 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.231599 27154 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:05.252255 21870 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:05.210335 27008 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.216753 26961 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.253736 27258 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:05.251454 27260 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:05.272360 27260 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:05.272873 27037 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:05.273671 27254 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:08:05.276443 26936 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.279074 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 684) took 1017 ms. Trace:
I20260709 13:08:05.260499 27261 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:05.283900 22024 rpcz_store.cc:276] 0709 13:08:04.261786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.397203 (+135417us) service_pool.cc:224] Handling call
0709 13:08:04.442890 (+ 45687us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.692966 (+250076us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:04.723508 (+ 30542us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.953218 (+229710us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:05.000859 (+ 47641us) log.cc:844] Serialized 52 byte log entry
0709 13:08:05.001053 (+   194us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:05.015288 (+ 14235us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.131219 (+115931us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.131498 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.131574 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.278834 (+147260us) raft_consensus.cc:1685] finished
0709 13:08:05.278856 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.279012 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219741,"prepare.queue_time_us":150546,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":2219,"raft.queue_time_us":230726,"raft.run_cpu_time_us":514,"raft.run_wall_time_us":28559,"thread_start_us":259300,"threads_started":2,"wal-append.queue_time_us":330608}
I20260709 13:08:05.271838 27258 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.272887 27260 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.266470 26862 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.344848 21944 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:08:05.345530 27223 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:05.333688 27179 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.351437 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:05.355501 27262 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:08:05.358289 26961 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:05.346514 27261 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:08:05.310046 27146 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:05.362862 27146 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:05.363255 27146 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:05.365365 26825 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:05.333474 27031 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:05.366709 27031 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:05.367112 27031 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:05.344122 27084 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:05.369091 27084 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.369273 27071 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.370532 27061 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.371321 27084 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:05.371556 27071 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:05.372102 27256 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.219s	user 0.001s	sys 0.001s
I20260709 13:08:05.375083 26821 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.364959 27154 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:05.378399 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 273936us
I20260709 13:08:05.385965 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:05.387251 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 83843.1us
W20260709 13:08:05.390564 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.384436 26861 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:05.392408 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.394564 27122 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:05.394919 26872 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:05.395741 26872 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.396111 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:05.396696 22021 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:05.397811 27255 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.269s	user 0.000s	sys 0.002s
I20260709 13:08:05.398029 26872 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:05.398845 27264 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.399309 27264 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:05.399771 27264 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:05.400689 27265 consensus_queue.cc:1059] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:08:05.401226 22023 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:05.388664 26936 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:05.395074 27122 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:05.385181 27247 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.001s
I20260709 13:08:05.393291 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:05.402055 27265 raft_consensus.cc:3055] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:05.393419 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:05.420744 21950 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:08:05.420920 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:05.422291 22021 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:05.424619 22015 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.368132 27031 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.429741 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:05.447342 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:05.364209 27146 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.403035 26821 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.389330 27061 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:05.455292 21916 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:05.393095 26861 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.468771 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:05.483695 22021 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
W20260709 13:08:05.491757 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 294744us
I20260709 13:08:05.381596 27179 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.501789 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:05.427335 27033 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:05.505574 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 56228.7us
I20260709 13:08:05.428287 27265 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:05.501566 21916 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:05.511375 27223 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:05.515595 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.519018 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 133159us
I20260709 13:08:05.427765 27247 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.532244 21949 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:05.497231 26988 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:05.537941 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:05.540930 27146 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.551167 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:05.539480 27061 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:05.554171 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:05.555627 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:05.516994 26936 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:05.537276 27031 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.573354 26988 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:05.574415 26988 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.556460 27054 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:05.578050 27054 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:05.579066 27054 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.580725 27061 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:05.581758 27061 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.561493 26961 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:05.584944 26961 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:05.585374 26961 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:05.587937 27176 consensus_meta.cc:287] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:08:05.497869 27273 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
W20260709 13:08:05.567387 27183 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.000s
I20260709 13:08:05.525669 27122 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.561043 27040 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:05.589313 27183 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.589906 27040 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.590304 27122 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.590827 22018 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:05.591118 22015 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:05.592720 27183 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:05.593580 21916 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:05.594224 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.594513 27084 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:05.589442 27273 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:05.595062 27084 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:05.595161 27273 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:05.596073 27273 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.597694 27273 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.600104 27234 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.600871 27234 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.603691 27234 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:05.572814 26936 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:05.579434 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73233.4us
I20260709 13:08:05.568902 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:05.605039 26936 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.605665 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:05.606307 27051 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:05.606817 21841 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:05.603853 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.611006 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.607687 27282 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:05.612274 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:05.639110 21950 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:05.571135 21947 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:05.570508 27247 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:05.634734 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.632107 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:05.606946 27051 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.590322 27040 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:05.642066 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 100211us
I20260709 13:08:05.646796 21946 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 8.
I20260709 13:08:05.656255 21914 leader_election.cc:400] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14.
I20260709 13:08:05.625198 27196 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.620759 27183 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.657815 21914 leader_election.cc:403] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:05.656178 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:05.664372 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 113428us
I20260709 13:08:05.664989 21943 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:05.583982 27260 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.588480 27176 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.647634 27051 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:05.672015 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45831.7us
I20260709 13:08:05.664415 27146 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:05.662617 27246 consensus_meta.cc:287] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.004s
I20260709 13:08:05.644009 27282 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:05.661367 27154 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:05.676222 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69485.8us
I20260709 13:08:05.687708 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:05.688481 22607 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:05.596089 27084 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.676496 27179 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:05.694628 27008 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:05.685230 26662 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 13:08:05.699928 27280 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:08:05.701426 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:05.702696 22022 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:05.703259 22573 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:05.705611 26861 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:05.705964 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:05.706411 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:05.706573 22020 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.706965 22021 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.674431 26862 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:05.709605 27281 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.710199 27281 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.710634 27176 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:05.705657 26906 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.712762 26906 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.713186 26906 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.710642 27281 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:05.718444 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.728739 27183 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.729125 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:05.729997 21875 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:05.731278 27183 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:05.663854 27265 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:05.732316 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.742053 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:05.677642 27247 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14.
W20260709 13:08:05.746454 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56068.3us
I20260709 13:08:05.746932 22020 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
W20260709 13:08:05.758157 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 120248us
I20260709 13:08:05.766188 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:05.767048 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:05.767118 21943 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:05.767694 22022 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.683794 27154 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:05.757661 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:05.775391 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.779733 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:05.780062 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 83275.5us
I20260709 13:08:05.683667 27282 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.777279 22021 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:05.667219 27196 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.784631 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:05.790035 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:05.746133 27265 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.812776 27266 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:05.813489 27266 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:05.813980 27266 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.797307 26662 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:05.818439 27287 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.064s	user 0.003s	sys 0.000s
I20260709 13:08:05.819250 21916 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:05.819677 27272 consensus_queue.cc:1175] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95296a4420ed41b69191d3d4353cf2b0" responder_term: 9 status { last_received { term: 9 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 9 index: 4 } }
I20260709 13:08:05.820304 21916 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:05.821372 27247 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:05.821903 27247 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:05.822018 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.713748 26961 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:05.823590 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.823709 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:05.791072 27154 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:05.799000 27288 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:05.716583 27264 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.821134 26862 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:05.800156 27179 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.755059 27003 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:08:05.835623 21987 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:05.839484 21870 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:05.842201 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1713) took 1487 ms. Trace:
I20260709 13:08:05.842738 21947 rpcz_store.cc:276] 0709 13:08:04.354758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.356985 (+  2227us) service_pool.cc:224] Handling call
0709 13:08:04.948462 (+591477us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:08:05.842003 (+893541us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b540029ac54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:05.842140 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434134144}
I20260709 13:08:05.839336 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:05.845314 22602 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:08:05.803001 27160 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:08:05.794894 27033 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:08:05.868489 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:05.875428 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 95005.4us
I20260709 13:08:05.881450 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:05.901412 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:05.903539 21947 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
W20260709 13:08:05.909870 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 106172us
I20260709 13:08:05.853969 26862 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:05.914639 27146 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:05.920274 27262 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.939143 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:05.847188 27258 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.916442 26936 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:05.856413 27179 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.949113 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:05.942898 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 86538.4us
I20260709 13:08:05.923250 27146 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.955319 27303 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:08:05.955664 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:05.956399 22608 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:05.956830 27303 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.969100 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 89945.2us
I20260709 13:08:05.974551 26862 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.951701 27262 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.957965 27146 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:05.953559 27260 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:05.957289 27303 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:05.911948 27247 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:05.965013 27219 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:05.921073 21945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:06.006122 21945 raft_consensus.cc:606] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:06.006515 21945 raft_consensus.cc:614] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:05.970420 26936 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:06.036231 22022 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:06.037547 22602 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:08:06.040079 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 52230.8us
I20260709 13:08:06.042927 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:06.045295 27037 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:06.054754 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:06.044466 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 64624.8us
I20260709 13:08:06.048930 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:06.055573 22022 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:06.056648 26961 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:06.057276 27295 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:08:05.979853 26906 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.062213 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.066840 27160 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:06.067454 27160 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.069577 27160 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:06.070119 27160 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:06.072711 27269 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:06.073495 27269 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.077322 22602 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:06.077919 27303 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.078492 26821 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:08:06.080647 27179 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:06.081319 27294 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:08:06.083372 27296 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:08:06.085536 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:06.086575 27285 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:08:06.086800 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:06.087420 22604 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:08:06.087384 26936 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.088166 27179 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:06.095999 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 44636.4us
I20260709 13:08:06.033735 27183 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:08:06.100047 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:06.103325 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:06.126762 22608 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.076367 27269 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.060185 27033 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.129386 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.043576 27262 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.063930 27264 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:06.099746 27273 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260709 13:08:06.138403 22610 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:06.138830 26662 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.143949 27054 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:06.145587 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.148885 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.149565 21944 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:06.150456 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.144373 27054 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:06.151058 27033 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.151630 27054 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.153069 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.153291 27033 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:06.153800 21873 raft_consensus.cc:2393] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:06.154899 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.091575 27196 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:06.129177 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.071959 27281 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.130973 22018 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:08:06.092097 27219 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:06.130709 26961 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.122933 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:06.225678 21873 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:06.226004 22606 raft_consensus.cc:2410] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:08:06.155561 21871 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:08:06.226348 21945 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:06.166178 21950 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:06.229785 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.236644 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.133533 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.230808 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.165560 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.242247 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.256709 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:06.256986 22608 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:06.096686 27051 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.253052 21867 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
W20260709 13:08:06.265107 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.252348 21946 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:08:06.260703 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.267082 21945 raft_consensus.cc:2376] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14. Re-sending same reply.
W20260709 13:08:06.262547 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 139748us
I20260709 13:08:06.268877 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:06.270100 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.270951 21950 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:06.132292 27303 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:08:06.277604 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.279117 22607 raft_consensus.cc:2368] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15.
I20260709 13:08:06.281543 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:06.294492 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:06.313017 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.315063 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.320250 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.240852 27179 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.323025 22610 raft_consensus.cc:2393] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:08:06.324481 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55663us
I20260709 13:08:06.329152 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.256142 26961 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.243033 27310 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:06.332093 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.321254 21941 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:06.334040 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:06.327793 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.279575 27258 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:06.364454 21866 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:06.272389 27262 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.372129 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.373159 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.390337 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.312142 27033 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:06.345577 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.399537 21945 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.350211 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.342034 26961 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.379639 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.341598 27310 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:06.403941 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.383932 21873 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.378366 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.404947 21941 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.276674 27219 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:06.365705 27269 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.392323 27262 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.388402 21946 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:06.393805 27270 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.395852 27290 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.557s	user 0.004s	sys 0.000s
I20260709 13:08:06.396656 27312 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.176090 27040 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.342754 27179 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.383512 27304 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.403463 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:06.411339 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.412861 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:06.417920 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.453255 21945 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:06.500247 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.502915 21866 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:06.504506 21988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.018s	sys 0.042s
W20260709 13:08:06.514605 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.019s	sys 0.042s
W20260709 13:08:06.514956 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 533341us
I20260709 13:08:06.470533 27281 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:06.406167 27033 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.524022 27033 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:06.401383 27233 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
W20260709 13:08:06.519994 21838 leader_election.cc:336] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.526s (SENT)
I20260709 13:08:06.527455 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:06.487738 27266 consensus_meta.cc:287] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.004s
I20260709 13:08:06.425531 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.537690 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.538126 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.538954 21950 raft_consensus.cc:2376] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14. Re-sending same reply.
I20260709 13:08:06.542779 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:06.534502 21944 raft_consensus.cc:2376] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14. Re-sending same reply.
I20260709 13:08:06.570763 27051 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.572332 27262 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:06.572994 27219 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.577032 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.577399 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.577744 26906 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.578063 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.578598 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:06.579152 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.579259 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:06.579680 27265 consensus_meta.cc:287] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.002s
I20260709 13:08:06.580016 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.580987 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.581377 27314 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.581858 27314 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.417966 27269 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.582219 27314 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.582577 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.581040 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.583240 22018 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.583361 22020 raft_consensus.cc:2410] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:08:06.583811 27269 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.577035 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:06.584833 27311 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:08:06.585328 21947 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:06.580396 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:06.586890 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66942.5us
I20260709 13:08:06.587019 22023 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
W20260709 13:08:06.587908 21838 leader_election.cc:336] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.563s (SENT)
I20260709 13:08:06.512171 27312 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:06.579715 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.591631 22024 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:06.589751 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.590807 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.593166 22018 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:06.594365 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.535869 26936 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:06.597498 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.599354 21942 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:06.608985 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:06.576488 27154 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.742s	user 0.006s	sys 0.004s
I20260709 13:08:06.609730 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.610981 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.612175 21874 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:06.615646 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.616549 21942 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.510394 27270 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:06.621461 21838 leader_election.cc:336] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.586s (SENT)
I20260709 13:08:06.621342 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.593329 27312 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.625296 22019 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:06.611230 22604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.006s
I20260709 13:08:06.630151 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:06.633343 22576 leader_election.cc:336] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.761s (SENT)
W20260709 13:08:06.633762 22604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.011s	sys 0.006s
I20260709 13:08:06.633972 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.635115 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.635723 22022 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.637390 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:06.640762 21838 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.596s (SENT)
W20260709 13:08:06.641103 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 236950us
W20260709 13:08:06.642057 21838 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.852s (SENT)
I20260709 13:08:06.595718 26862 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.645483 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.646129 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.536139 27266 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.650731 22024 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:06.651988 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.653939 22023 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:06.654922 22015 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.656186 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.656883 22020 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:06.653560 21948 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:06.662019 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.665261 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.674834 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.685370 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.686299 22020 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:06.670235 27223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.007s	sys 0.015s
I20260709 13:08:06.688019 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.691749 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.692274 21942 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:06.692682 22019 raft_consensus.cc:2410] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:08:06.693109 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:06.693650 21950 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.658562 27233 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:06.692523 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 50524.6us
I20260709 13:08:06.688696 21948 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:08:06.691356 27223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.007s	sys 0.015s
I20260709 13:08:06.695555 27040 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.658982 26862 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.647639 27298 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:08:06.647200 27303 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.699252 27266 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.691753 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.745982 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:06.746331 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:06.700915 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:06.702733 27196 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.747277 21870 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:06.747579 27196 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.703408 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.750214 22023 raft_consensus.cc:2376] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14. Re-sending same reply.
I20260709 13:08:06.586568 27310 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.706554 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:06.715410 27146 consensus_meta.cc:287] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
W20260709 13:08:06.709802 27318 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:08:06.710268 22020 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:06.759114 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.629016 27154 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:06.712549 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 79233us
I20260709 13:08:06.758109 21944 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:06.715945 22022 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:08:06.720532 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:06.719672 21838 leader_election.cc:336] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.055s (SENT)
I20260709 13:08:06.718657 22015 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:06.762986 21950 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:06.763808 21866 raft_consensus.cc:2393] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:06.765108 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:06.742022 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.745324 22610 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:06.768975 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.746450 22024 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:08:06.747056 27223 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.749253 22602 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:06.705788 21916 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:06.747299 22605 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 16 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:08:06.751386 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.704814 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.752441 21949 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:08:06.709062 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.740918 27271 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.749876 27196 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:06.792045 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.793823 21872 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:06.704834 26906 consensus_queue.cc:1059] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:08:06.799928 22020 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:06.770749 27247 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.807135 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.767979 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:06.768018 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:06.822337 21870 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:06.773200 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:06.822863 21950 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
W20260709 13:08:06.824298 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 104662us
W20260709 13:08:06.825947 21838 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.114s (SENT)
I20260709 13:08:06.801683 27247 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:06.752333 27314 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.807858 21866 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:06.801529 27040 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.814437 26821 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.820127 22019 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:06.837643 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:06.762118 27146 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.784984 27223 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.783560 21875 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:08:06.829201 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 61294.5us
W20260709 13:08:06.810297 27282 consensus_meta.cc:287] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.987s	user 0.013s	sys 0.000s
I20260709 13:08:06.832590 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.849453 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:06.850133 21866 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.838478 21870 raft_consensus.cc:2393] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:06.771133 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 65431.4us
I20260709 13:08:06.832015 27247 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.848531 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 86448.3us
I20260709 13:08:06.827576 27270 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:06.854041 22576 leader_election.cc:336] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.849s (SENT)
I20260709 13:08:06.854610 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.854810 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:06.849150 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:06.851438 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:06.842428 27266 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:06.858621 27301 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.858745 26936 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.858814 21838 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.717s (SENT)
W20260709 13:08:06.862882 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.863168 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.863523 22016 raft_consensus.cc:2368] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9.
I20260709 13:08:06.861199 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:06.859627 27266 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:06.866222 27266 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.865103 27264 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.852197 27282 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.864769 27265 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.870407 27265 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:06.871295 27265 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.871887 27282 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:06.868818 21838 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.729s (SENT)
I20260709 13:08:06.874009 21869 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:06.875764 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:06.877645 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:06.868829 27223 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.878589 27270 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.792979 27271 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.879951 21948 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:06.880528 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:06.880892 27037 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.881345 27037 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.879019 27266 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.881706 27037 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.882279 27223 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.882793 27223 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.883236 27266 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.883399 27321 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.883939 27266 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:06.883998 27321 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:06.888352 27303 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:06.893137 27329 log.cc:927] Time spent T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:08:06.896111 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:06.896929 22019 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.899314 22023 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:06.902822 21941 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:06.903304 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:06.904695 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:06.908370 22604 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:06.908489 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54478.6us
I20260709 13:08:06.911525 22607 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:08:06.912096 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.912523 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:06.887216 27327 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:08:06.866586 26936 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:06.929481 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:06.930641 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.922905 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:06.923228 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.931378 22608 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:06.930552 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:06.902262 27282 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.908099 27040 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.921103 22019 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:06.933252 27271 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.928272 27305 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:06.934340 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:06.944178 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 83789.5us
I20260709 13:08:06.938421 21841 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.939281 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:06.962707 21988 connection.cc:256] RPC call timeout handler was delayed by -1.0246896269999297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 13:08:06.963618 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.934121 26862 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:06.936780 27331 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:08:06.935698 27304 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.972856 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:06.976315 27306 raft_consensus.cc:2764] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:06.979636 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:06.980895 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.939862 27223 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:06.982920 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:06.946429 27313 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.937315 27305 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:06.986657 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 47486.5us
W20260709 13:08:06.988106 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 126973us
I20260709 13:08:06.979729 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:06.936962 27301 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:08:06.993201 27301 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.978478 27303 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.993777 27258 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:06.994192 27258 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:06.994966 27258 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:06.992290 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:06.995484 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:06.996183 27258 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.974015 27336 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:08:06.972441 27282 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.001981 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:07.000367 21841 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:07.008528 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:07.011735 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:06.984119 27154 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:07.018564 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:07.020187 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:06.990024 27313 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.988131 27343 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:07.001735 27305 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:07.007014 27304 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:07.009721 27271 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:07.042282 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 78953.9us
I20260709 13:08:07.010951 27306 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.012885 27303 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:07.017081 27084 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.017266 27301 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:07.041314 27270 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.054687 27270 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:07.051617 27333 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:08:07.059365 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:07.070204 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.027771 27282 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.030016 27313 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.969043 27321 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.032240 27314 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:07.032949 27146 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:07.064517 26961 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
W20260709 13:08:07.065342 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 66036.1us
I20260709 13:08:07.028920 26862 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:08:07.025592 27266 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:08:07.066653 27154 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:07.049717 27304 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:07.093283 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:07.097509 21873 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:07.111559 27304 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.113312 27003 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:07.113760 27003 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:07.114617 27003 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.097904 26961 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.129717 27328 raft_consensus.cc:3055] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:07.130219 27328 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:07.131088 27328 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.132139 27328 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.141953 27154 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:07.142761 27179 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:07.143210 27154 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.147660 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:07.149390 22602 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:07.099927 21866 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:07.083462 27282 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:07.064780 27337 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.105515 26936 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:07.155615 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 62421.4us
I20260709 13:08:07.156405 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:07.108740 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 94931us
W20260709 13:08:07.116328 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69806.2us
I20260709 13:08:07.109650 27345 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:07.115803 27344 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:08:07.123183 26821 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:07.164795 21916 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:07.167703 27301 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:07.168816 27301 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.124701 27270 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:07.110297 27265 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:08:07.132984 27054 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.191032 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.192322 22019 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:07.133985 26961 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:07.134958 27037 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.139500 27247 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.141280 27003 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:07.156085 27282 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.201674 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.059423 27312 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.155385 27146 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.173352 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:07.177151 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 157034us
I20260709 13:08:07.177649 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:07.195142 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.196185 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.188462 26821 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.188973 27260 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:07.198298 26862 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:07.208194 21866 raft_consensus.cc:2410] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:08:07.203646 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.215049 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:07.208077 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:07.197428 27084 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:07.175951 27343 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:07.218456 21950 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.219219 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:07.219877 21943 raft_consensus.cc:3060] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.221802 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.222189 22024 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:07.223196 21871 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.225190 22015 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:08:07.227509 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 54227.7us
I20260709 13:08:07.229655 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:07.215827 27160 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.233954 22018 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:07.238452 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:07.239153 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.239223 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 916) took 1516 ms. Trace:
I20260709 13:08:07.235492 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.236725 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:07.214676 27260 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:07.207105 27346 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.287719 27271 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:07.243848 21943 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:07.240141 21866 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 7.
I20260709 13:08:07.290201 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:07.245453 27354 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.239688 21872 rpcz_store.cc:276] 0709 13:08:05.722574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.724160 (+  1586us) service_pool.cc:224] Handling call
0709 13:08:05.724448 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.794244 (+1069796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.239028 (+444784us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400217d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:07.239171 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2458918144}
I20260709 13:08:07.246760 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.248128 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:07.239358 27122 raft_consensus.cc:2764] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:07.195395 27319 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:08:07.221645 26862 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.239653 27146 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:08:07.256006 27033 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.261456 27310 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.262189 21942 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:07.263540 27266 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.265689 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.265930 27037 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:07.270448 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.209832 27303 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:07.271018 27305 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.272083 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:07.328374 21871 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.311933 27314 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.273650 27292 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:07.317173 27316 raft_consensus.cc:2764] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:07.276239 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:07.279001 22018 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 13: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:07.279498 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.279683 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:07.282435 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:07.340045 22605 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.282842 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:07.283107 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:07.211217 27258 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:07.291364 22574 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:07.343537 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 52254.5us
I20260709 13:08:07.292461 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:07.344843 21950 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:07.345736 21875 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:07.294049 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:07.346887 21944 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.294224 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.347165 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.295683 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.229131 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.310376 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:07.315338 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.313154 21987 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:07.228029 27084 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:07.349299 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:07.321987 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 292871us
I20260709 13:08:07.324390 21945 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:07.294164 27260 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:07.325565 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 77509.1us
I20260709 13:08:07.327385 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:07.290738 27312 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:07.272722 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 64727us
I20260709 13:08:07.288568 27271 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.306994 27313 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.323082 27266 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:07.356221 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.371979 22018 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:07.373167 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.373927 22018 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:07.375002 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.361675 22605 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:08:07.375916 22018 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 13: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:07.361794 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:07.341815 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 65791us
I20260709 13:08:07.364529 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:07.365733 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:07.364730 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 51932.5us
I20260709 13:08:07.338872 27350 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:07.379025 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.323035 27033 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.377030 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:07.379616 22016 raft_consensus.cc:2376] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12. Re-sending same reply.
I20260709 13:08:07.368804 21872 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:07.377030 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:07.345476 27298 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.363610 27321 raft_consensus.cc:2804] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:07.385586 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.388195 21914 leader_election.cc:400] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15.
I20260709 13:08:07.397080 22015 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 10: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:07.397138 21914 leader_election.cc:403] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:07.389060 21867 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:08:07.397799 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69503.6us
I20260709 13:08:07.368417 27306 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:07.340116 27314 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.402761 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:07.405884 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.408221 22015 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:07.391393 27356 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:08:07.390471 27350 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:07.428063 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.411019 22016 raft_consensus.cc:2410] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:07.398694 27122 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:07.431633 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 53341.4us
I20260709 13:08:07.383596 27326 consensus_queue.cc:1059] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:07.404805 27306 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.408380 27346 raft_consensus.cc:2764] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:08:07.390864 27270 consensus_queue.cc:1059] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:08:07.404125 27321 raft_consensus.cc:697] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:07.434927 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:07.385691 27219 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:08:07.436550 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:07.437198 27363 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.414911 27176 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.387604 27316 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:08:07.438771 27306 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:07.443536 26821 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.499830 21869 raft_consensus.cc:1217] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Deduplicated request from leader. Original: 12.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:08:07.389734 27084 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.365852 27343 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:07.470857 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.478657 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 115167us
I20260709 13:08:07.370111 27303 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.481055 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.460798 21867 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:07.430184 27298 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.489331 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.411559 27304 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:07.503182 21869 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:07.510426 22021 raft_consensus.cc:2410] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:08:07.516441 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 134530us
W20260709 13:08:07.520109 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 83647.4us
I20260709 13:08:07.482299 27365 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.527546 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:07.528493 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:07.529835 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:07.531252 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:07.531864 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:07.482457 27349 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.533797 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:07.545101 21838 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:07.535360 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.538133 27369 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:07.532023 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:07.539851 21943 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:07.539772 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 104913us
I20260709 13:08:07.445307 27266 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.502241 26862 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:07.550032 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:07.549544 22608 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:07.579237 22024 raft_consensus.cc:2368] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9.
I20260709 13:08:07.580921 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.581681 22024 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 18: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:07.582283 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.548120 27305 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:07.583101 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.588157 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.589182 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.590075 22015 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 13: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:07.524145 27304 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:07.592923 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:07.592811 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.600194 21867 raft_consensus.cc:2393] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:07.600735 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.594221 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:07.598007 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:07.601975 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.532929 27365 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.600461 22015 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:07.609491 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.610342 22015 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:07.612517 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.525108 27363 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:08:07.617219 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.615010 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:07.576316 27154 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.585748 27346 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.619834 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.546584 27176 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.604571 27266 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.625008 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.550429 27369 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.636669 21874 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:07.636425 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 104631us
I20260709 13:08:07.523483 27298 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.635701 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:07.638186 22019 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.640718 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:07.641985 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.642453 21874 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:07.639667 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:07.643224 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:07.643741 21874 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.610116 27365 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.616431 27146 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.624152 27316 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.652397 22015 raft_consensus.cc:1240] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:07.633608 27176 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.635115 27271 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:07.547441 27350 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.576545 27321 consensus_queue.cc:237] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.641242 27040 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:07.664666 27361 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:08:07.684005 27040 raft_consensus.cc:697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:07.670796 27341 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15.
I20260709 13:08:07.685281 27040 consensus_queue.cc:237] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.670626 27374 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.687191 22017 raft_consensus.cc:2410] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:07.687942 27326 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:07.688416 27326 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:08:07.677418 27332 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.815s	user 0.004s	sys 0.000s
I20260709 13:08:07.689518 27326 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.675470 27319 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:07.690874 27326 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.690768 27365 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.693579 27365 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:07.693897 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1757) took 1017 ms. Trace:
I20260709 13:08:07.683400 22015 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:07.696132 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 102039us
I20260709 13:08:07.690047 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1751) took 1200 ms. Trace:
I20260709 13:08:07.699447 22019 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:07.719863 22019 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:07.636950 27369 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.699793 21946 rpcz_store.cc:276] 0709 13:08:06.498255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.525986 (+ 27731us) service_pool.cc:224] Handling call
0709 13:08:06.536342 (+ 10356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.536794 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.536826 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.569824 (+ 32998us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.806108 (+236284us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:06.806147 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.806226 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.676557 (+870331us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:07.689720 (+ 13163us) raft_consensus.cc:1685] finished
0709 13:08:07.689745 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.689984 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13662,"raft.queue_time_us":752,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":40425,"spinlock_wait_cycles":5055872,"thread_start_us":176616,"threads_started":1,"wal-append.queue_time_us":263501}
I20260709 13:08:07.694528 21942 rpcz_store.cc:276] 0709 13:08:06.676580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.754632 (+ 78052us) service_pool.cc:224] Handling call
0709 13:08:07.261869 (+507237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.321531 (+ 59662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.693603 (+372072us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54000fb250. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:07.693807 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144651008}
I20260709 13:08:07.723555 21871 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:08:07.738713 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:07.741487 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 152997us
W20260709 13:08:07.742745 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 210837us
I20260709 13:08:07.660575 27176 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:07.667573 27357 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:08:07.756184 22019 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:07.660408 27033 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:07.672433 27298 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:07.762076 27316 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.677119 27375 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.767879 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:07.658094 27314 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:07.737112 27365 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.736835 27304 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.749138 27349 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.783895 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:07.874432 22024 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:07.875916 22024 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:07.806314 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.778788 27160 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:07.833425 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 193900us
I20260709 13:08:07.910326 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:07.835253 27363 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.655002 27146 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.843542 27316 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:07.844419 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100183us
W20260709 13:08:07.773578 27282 consensus_meta.cc:287] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.558s	user 0.004s	sys 0.006s
I20260709 13:08:07.864171 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2859) took 1468 ms. Trace:
I20260709 13:08:07.915598 21875 rpcz_store.cc:276] 0709 13:08:06.395865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.083438 (+687573us) service_pool.cc:224] Handling call
0709 13:08:07.090652 (+  7214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.346234 (+255582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.863931 (+517697us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400217854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:07.864114 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586225920}
I20260709 13:08:07.869095 21874 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:07.797334 21944 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 9.
I20260709 13:08:07.872205 21869 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:07.876965 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.770691 27313 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:07.775218 26821 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:07.832355 27270 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.912279 22024 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.917171 21949 raft_consensus.cc:606] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:07.924015 21949 raft_consensus.cc:614] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:07.918015 21871 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:07.926801 22023 raft_consensus.cc:2410] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:08:07.916517 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 515565us
I20260709 13:08:07.918349 21874 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:08:07.917353 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.856458 27375 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:07.919222 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 176924us
I20260709 13:08:07.919906 21869 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:07.863498 27365 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:07.863627 27328 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.768555 27260 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.931157 21875 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:07.933246 27375 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.940847 21916 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:07.940761 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:07.922048 27282 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.945930 22608 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:07.949146 21874 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.952098 22602 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:07.955809 27264 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:07.959133 26821 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:07.960306 27375 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:07.963891 27375 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:07.964792 27375 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:07.964908 27160 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:07.946447 27146 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:07.965930 27160 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:07.966675 27146 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.967021 27146 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:07.965219 27375 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:07.984161 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.986119 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.986358 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45687.4us
I20260709 13:08:07.930503 27390 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.987121 21987 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:07.947955 27282 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:07.978680 27271 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.988724 27375 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.023126 27378 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:08:07.943029 27384 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:08:07.920957 27363 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.997475 27386 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.026387 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.027108 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:07.993052 27390 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:08.064800 21945 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:08.027774 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:08.065811 21947 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:08.028856 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:08.029388 27365 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.013022 27310 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:08.041069 22017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1842) took 1465 ms (client timeout 1641 ms). Trace:
I20260709 13:08:08.043233 22020 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:07.967808 27146 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:07.930277 27270 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.118327 21875 raft_consensus.cc:1240] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:08.108224 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.060137 27306 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 13:08:08.134512 22020 pending_rounds.cc:85] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 10
I20260709 13:08:08.141803 22020 pending_rounds.cc:107] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 13.11
W20260709 13:08:08.061403 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 121543us
I20260709 13:08:08.138767 22602 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:08.142406 22020 raft_consensus.cc:2889] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.057039 27271 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:08.123266 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 928) took 1266 ms. Trace:
W20260709 13:08:08.134492 22017 rpcz_store.cc:269] 0709 13:08:06.575437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.580724 (+  5287us) service_pool.cc:224] Handling call
0709 13:08:08.040750 (+1460026us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400417dd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:08.040948 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541803264}
W20260709 13:08:08.146883 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.147733 21868 rpcz_store.cc:276] 0709 13:08:06.857023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.863478 (+  6455us) service_pool.cc:224] Handling call
0709 13:08:08.123049 (+1259571us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540040f6d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:08.123203 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938419968}
W20260709 13:08:08.163590 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 215071us
I20260709 13:08:08.164393 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:08.165957 22604 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:08:08.168220 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 224862us
I20260709 13:08:08.169309 21947 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.170496 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:08.064968 27176 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.072746 27390 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.090770 27196 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:08.127018 27003 raft_consensus.cc:3055] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:08.180258 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:08.226902 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56452.9us
I20260709 13:08:08.255934 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:08:08.260352 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.260790 21945 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:08.146685 27314 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.162650 27271 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:08.239423 27395 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:08:08.087543 27341 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:08:08.274389 22017 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:08.274914 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:08.294484 22016 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.165616 27310 raft_consensus.cc:697] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:08.104353 27363 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:08.280833 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.282723 21949 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:08.284179 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.285606 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:08.285791 27176 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:08.286312 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:08.254528 27266 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.160657 27306 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.300573 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.240499 27196 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:08.255306 27003 raft_consensus.cc:740] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:08:08.307958 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 140180us
I20260709 13:08:08.312762 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:08.238879 27265 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:08:08.315943 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.316013 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.316888 21943 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.314431 22604 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:08.329799 21987 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:08.329821 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.331758 21949 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:08.276250 27040 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:08:08.337949 21945 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:08.334193 22018 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:08.281177 27304 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:08:08.283327 27314 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.365752 21943 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:08.321964 27223 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.338613 27368 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:08.343883 27304 consensus_queue.cc:1243] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:08.344161 27384 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:08.349716 27370 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:08.343592 27298 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:08.344190 27262 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:08:08.392398 21943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:08.462306 21943 raft_consensus.cc:606] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:08.377326 27223 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.462697 21943 raft_consensus.cc:614] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:08.459169 27397 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:08:08.468631 27369 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 13:08:08.457729 27336 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:08.448858 27310 consensus_queue.cc:237] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.383563 27384 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:08.534282 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 199035us
I20260709 13:08:08.464349 27370 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.543807 27370 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:08.538650 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 218373us
W20260709 13:08:08.533483 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 271709us
I20260709 13:08:08.549580 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:08.472064 27270 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:08.591450 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 251931us
I20260709 13:08:08.597612 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:08.374482 27196 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.530279 27399 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.602998 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:08.603786 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 304947us
W20260709 13:08:08.553545 27388 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:08:08.468117 27298 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:08.614158 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.617133 21948 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:08.380090 27003 consensus_queue.cc:260] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.540104 27369 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.626627 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:08.600402 27313 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:08.618132 27406 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:08:08.605436 27247 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:08.541002 27336 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.606735 27306 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:08.652870 27390 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.603549 27303 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:08:08.603381 27258 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:08.600749 27379 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:08.661635 22607 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:08.641812 27196 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:08.684021 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 86536.9us
I20260709 13:08:08.628352 27281 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:08:08.614888 27399 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.701155 27426 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.701818 27405 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:08.644800 27267 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:08:08.689127 27061 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:08:08.720288 22016 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:08.684458 27054 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:08.715211 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 68481.3us
W20260709 13:08:08.718209 27401 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:08:08.756083 21948 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:08.762113 27403 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:08:08.770555 27399 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:08.626565 27384 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.773801 27298 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:08.774554 27298 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.775027 27298 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:08.775863 27326 consensus_meta.cc:287] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.084s	user 0.008s	sys 0.004s
I20260709 13:08:08.781479 22016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:08.782153 22016 raft_consensus.cc:606] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:08.782505 22016 raft_consensus.cc:614] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:08.798022 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.803532 27369 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:08.758196 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.722075 27426 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.817786 27303 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:08.832751 27260 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:08.835707 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3155) took 1051 ms. Trace:
W20260709 13:08:08.838263 21873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 2321) took 1691 ms (client timeout 2237 ms). Trace:
W20260709 13:08:08.838869 21873 rpcz_store.cc:269] 0709 13:08:07.146337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.221517 (+ 75180us) service_pool.cc:224] Handling call
0709 13:08:08.837976 (+1616459us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003adc54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:08.838183 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2654521728}
I20260709 13:08:08.840334 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.842144 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:08.844589 21870 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.846519 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 932) took 1784 ms. Trace:
I20260709 13:08:08.846946 21870 rpcz_store.cc:276] 0709 13:08:07.061986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.364359 (+302373us) service_pool.cc:224] Handling call
0709 13:08:08.844309 (+1479950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.845150 (+   841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.846259 (+  1109us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003adc50. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:08.846447 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3367070592}
W20260709 13:08:08.853229 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.855325 27398 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:08.855921 27398 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:08.857009 27398 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.858413 27398 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:08.870121 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 2322) took 1723 ms. Trace:
I20260709 13:08:08.870695 21866 rpcz_store.cc:276] 0709 13:08:07.146622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.293943 (+147321us) service_pool.cc:224] Handling call
0709 13:08:08.869814 (+1575871us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001d83d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:08.870029 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3062884096}
I20260709 13:08:08.888489 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 936) took 1032 ms. Trace:
I20260709 13:08:08.889138 21874 rpcz_store.cc:276] 0709 13:08:07.856162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.930272 (+ 74110us) service_pool.cc:224] Handling call
0709 13:08:07.931540 (+  1268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.954536 (+ 22996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.888161 (+933625us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b54001b7454. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:08.888415 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39992064}
I20260709 13:08:08.893577 27368 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:08.894218 27368 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:08.904384 22607 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:08.908412 22021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1837) took 2334 ms (client timeout 2124 ms). Trace:
W20260709 13:08:08.908964 22021 rpcz_store.cc:269] 0709 13:08:06.573954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.576707 (+  2753us) service_pool.cc:224] Handling call
0709 13:08:08.908115 (+2331408us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b540017b1d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:08.908290 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143234176}
I20260709 13:08:08.910840 22022 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:08.911293 22022 pending_rounds.cc:85] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 10
I20260709 13:08:08.911564 22022 pending_rounds.cc:107] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:08.911834 22022 raft_consensus.cc:2889] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:08.907168 27408 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.379s	user 0.003s	sys 0.000s
I20260709 13:08:08.915660 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.918764 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1867) took 2022 ms. Trace:
W20260709 13:08:08.918987 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 64650.3us
I20260709 13:08:08.919255 22020 rpcz_store.cc:276] 0709 13:08:06.896023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.901894 (+  5871us) service_pool.cc:224] Handling call
0709 13:08:08.042853 (+1140959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.143265 (+100412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.918547 (+775282us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400417dd0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:08.918679 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2575495040}
I20260709 13:08:08.836261 22019 rpcz_store.cc:276] 0709 13:08:07.784787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.832833 (+ 48046us) service_pool.cc:224] Handling call
0709 13:08:07.833295 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.968795 (+135500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.968843 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.990645 (+ 21802us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.339447 (+348802us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:08.339489 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.835201 (+495712us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b5400199954. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:08.835251 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.835305 (+    54us) raft_consensus.cc:1685] finished
0709 13:08:08.835326 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.835626 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36948,"raft.queue_time_us":36439,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8593,"spinlock_wait_cycles":226973568,"thread_start_us":289967,"threads_started":1,"wal-append.queue_time_us":410837}
I20260709 13:08:08.927030 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:08.929309 27223 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:08.932502 27410 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.933234 27410 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.936018 27003 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.945108 27375 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:08.947427 21841 leader_election.cc:400] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9.
I20260709 13:08:08.947780 21841 leader_election.cc:403] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:08.948145 27343 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:08.948729 27343 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:08.953678 27316 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:08.959896 22023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 696) took 1727 ms. Trace:
I20260709 13:08:08.931536 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:08.982410 21948 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:08.984105 21948 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:08.969223 27371 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.818022 27350 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.972728 22015 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:08.948725 21841 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:08.826133 27303 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:08.818056 27269 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.980967 22023 rpcz_store.cc:276] 0709 13:08:07.232371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.232850 (+   479us) service_pool.cc:224] Handling call
0709 13:08:08.959636 (+1726786us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54001f18d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:08.959820 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419811200}
I20260709 13:08:08.821939 27258 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.164s
W20260709 13:08:08.989118 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 71683.3us
W20260709 13:08:09.018167 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.989553 27365 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.990587 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:08.967757 27410 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:08.972268 27426 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:08.979934 27054 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:08.979437 27369 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:09.020282 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.023116 22016 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:09.095045 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:09.096138 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:09.096792 27428 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:08:09.097852 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:09.098497 22605 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:09.101918 22608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 822) took 1146 ms. Trace:
I20260709 13:08:09.102113 27303 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.102794 27303 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 8. Current term is 9.
I20260709 13:08:09.102432 22608 rpcz_store.cc:276] 0709 13:08:07.978169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.984911 (+  6742us) service_pool.cc:224] Handling call
0709 13:08:07.985255 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.219452 (+234197us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:08:08.281528 (+ 62076us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.608974 (+327446us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.879781 (+270807us) spinlock_profiling.cc:243] Waited 969 us on lock 0x7b2c00047568. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:08:08.880314 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.880514 (+   200us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:08.880560 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.917459 (+ 36899us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54005d02d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:08.917532 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.101656 (+184124us) raft_consensus.cc:1685] finished
0709 13:08:09.101683 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.101821 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86115,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":24663,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":29237,"spinlock_wait_cycles":425450624,"thread_start_us":286647,"threads_started":1,"wal-append.queue_time_us":713346}
I20260709 13:08:09.000731 27429 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.130270 27122 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.130796 27122 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.131269 27146 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.015360 27350 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.134518 27350 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.001226 27298 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:08.997514 27386 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:09.000447 27160 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:09.077212 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:09.034371 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:09.076176 27219 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:09.080293 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58422.4us
I20260709 13:08:09.082553 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:09.082638 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:09.171001 22019 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.171347 22021 raft_consensus.cc:2410] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:09.084092 22017 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:09.086345 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:09.079532 27390 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:08.998168 27337 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:09.022619 27378 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.105433 27422 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:08:09.105870 27369 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.107620 27054 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.034039 27269 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.087910 27319 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:08:09.111510 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:09.204234 21949 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:08:09.111953 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:09.205307 22023 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:09.115144 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.118546 27343 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:09.119004 27271 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.822s	user 0.009s	sys 0.000s
I20260709 13:08:09.122452 27368 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.123332 27336 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:09.080641 27383 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:08:09.110469 27410 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:09.126246 27396 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.110417 27266 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.225204 27298 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.023648 21916 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:09.245424 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 221846us
I20260709 13:08:09.166297 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:09.173050 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 138762us
I20260709 13:08:09.191195 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.246920 21874 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:09.247041 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:09.182591 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 105470us
I20260709 13:08:09.193765 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.201069 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:09.203163 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:09.014297 27371 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.204392 27378 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.211817 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:09.204444 21839 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:09.217928 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:09.218997 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.208355 27417 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.129516 27429 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.223308 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.266683 21867 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
W20260709 13:08:09.266921 21947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.011s	sys 0.008s
I20260709 13:08:09.190945 26862 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:09.234040 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:09.201519 27350 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:09.217837 27370 consensus_meta.cc:287] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
I20260709 13:08:09.171877 27160 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.201550 27337 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.245301 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:09.274247 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 69868us
I20260709 13:08:09.250046 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.278647 21949 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:09.279067 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3163) took 1030 ms. Trace:
I20260709 13:08:09.209438 22608 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:09.198817 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:09.237344 27033 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.264716 22017 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:08:09.267279 21947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.011s	sys 0.008s
I20260709 13:08:09.169003 27386 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.230422 27271 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:09.271694 27196 consensus_meta.cc:287] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.001s
I20260709 13:08:09.290113 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.290304 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:09.279495 22018 rpcz_store.cc:276] 0709 13:08:08.248756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.370337 (+121581us) service_pool.cc:224] Handling call
0709 13:08:08.381982 (+ 11645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.382259 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.382296 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.405110 (+ 22814us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.638565 (+233455us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:08.638602 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.638669 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.278796 (+640127us) raft_consensus.cc:1685] finished
0709 13:08:09.278824 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.278992 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":198025,"threads_started":1,"wal-append.queue_time_us":378569}
I20260709 13:08:09.292984 22018 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:09.238345 27003 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:08:09.292409 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:09.297271 22020 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.298069 22606 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:09.273332 27292 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:09.299943 27292 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.271703 27219 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:09.284436 27350 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.284200 27370 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.264058 27266 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.277846 27349 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:09.277846 27319 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:09.339893 22603 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:09.255089 27396 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.348490 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2610) took 1171 ms. Trace:
I20260709 13:08:09.310631 22016 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:09.358826 27269 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.359624 27412 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.314157 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.271795 27417 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.317281 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 772) took 1059 ms. Trace:
I20260709 13:08:09.289188 27345 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.283797 27033 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:09.318449 21946 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:09.322290 21942 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:09.323340 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.289602 27247 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.325364 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 50735.6us
I20260709 13:08:09.325739 22018 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:09.347762 21868 raft_consensus.cc:1275] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:09.353518 22020 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:09.452876 22018 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:09.453011 22020 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:09.358944 27266 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.294488 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:09.295704 26862 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:09.309046 22019 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:09.365919 22016 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
W20260709 13:08:09.310459 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 361810us
I20260709 13:08:09.463783 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.361613 21873 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:09.369436 22602 rpcz_store.cc:276] 0709 13:08:08.258270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.259306 (+  1036us) service_pool.cc:224] Handling call
0709 13:08:08.259640 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:08.267294 (+  7654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.267338 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:08.280640 (+ 13302us) log.cc:844] Serialized 52 byte log entry
0709 13:08:08.533780 (+253140us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:08.548914 (+ 15134us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.549199 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.549275 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.300841 (+751566us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b2400303428. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352e0b9c4 00007f6352e09acb 00007f6352fc4dc9 00007f6352fc4a55 00007f6352fc3fb0 00007f6355c3a488 00007f6355c3abe8 00007f6355c12398 00007f6355c0d76a 00007f6355c0cbb6
0709 13:08:09.304395 (+  3554us) raft_consensus.cc:1685] finished
0709 13:08:09.317078 (+ 12683us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.317222 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7195,"prepare.queue_time_us":55802,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":56,"raft.queue_time_us":7406,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":16442,"spinlock_wait_cycles":118925568,"thread_start_us":216882,"threads_started":1,"wal-append.queue_time_us":462150}
W20260709 13:08:09.378568 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.356698 21947 rpcz_store.cc:276] 0709 13:08:08.177319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.186565 (+  9246us) service_pool.cc:224] Handling call
0709 13:08:08.276526 (+ 89961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.276747 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:08.655495 (+378748us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.348112 (+692617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.348189 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:09.348249 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.348314 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.348437 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63628,"prepare.queue_time_us":116086,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":979313,"threads_started":2}
I20260709 13:08:09.328704 27433 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:09.465879 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.466150 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.466784 21872 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:09.466365 27433 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.418956 22021 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:09.342379 27223 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:09.469026 27223 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:09.469645 27433 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.306458 27273 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:09.420809 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 76292.7us
I20260709 13:08:09.470217 27433 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.470744 27433 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.470974 27223 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.308511 22023 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:09.347038 27349 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:09.346397 27219 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:09.348081 27398 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:08:09.346695 27319 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.487643 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.487368 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.493615 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.499706 27319 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:09.500121 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:09.501526 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.502743 27442 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.503546 27442 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:09.503952 27442 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:09.504359 27442 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.516265 27269 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.522581 27269 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:09.423720 27196 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:09.424680 27418 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:09.472930 27223 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.528025 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.535943 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.537853 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.477375 27431 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.464227 27444 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:09.449353 27264 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:08:09.523249 27269 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.575737 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:09.584367 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 48527.9us
I20260709 13:08:09.464001 27247 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.542574 27258 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.551362 27434 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:09.478751 27439 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.363s
I20260709 13:08:09.629051 21947 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:09.583145 27343 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:09.585881 27436 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.335s	user 0.004s	sys 0.007s
I20260709 13:08:09.544232 27003 consensus_queue.cc:1048] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:08:09.546965 27196 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.604717 27386 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:09.605012 27368 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.623783 27434 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.628185 27369 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.693636 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:09.634583 27160 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:09.611488 27313 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:08:09.576779 27033 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.630889 27371 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.550912 27418 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.699131 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:09.705075 27366 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:09.705148 27436 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:09.593199 27444 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.622845 27381 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.377s
I20260709 13:08:09.705862 27433 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.691201 27378 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:09.642062 27343 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:09.638474 27271 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.622695 27438 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.401s
I20260709 13:08:09.692102 27434 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.644522 27429 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:09.634333 27337 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:09.710553 27054 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:08:09.742210 27454 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:08:09.744978 27435 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
W20260709 13:08:09.851754 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 251196us
W20260709 13:08:09.746244 27449 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 13:08:09.747128 27445 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 13:08:09.748099 27441 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:08:09.757017 27440 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:08:09.758504 27196 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:09.585806 27431 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.869939 22020 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:08:09.725376 27292 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.766271 27433 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:09.872409 27433 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.633598 27219 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.709873 27370 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:09.725602 27160 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:09.876787 27160 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.877367 27160 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:09.877700 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1775) took 1151 ms. Trace:
I20260709 13:08:09.878091 21945 rpcz_store.cc:276] 0709 13:08:08.726071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.755060 (+ 28989us) service_pool.cc:224] Handling call
0709 13:08:08.761934 (+  6874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.762276 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.762305 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.762748 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.829738 (+ 66990us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:08.829782 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.831437 (+  1655us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.877452 (+1046015us) raft_consensus.cc:1685] finished
0709 13:08:09.877476 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.877637 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1010,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":66618,"threads_started":1,"wal-append.queue_time_us":447488}
I20260709 13:08:09.769562 27396 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:09.775230 27448 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:09.776067 27247 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:09.777871 27365 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.001s
W20260709 13:08:09.779948 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.897614 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 800) took 1036 ms. Trace:
I20260709 13:08:09.646782 27349 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.809079 27371 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:09.730400 27366 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.733326 27350 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.745293 27372 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:09.898087 21948 rpcz_store.cc:276] 0709 13:08:08.861062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.301994 (+440932us) service_pool.cc:224] Handling call
0709 13:08:09.324779 (+ 22785us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:09.350828 (+ 26049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.350858 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:09.358114 (+  7256us) log.cc:844] Serialized 52 byte log entry
0709 13:08:09.475817 (+117703us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:09.475872 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.475962 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.897384 (+421422us) raft_consensus.cc:1685] finished
0709 13:08:09.897406 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.897558 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22969,"raft.queue_time_us":33947,"spinlock_wait_cycles":22688000,"thread_start_us":117212,"threads_started":1,"wal-append.queue_time_us":239104}
I20260709 13:08:09.648022 26862 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:09.860539 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:09.859683 27304 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:09.867812 27313 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:09.896656 27455 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:08:09.734894 27146 consensus_meta.cc:287] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.002s
I20260709 13:08:09.897686 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.899986 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:09.901175 27033 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.938910 22608 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:09.902635 27369 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.817471 27442 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.946837 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:09.902508 27292 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:09.953701 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.954962 21988 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:09.956120 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:09.909966 27370 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:09.898639 27371 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.975773 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.950062 27429 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.911808 27439 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:08:09.992847 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:09.981449 27345 consensus_meta.cc:287] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.524s	user 0.000s	sys 0.010s
I20260709 13:08:10.005578 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:09.939635 27350 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:08:09.981916 27054 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.009332 27345 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:10.013309 27452 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 13:08:10.013434 27462 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:10.015884 27386 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:09.984905 27146 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.984308 27443 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.990207 27314 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.024945 27146 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:10.027562 21771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 165) took 34150 ms (client timeout 15000 ms). Trace:
I20260709 13:08:10.008858 27426 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:10.029452 27303 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.000213 27428 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.988768 27269 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:09.978145 27292 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.975103 27369 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:09.988575 27378 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:09.991432 27396 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:10.024290 27386 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:10.009528 27432 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:09.985934 27370 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.007870 27433 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:10.051721 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 768) took 2506 ms. Trace:
I20260709 13:08:09.987246 27343 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.027598 27146 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.003055 27429 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.062809 27474 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:10.063328 27474 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:10.064214 27474 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.053356 27386 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:10.040831 27470 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:10.060233 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1859) took 3422 ms. Trace:
I20260709 13:08:10.047322 27378 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.059338 22610 rpcz_store.cc:276] 0709 13:08:07.540706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.542636 (+  1930us) service_pool.cc:224] Handling call
0709 13:08:07.543091 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:07.549618 (+  6527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.549649 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:07.586619 (+ 36970us) log.cc:844] Serialized 52 byte log entry
0709 13:08:09.368240 (+1781621us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b180037a920. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:08:09.583683 (+215443us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:09.583740 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.583973 (+   233us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.045555 (+461582us) raft_consensus.cc:1685] finished
0709 13:08:10.045575 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.046648 (+  1073us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6044,"raft.queue_time_us":79468,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10793,"spinlock_wait_cycles":10239232,"thread_start_us":215218,"threads_started":1,"wal-append.queue_time_us":2035568}
I20260709 13:08:10.058671 27418 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:10.057469 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51979.8us
W20260709 13:08:10.028010 21771 rpcz_store.cc:269] 0709 13:07:35.876908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.888712 (+ 11804us) service_pool.cc:224] Handling call
0709 13:08:10.027460 (+34138748us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:04.796654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:04.826632 (+ 29978us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:04.826684 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:08:04.826703 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:04.827673 (+   970us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:04.827805 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:04.827839 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:04.878281 (+ 50442us) tablet.cc:701] Row locks acquired
0709 13:08:04.901002 (+ 22721us) write_op.cc:260] PREPARE: finished
0709 13:08:04.941741 (+ 40739us) write_op.cc:270] Start()
0709 13:08:04.957879 (+ 16138us) write_op.cc:276] Timestamp: P: 1783602484933905 usec, L: 0
0709 13:08:04.964181 (+  6302us) op_driver.cc:348] REPLICATION: starting
0709 13:08:05.199125 (+234944us) log.cc:844] Serialized 3170 byte log entry
0709 13:08:05.802202 (+603077us) op_driver.cc:464] REPLICATION: finished
0709 13:08:06.002521 (+200319us) write_op.cc:301] APPLY: starting
0709 13:08:06.002646 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:06.523976 (+521330us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:06.524104 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:06.877448 (+353344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:06.877743 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:08:06.877795 (+    52us) write_op.cc:312] APPLY: finished
0709 13:08:06.878120 (+   325us) log.cc:844] Serialized 81 byte log entry
0709 13:08:06.972704 (+ 94584us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.982088 (+  9384us) write_op.cc:454] Released schema lock
0709 13:08:07.000838 (+ 18750us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:07.048785 (+ 47947us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:07.050466 (+  1681us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7941418,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":142960,"apply.run_cpu_time_us":37834,"apply.run_wall_time_us":1040478,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37615,"num_ops":8,"prepare.queue_time_us":203884,"prepare.run_cpu_time_us":33583,"prepare.run_wall_time_us":801927,"raft.queue_time_us":120031,"raft.run_cpu_time_us":15154,"raft.run_wall_time_us":221717,"replication_time_us":783425,"thread_start_us":473389,"threads_started":5,"wal-append.queue_time_us":438015,"wal-append.run_cpu_time_us":7739,"wal-append.run_wall_time_us":2112277}]]}
W20260709 13:08:10.057859 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 197384us
I20260709 13:08:10.079020 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:10.082408 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:10.083170 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:10.056435 27223 consensus_meta.cc:287] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:08:10.052081 27431 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.039134 27054 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.098058 21869 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:10.060145 27459 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.109s	user 0.001s	sys 0.001s
I20260709 13:08:10.064317 27429 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.069310 22022 rpcz_store.cc:276] 0709 13:08:06.632299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.762490 (+130191us) service_pool.cc:224] Handling call
0709 13:08:08.910380 (+2147890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.912319 (+  1939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.054843 (+1142524us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b540017b1d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:10.055019 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4938865024}
I20260709 13:08:10.044225 27428 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.086649 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.090902 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.093915 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:10.053587 27432 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:10.099602 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.104024 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.104996 21873 raft_consensus.cc:2410] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:10.105013 22024 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:10.105705 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.106540 22602 raft_consensus.cc:2410] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 20 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:08:10.069082 27470 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:10.107977 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.111995 22603 raft_consensus.cc:2410] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:10.074918 27378 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.108418 27313 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 13:08:10.115800 27463 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:08:10.107478 27432 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:10.117527 27437 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.814s	user 0.000s	sys 0.003s
I20260709 13:08:10.117616 27160 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.119004 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1777) took 1320 ms. Trace:
I20260709 13:08:10.119892 27160 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.120110 27475 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:10.120590 27475 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:10.120842 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.108270 27429 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.100467 27474 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.113691 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.068713 27444 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.109889 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.123991 22604 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:08:10.125054 27442 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.126425 27428 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.126932 27054 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.127305 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.127936 22019 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:10.128785 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.119344 21943 rpcz_store.cc:276] 0709 13:08:08.799065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.799276 (+   211us) service_pool.cc:224] Handling call
0709 13:08:08.802600 (+  3324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.803011 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:08.803041 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.803500 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.974647 (+171147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:08.976703 (+  2056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.977667 (+   964us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.064480 (+1086813us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:10.118713 (+ 54233us) raft_consensus.cc:1685] finished
0709 13:08:10.118734 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.118939 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1251,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6023,"spinlock_wait_cycles":16468224,"thread_start_us":169790,"threads_started":1,"wal-append.queue_time_us":368149}
I20260709 13:08:10.129776 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.130802 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.131313 22019 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:10.132052 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.102674 27350 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:08:10.137759 21946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2604) took 2130 ms (client timeout 2149 ms). Trace:
W20260709 13:08:10.138233 21946 rpcz_store.cc:269] 0709 13:08:08.007049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.007223 (+   174us) service_pool.cc:224] Handling call
0709 13:08:10.137530 (+2130307us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000fc154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:10.137656 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877930240}
I20260709 13:08:10.121033 27475 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.146517 27336 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:10.147061 27336 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:10.151093 27313 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:10.153462 22019 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.157359 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:10.159950 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:10.162094 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:10.147975 27336 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.113687 27467 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:08:10.164362 27054 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:10.184883 27054 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.185328 27054 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:10.125002 27472 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:08:10.165153 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.169209 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.155922 27366 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.177382 27336 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:10.158077 27371 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.191075 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:10.216361 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.194585 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.204823 22604 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:10.163033 27444 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:10.209487 27370 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.213776 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.216434 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:10.222609 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:10.189330 27474 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:10.227656 27469 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:10.228421 22019 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:10.229739 22019 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:10.233623 27313 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:10.220006 27269 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:10.241549 27269 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:10.222515 27444 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:10.242467 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 3168) took 1164 ms. Trace:
I20260709 13:08:10.242794 27444 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:10.243057 22021 rpcz_store.cc:276] 0709 13:08:09.078177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.171996 (+ 93819us) service_pool.cc:224] Handling call
0709 13:08:10.242250 (+1070254us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540017c5d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:10.242394 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390876032}
I20260709 13:08:10.247833 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3170) took 1156 ms. Trace:
I20260709 13:08:10.248559 21839 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:10.188725 27378 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.248358 22020 rpcz_store.cc:276] 0709 13:08:09.091705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.454121 (+362416us) service_pool.cc:224] Handling call
0709 13:08:09.488375 (+ 34254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.870328 (+381953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.247526 (+377198us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54001ee6d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:10.247757 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876842880}
I20260709 13:08:10.253230 27432 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.255784 27432 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.227005 27434 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.234917 27474 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:10.271256 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.757s (SENT) [suppressed 41 similar messages]
I20260709 13:08:10.274152 22022 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 16: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:10.279831 27386 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.282266 27386 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:10.285620 27476 log.cc:927] Time spent T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:10.265865 27313 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.266090 27412 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.289031 27412 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.291599 27412 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.294124 27122 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.238301 27472 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:10.253286 27384 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.296787 22022 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:10.242507 27269 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.306236 27269 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:10.167073 27470 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.310185 22023 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:10.326344 21874 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.274401 27474 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.304538 27378 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.360255 27470 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:10.373598 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 102381us
I20260709 13:08:10.379253 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 801) took 1457 ms. Trace:
I20260709 13:08:10.379698 21949 rpcz_store.cc:276] 0709 13:08:08.921887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.299694 (+377807us) service_pool.cc:224] Handling call
0709 13:08:09.299998 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.303092 (+  3094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.303121 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.303174 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:09.303211 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.379021 (+1075810us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b54000fdf54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:10.379071 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.379193 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6676736}
I20260709 13:08:10.383467 27054 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.384662 22020 raft_consensus.cc:1240] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:10.386663 22020 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:08:10.436914 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 52405.1us
I20260709 13:08:10.405963 27439 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:10.443439 22576 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:10.445624 27366 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:10.369622 27444 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.446571 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:10.446197 27366 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:10.447901 27122 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.448530 27365 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.448426 27366 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.449187 27365 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.451280 27365 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.448438 27122 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:10.458385 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.446353 27370 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.460673 27267 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:08:10.449405 27483 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:10.470034 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3153) took 3061 ms. Trace:
I20260709 13:08:10.470891 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:10.475980 27369 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:10.464265 27444 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:10.511096 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.514597 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.515389 22605 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
W20260709 13:08:10.516585 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.454551 27475 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.478345 22015 rpcz_store.cc:276] 0709 13:08:07.408726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.736240 (+327514us) service_pool.cc:224] Handling call
0709 13:08:08.960396 (+1224156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.010537 (+ 50141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.468438 (+1457901us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001f18d0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:10.469965 (+  1527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2814368512}
I20260709 13:08:10.473455 27303 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.519555 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.535187 22015 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:10.485105 27350 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:08:10.488252 27176 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:10.508409 27429 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.539405 27303 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.509083 27122 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.492414 27267 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:08:10.548914 21942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1765) took 2268 ms (client timeout 2228 ms). Trace:
I20260709 13:08:10.485527 27349 consensus_queue.cc:1059] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:08:10.551198 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.477923 27370 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.554095 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.562872 27474 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.558328 27442 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:10.560052 27040 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:08:10.560869 22016 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1884) took 1535 ms (client timeout 1757 ms). Trace:
I20260709 13:08:10.563704 27429 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.610546 27429 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.567062 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.613304 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:10.549954 27480 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:10.615123 27040 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:10.615577 22023 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:10.616096 27040 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.617380 27040 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.619658 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.620445 21867 raft_consensus.cc:2393] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:10.606307 22016 rpcz_store.cc:269] 0709 13:08:09.025254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.094775 (+ 69521us) service_pool.cc:224] Handling call
0709 13:08:10.560674 (+1465899us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400181ad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:10.560803 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494220544}
I20260709 13:08:10.621987 22016 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.623385 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:10.625083 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:10.584450 21942 rpcz_store.cc:269] 0709 13:08:08.280359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.280500 (+   141us) service_pool.cc:224] Handling call
0709 13:08:10.548720 (+2268220us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b540019ad54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:10.548839 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283865472}
I20260709 13:08:10.588546 22015 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:10.553520 27054 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.545176 27176 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:10.594198 22020 raft_consensus.cc:2393] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 20: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:10.557348 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.629659 22605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:36026
I20260709 13:08:10.630064 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:10.594703 27482 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:08:10.597433 27417 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.630934 21868 raft_consensus.cc:2410] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:10.599987 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.631608 22603 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:10.596091 27475 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.569561 27434 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.600777 27303 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:10.635602 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.630226 22605 raft_consensus.cc:606] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:10.605922 27442 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:10.644832 27486 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:10.645318 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.645969 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.689285 21870 raft_consensus.cc:2393] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:10.648795 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:10.653995 27370 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.654726 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1766) took 2374 ms. Trace:
I20260709 13:08:10.690783 21950 rpcz_store.cc:276] 0709 13:08:08.280680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.281419 (+   739us) service_pool.cc:224] Handling call
0709 13:08:08.281801 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.282195 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.282232 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.971534 (+689302us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b2c00010da8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:08:08.971969 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.367631 (+395662us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:09.420232 (+ 52601us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.654191 (+1233959us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b18003bf8c0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:08:10.654386 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.654464 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.654516 (+    52us) raft_consensus.cc:1685] finished
0709 13:08:10.654531 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.654664 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":490,"prepare.queue_time_us":52606,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3866,"raft.queue_time_us":1250801,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":3164,"spinlock_wait_cycles":40136320,"thread_start_us":351842,"threads_started":1,"wal-append.queue_time_us":503205}
I20260709 13:08:10.693488 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.656247 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44780 (request call id 943) took 1334 ms. Trace:
W20260709 13:08:10.657451 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 1.20703e+06us
I20260709 13:08:10.694129 21875 rpcz_store.cc:276] 0709 13:08:09.321748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.323002 (+  1254us) service_pool.cc:224] Handling call
0709 13:08:10.656027 (+1333025us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b540044f054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:10.656183 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184389504}
I20260709 13:08:10.696048 21950 raft_consensus.cc:1217] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.7->[9.8-13.10]   Dedup: 9.8->[11.9-13.10]
I20260709 13:08:10.696542 21950 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [9.8-13.10]
I20260709 13:08:10.697220 21944 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:08:10.658010 27266 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:10.658655 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 1.18793e+06us
I20260709 13:08:10.661975 27474 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:10.662461 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.663594 27358 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:10.664040 27292 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:10.664116 27265 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:10.737994 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:10.738759 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.739444 21945 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:10.739570 21941 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:10.624024 27349 consensus_queue.cc:1243] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:10.666069 27368 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.666515 27427 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.666916 27399 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:10.668450 27434 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:10.629287 27431 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.670212 27343 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:10.670603 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.635640 27176 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.671676 27443 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.648831 27267 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.675103 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 717) took 1651 ms. Trace:
I20260709 13:08:10.679774 27003 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.682670 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.683421 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.680953 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.689965 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.709201 22573 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:10.717605 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.694155 21872 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:10.724407 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:10.725802 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.729841 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.731017 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:10.734043 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.734956 22024 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:10.740506 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.742134 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.740483 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.744761 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.745114 22020 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:10.967409 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:10.967638 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.723551 27384 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:10.968235 22020 raft_consensus.cc:2368] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16.
I20260709 13:08:10.994581 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.742718 27358 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.968778 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:10.998093 22605 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:10.998428 22015 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:10.858387 27410 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:10.968964 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.999884 21946 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:10.961103 27442 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.970669 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:10.972111 21945 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:11.007822 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.788282 22023 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:10.977645 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.978374 21873 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.010869 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:11.009738 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:10.980271 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.981081 21867 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:10.847080 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.982049 21949 raft_consensus.cc:2410] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:10.790433 21875 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:10.983356 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:10.930187 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:10.733922 27370 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.246s
I20260709 13:08:11.014070 22019 raft_consensus.cc:2410] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:08:10.968014 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.013762 21916 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:10.993727 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 284650us
I20260709 13:08:10.995697 22024 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
W20260709 13:08:10.995951 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 460060us
I20260709 13:08:11.017951 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.992841 21868 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:10.999769 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:10.969738 21948 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:10.733650 27430 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.730440 27336 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.989342 22017 rpcz_store.cc:276] 0709 13:08:09.024169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.284369 (+260200us) service_pool.cc:224] Handling call
0709 13:08:09.298937 (+ 14568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.781026 (+482089us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:09.781071 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.819136 (+ 38065us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.977242 (+158106us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:09.977280 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.640394 (+663114us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54001f13d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:10.640458 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.640526 (+    68us) raft_consensus.cc:1685] finished
0709 13:08:10.640545 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.675035 (+ 34490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107817728,"thread_start_us":95676,"threads_started":1,"wal-append.queue_time_us":202961}
I20260709 13:08:11.018143 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.019845 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.020529 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.001241 27292 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:11.022078 27341 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.997335 27434 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.029789 27341 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:10.997555 27427 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.027243 27292 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.997478 27343 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.033056 27292 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:10.791742 27265 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.056911 27262 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:11.057888 27262 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.058560 27265 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.059190 27265 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:11.059906 27262 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.065297 27472 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:11.065791 27472 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:11.066816 27350 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:11.066633 27472 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.067241 27350 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:11.067931 27472 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:11.068572 27350 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.069782 27350 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.070317 27084 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:11.073925 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:10.747864 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:10.929442 27271 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.074869 27442 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.075114 27271 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.820050 27258 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:11.076897 27258 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.077982 27271 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.028975 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:11.078761 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49871.2us
I20260709 13:08:11.079699 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.080904 27369 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:11.081024 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.081334 27369 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.081749 27369 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:11.082343 27281 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:11.082770 27281 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:11.083128 27281 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:11.032006 27321 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.084779 27411 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.002969 27384 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.086355 21945 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:11.087659 27384 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.035141 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.023960 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:11.032310 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:11.038029 21839 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:10.996932 27266 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:11.010557 27410 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:10.997076 27431 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.041668 27427 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.042485 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.103624 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.103799 21866 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:11.044238 27341 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.044585 27358 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.045372 27343 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.045666 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.045986 21875 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:08:11.121340 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 107643us
I20260709 13:08:11.046584 22020 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:11.037485 21943 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 20.
I20260709 13:08:11.024694 21871 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.055261 27363 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:11.055786 27337 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:11.055900 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.125571 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:10.976460 27040 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:08:11.056429 27374 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:11.089046 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:11.146018 21948 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.146423 21916 leader_election.cc:400] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16.
I20260709 13:08:11.146879 21916 leader_election.cc:403] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:11.089205 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:11.037441 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:11.089566 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 51629.3us
I20260709 13:08:11.089959 21870 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.025499 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.150687 21944 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:10.996266 21874 raft_consensus.cc:2393] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:11.092093 21914 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.093295 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:11.093451 21873 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:11.097325 22023 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.020242 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.099480 27345 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.099196 27428 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:11.106680 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:11.110754 27417 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:11.120059 27377 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.163105 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.166823 21875 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.112910 27258 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.113425 27431 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:11.180817 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 74224.4us
I20260709 13:08:11.060055 27265 consensus_queue.cc:1243] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:08:11.115509 27410 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.101006 27266 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.116423 22024 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:11.193272 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.998811 27368 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.134923 21867 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:11.006494 27003 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.099383 27303 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.138967 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.140563 27304 consensus_queue.cc:1059] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:08:11.090142 27430 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.089962 27336 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.215317 27304 raft_consensus.cc:3055] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.215726 27304 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:11.216037 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:11.216401 27336 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.143844 27374 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.216627 27304 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.217274 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.217944 21943 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:11.218474 27374 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.046649 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.218799 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:11.155215 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 63227.8us
I20260709 13:08:11.152518 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.165875 21916 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:11.219794 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 54002.6us
I20260709 13:08:11.220242 27304 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.110805 27281 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.220955 27219 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:11.221288 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:11.187913 27377 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.222375 27281 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.223131 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.223769 27377 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.138818 27337 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.224026 26862 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:11.153896 27345 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.224841 27345 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.224771 27427 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:11.226078 27337 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.227720 27292 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.228791 21941 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:11.140549 27341 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.229434 27341 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.229844 27266 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.230258 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:11.230518 27292 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.230827 21941 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.231642 27430 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.232410 27368 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.232651 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.233255 21866 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.178750 27176 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.236780 21943 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:08:11.237715 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.238204 27176 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.189081 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.239293 21872 raft_consensus.cc:2410] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:11.239445 26862 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:11.190603 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.239786 26862 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:11.240677 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.179977 27428 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.224277 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:11.241571 21946 raft_consensus.cc:2410] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:10.999053 27443 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.242426 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.242991 21946 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:11.243800 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.242426 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:11.161358 27383 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.021s
I20260709 13:08:11.197893 27358 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:08:11.209961 27349 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:11.200366 27196 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:11.245138 27349 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.245685 27196 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.208812 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:11.205907 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:11.247146 27349 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.247597 27196 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:11.229815 27341 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.226398 27427 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.248162 27196 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.249126 27380 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:11.249526 27380 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:11.250308 27380 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.252810 21943 raft_consensus.cc:2410] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:11.253238 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.253657 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.253865 21875 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:11.254300 27427 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:11.255118 21875 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:08:11.194538 27411 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:11.214401 27474 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:11.255779 27474 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:11.255672 27411 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.256250 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:11.256731 27474 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.257642 27122 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:11.257886 27411 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.258208 27122 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.258733 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.259351 21872 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:11.211427 27303 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:11.208892 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 115663us
I20260709 13:08:11.183364 22574 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:11.162688 27384 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:08:11.200811 27467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.015s	sys 0.026s
I20260709 13:08:11.169826 21871 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:11.244256 27443 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.156479 27262 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:11.244526 27383 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.008s	sys 0.021s
I20260709 13:08:11.199442 27370 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:11.254976 27358 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:10.999269 27399 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.138888 27363 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.160715 27417 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:11.240638 26862 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.260640 27303 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.285382 22608 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:11.289225 27196 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.244256 27003 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.312927 27282 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:11.309403 21950 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:11.403334 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.404629 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.404987 21942 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:08:11.405966 21950 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:11.304423 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:11.270812 21948 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
W20260709 13:08:11.406986 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 102658us
I20260709 13:08:11.407578 21948 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.261871 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.253360 22603 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:11.317548 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 134264us
I20260709 13:08:11.318773 21875 pending_rounds.cc:85] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 9
I20260709 13:08:11.410087 21875 pending_rounds.cc:107] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:08:11.410383 21875 raft_consensus.cc:2889] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:11.410481 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:11.311002 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 54832.7us
W20260709 13:08:11.310842 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 57016.6us
I20260709 13:08:11.325034 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.411950 22024 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 20.
I20260709 13:08:11.414573 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.415997 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.416657 22024 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:11.417523 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.308022 21866 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:11.311326 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.419273 21944 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:11.409859 27271 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16.
I20260709 13:08:11.336120 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.271001 21941 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:08:11.210438 27442 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.260581 27428 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:11.258735 27122 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:11.186163 21870 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
W20260709 13:08:11.314632 27467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.019s	sys 0.027s
I20260709 13:08:11.386762 22020 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:11.312152 21869 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: [12.6-13.7]
I20260709 13:08:11.412101 27370 raft_consensus.cc:2764] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:11.381309 27411 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.326332 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.415638 26862 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:11.332283 22022 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.083s	sys 0.192s
W20260709 13:08:11.434303 22022 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.083s	sys 0.192s
I20260709 13:08:11.435447 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43292 (request call id 1906) took 1218 ms. Trace:
I20260709 13:08:11.419684 21867 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:08:11.420693 22603 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:11.399075 27196 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.421909 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:11.423362 27431 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.429603 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.411607 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:11.431520 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.432188 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.420545 27343 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.423686 27258 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.435943 22022 rpcz_store.cc:276] 0709 13:08:10.217343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.305984 (+ 88641us) service_pool.cc:224] Handling call
0709 13:08:10.306301 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.306644 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.306672 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.307137 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.364432 (+ 57295us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:11.434794 (+1070362us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.435079 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.435172 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.435217 (+    45us) raft_consensus.cc:1685] finished
0709 13:08:11.435229 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.435376 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7854,"prepare.queue_time_us":77311,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":1102,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1049749,"threads_started":2,"wal-append.queue_time_us":118365}
I20260709 13:08:11.441243 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:11.449971 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.411271 27282 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.429652 27411 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.427631 27040 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:08:11.468204 21866 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 11.
I20260709 13:08:11.466183 27258 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.415385 27369 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.477207 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:11.479120 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.479971 22022 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:11.480875 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:11.447602 27431 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.448040 27384 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:11.483001 27370 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:11.471269 27358 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:11.464485 27054 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.484462 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.511276 27358 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.511384 27054 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.511787 27358 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:11.511950 27054 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:11.484995 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.512290 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.431120 27281 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:11.513830 27281 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:11.514269 27281 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:08:11.515862 27366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.004s	sys 0.019s
I20260709 13:08:11.515379 27281 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.428671 27442 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.522742 27442 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.526482 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:11.476125 27411 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.463112 27269 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:08:11.493994 27384 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.447423 27417 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:11.516841 27375 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.003s	sys 0.019s
I20260709 13:08:11.468886 27343 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.495025 27431 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.494630 27429 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:08:11.535554 27281 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:11.548087 27267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.015s	sys 0.045s
W20260709 13:08:11.593312 27267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.015s	sys 0.046s
I20260709 13:08:11.542649 27384 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:11.570504 27341 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.542027 27430 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.572367 27375 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.004s	sys 0.019s
I20260709 13:08:11.586504 27343 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.589161 27399 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.577239 27429 consensus_queue.cc:1243] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:08:11.516543 22021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.012s	sys 0.011s
I20260709 13:08:11.584184 27054 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.622630 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:11.598366 27269 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:11.516278 27366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.004s	sys 0.019s
I20260709 13:08:11.629850 27374 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:11.639149 27374 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:11.639886 27282 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:11.632844 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.637416 27369 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.638195 27269 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.641544 27429 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:11.642972 27269 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.604370 27430 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.640122 27374 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.644304 27374 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:11.647274 21873 raft_consensus.cc:2410] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:08:11.626318 21946 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:11.653435 22020 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:11.656076 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.656898 21871 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:11.610137 22021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.012s	sys 0.011s
W20260709 13:08:11.665409 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 444165us
I20260709 13:08:11.674244 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:11.648849 27377 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:11.652540 27084 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.002s	sys 0.009s
I20260709 13:08:11.681666 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.679952 22610 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:11.684252 21871 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:11.608880 27358 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.665401 27306 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.690191 22574 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:11.650781 27444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.013s	sys 0.012s
W20260709 13:08:11.680442 27084 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.002s	sys 0.010s
I20260709 13:08:11.712874 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:11.680932 27377 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:11.724347 27496 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:08:11.725551 27054 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:11.726927 27054 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:11.727375 27054 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:11.729089 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 724) took 1284 ms. Trace:
I20260709 13:08:11.729302 27411 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.729627 22016 rpcz_store.cc:276] 0709 13:08:10.445034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.622663 (+177629us) service_pool.cc:224] Handling call
0709 13:08:10.622941 (+   278us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:10.623287 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.623313 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:10.636462 (+ 13149us) log.cc:844] Serialized 52 byte log entry
0709 13:08:10.974811 (+338349us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b18004afd40. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:08:11.444555 (+469744us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:11.444594 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.449809 (+  5215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.728679 (+278870us) raft_consensus.cc:1685] finished
0709 13:08:11.728710 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.729010 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1131,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10422,"spinlock_wait_cycles":54764800,"thread_start_us":469543,"threads_started":1,"wal-append.queue_time_us":953985}
I20260709 13:08:11.732115 27304 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.685506 27262 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.733105 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:11.685379 27366 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:11.711336 27444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.014s	sys 0.012s
I20260709 13:08:11.732127 27411 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:11.773164 27269 consensus_queue.cc:1059] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:11.718019 27219 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:11.735126 27377 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.780643 27467 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:11.783174 21866 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:11.784082 22608 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:11.732671 27304 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:11.789399 27491 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:08:11.813197 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:11.792915 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:11.732591 27258 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.797479 27341 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.728080 27384 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.805806 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:11.818375 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 391931us
I20260709 13:08:11.716786 27267 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:11.716171 27368 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.810231 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:11.734277 27427 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:11.710744 27282 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:08:11.796816 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:11.825196 22610 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
I20260709 13:08:11.814149 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.815790 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.827047 21866 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:08:11.814970 21874 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.038s	sys 0.045s
I20260709 13:08:11.820860 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:11.818073 27321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.010s	sys 0.023s
W20260709 13:08:11.829614 21874 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.038s	sys 0.045s
I20260709 13:08:11.822206 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.733210 27122 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.832898 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:11.831507 27321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.010s	sys 0.024s
W20260709 13:08:11.814632 27390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.013s	sys 0.013s
I20260709 13:08:11.839548 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.842649 21867 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:11.841151 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.834654 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.728385 27054 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.804991 27366 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.825886 27341 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.830077 27442 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.845134 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.832149 27267 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:11.835422 27427 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:11.853374 22573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.022s	sys 0.015s
W20260709 13:08:11.843889 27345 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:08:11.823973 27258 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:08:11.867622 21868 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:11.851470 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:11.853871 27390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.014s	sys 0.013s
I20260709 13:08:11.861420 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:11.869405 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:11.860378 22573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.023s	sys 0.015s
I20260709 13:08:11.841967 27219 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:11.883272 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.911140 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:11.852929 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 370585us
I20260709 13:08:11.916050 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.917356 21941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:11.918082 21941 raft_consensus.cc:606] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.918502 21941 raft_consensus.cc:614] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:11.922263 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.922416 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.922950 21944 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:11.923877 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.925314 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:11.925864 21944 raft_consensus.cc:3060] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.916888 21868 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 9.
I20260709 13:08:11.919684 27054 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.854074 27341 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.915477 27507 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:11.909142 27370 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:11.905705 27431 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:11.867933 27345 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.936573 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.048159 27341 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.048878 27341 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.938194 21867 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:12.050699 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.051873 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.028548 21943 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:11.937287 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:12.099946 27518 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:12.100251 22601 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:12.100935 27412 raft_consensus.cc:993] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:12.028475 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 804) took 1301 ms. Trace:
I20260709 13:08:11.942183 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:11.946450 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.974191 21949 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:11.941119 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:11.945976 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:12.109894 22607 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.029001 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3180) took 1170 ms. Trace:
I20260709 13:08:12.042907 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.052444 21867 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
W20260709 13:08:12.096259 27503 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:08:12.102871 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:12.025882 27500 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:08:11.963956 27497 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:08:12.133253 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:11.965085 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:11.964439 27502 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:08:12.126823 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 184698us
I20260709 13:08:11.948514 27282 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.060822 27304 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:11.939493 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:12.138883 21948 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.003685 27358 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.026407 27516 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:11.965477 27303 consensus_meta.cc:287] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.004s
I20260709 13:08:12.095110 27122 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.134959 21941 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:12.154568 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.100955 27518 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:11.958571 27292 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.025945 27517 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:12.136541 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:12.097877 27377 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.137190 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.134207 21868 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
W20260709 13:08:12.140362 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 271051us
I20260709 13:08:11.986322 27514 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.110865 22017 rpcz_store.cc:276] 0709 13:08:10.858921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.101090 (+242169us) service_pool.cc:224] Handling call
0709 13:08:11.137433 (+ 36343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.141277 (+  3844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.141321 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.156146 (+ 14825us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.656864 (+500718us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:11.656910 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.656986 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.028729 (+371743us) raft_consensus.cc:1685] finished
0709 13:08:12.028755 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.028940 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18269,"raft.queue_time_us":3398,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":23281,"thread_start_us":389497,"threads_started":1,"wal-append.queue_time_us":750132}
I20260709 13:08:12.179287 21948 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:11.967204 27507 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:12.190001 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.190703 21948 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
W20260709 13:08:12.144672 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 208177us
I20260709 13:08:12.104419 27505 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:12.129756 27412 raft_consensus.cc:1081] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
W20260709 13:08:12.148716 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.052357 21768 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 10 to 12, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 12 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:12.155479 21941 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:12.131305 27384 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.160919 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:12.105904 21945 rpcz_store.cc:276] 0709 13:08:10.727206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.305889 (+578683us) service_pool.cc:224] Handling call
0709 13:08:11.306313 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:11.306783 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.306821 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:11.383050 (+ 76229us) log.cc:844] Serialized 52 byte log entry
0709 13:08:11.811132 (+428082us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:11.836015 (+ 24883us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.838938 (+  2923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.839039 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.028219 (+189180us) raft_consensus.cc:1685] finished
0709 13:08:12.028241 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.028412 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6757,"prepare.queue_time_us":24867,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":17099,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":64444,"spinlock_wait_cycles":4521728,"thread_start_us":395425,"threads_started":1,"wal-append.queue_time_us":602528}
I20260709 13:08:12.266050 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.267501 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:12.268359 21945 raft_consensus.cc:2368] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
W20260709 13:08:12.163128 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 370336us
I20260709 13:08:12.187516 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.271442 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.188143 21867 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
I20260709 13:08:12.264410 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.273587 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:11.992273 27427 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.048883 27370 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.199424 27292 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:12.145598 27282 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:11.978917 27267 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.184217 27515 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.190761 27366 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.156914 27303 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:12.214454 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.215566 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2891) took 1226 ms. Trace:
I20260709 13:08:12.219628 22018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3169) took 3138 ms. Trace:
I20260709 13:08:12.291651 22018 rpcz_store.cc:276] 0709 13:08:09.080965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.453903 (+372938us) service_pool.cc:224] Handling call
0709 13:08:09.454264 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.454566 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:11.112142 (+1657576us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b180010f780. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf
0709 13:08:11.112283 (+   141us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.914618 (+802335us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.219123 (+304505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.219199 (+    76us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:12.219278 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.219380 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.219546 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16074,"prepare.queue_time_us":153109,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":4622,"raft.queue_time_us":428717,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":7085,"spinlock_wait_cycles":8937344,"thread_start_us":1245388,"threads_started":4,"wal-append.queue_time_us":701658}
I20260709 13:08:12.220772 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2630) took 1223 ms. Trace:
I20260709 13:08:12.227439 27470 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:12.228753 27434 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.229496 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:12.289187 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.230767 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54900 (request call id 2635) took 1170 ms. Trace:
I20260709 13:08:12.303735 21943 rpcz_store.cc:276] 0709 13:08:11.060653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.255469 (+194816us) service_pool.cc:224] Handling call
0709 13:08:12.230506 (+975037us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54000fda54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:12.230690 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383533312}
I20260709 13:08:12.234082 27390 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:12.234704 22607 raft_consensus.cc:2410] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:12.235888 27358 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:12.237197 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.247740 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1792) took 1535 ms. Trace:
I20260709 13:08:12.308390 21949 rpcz_store.cc:276] 0709 13:08:10.712722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.242118 (+529396us) service_pool.cc:224] Handling call
0709 13:08:12.247495 (+1005377us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540019d054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:12.247656 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542902528}
I20260709 13:08:12.278882 27431 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:12.309544 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72458.3us
I20260709 13:08:12.254575 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 2374) took 1109 ms. Trace:
I20260709 13:08:12.199597 27176 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:12.038029 21944 raft_consensus.cc:2468] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:12.189092 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.274513 21941 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 9.
I20260709 13:08:12.276834 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:12.279491 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 118678us
I20260709 13:08:12.310483 21873 rpcz_store.cc:276] 0709 13:08:11.145186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.152195 (+  7009us) service_pool.cc:224] Handling call
0709 13:08:12.254313 (+1102118us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54003179d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:12.254490 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982777600}
I20260709 13:08:12.312006 22573 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:12.286688 27369 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:08:12.258414 27497 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:08:12.290962 21869 rpcz_store.cc:276] 0709 13:08:10.989061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.154227 (+165166us) service_pool.cc:224] Handling call
0709 13:08:11.311861 (+157634us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:11.429026 (+117165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.215310 (+786284us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54001b7950. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560718ad 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:12.215492 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285900032}
I20260709 13:08:12.291460 21768 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.293903 21946 rpcz_store.cc:276] 0709 13:08:10.997073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.243561 (+246488us) service_pool.cc:224] Handling call
0709 13:08:12.220490 (+976929us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400279cd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:12.220692 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858033408}
W20260709 13:08:12.295693 27521 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:08:12.296303 27519 log.cc:927] Time spent T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:12.327433 21768 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 14, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 14 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:12.277753 27292 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:12.297282 27520 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:12.297204 27303 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.297986 21871 raft_consensus.cc:2393] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:12.299842 27196 consensus_meta.cc:287] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.001s
W20260709 13:08:12.304828 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 392039us
I20260709 13:08:12.310626 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:12.313966 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 124961us
I20260709 13:08:12.314471 21942 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 11: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:12.303171 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:12.281693 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:12.287175 27345 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.319957 27377 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.321594 27282 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.331947 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:12.332238 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.295230 27470 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:12.276577 27505 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.334479 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.348152 21948 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:12.340294 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.315979 27369 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:12.353050 22024 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.351372 27431 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:08:12.352147 27428 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.355679 27428 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.344913 21914 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:08:12.345059 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 63461.8us
I20260709 13:08:12.339383 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:12.345570 21950 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:12.357434 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.357403 22024 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:12.325945 27219 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.318768 27434 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.317399 27366 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:12.343251 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:12.363628 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.363960 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:12.364670 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.349344 27384 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:12.351311 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.354882 22017 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:12.348649 27410 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.278658 27507 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.377228 27507 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.378207 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:12.378988 27374 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:12.378912 27383 consensus_queue.cc:1175] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95296a4420ed41b69191d3d4353cf2b0" responder_term: 15 status { last_received { term: 12 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.9-14.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:12.379969 27374 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:12.341598 27292 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:12.359625 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 172955us
I20260709 13:08:12.382560 22574 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:12.361116 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:12.384008 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.384955 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:12.385360 21838 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:12.385550 27384 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.385869 27410 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.374166 22023 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:12.386395 27410 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:12.386947 27410 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.388391 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:12.389168 27341 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:12.389642 27505 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.390610 27341 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.390982 27341 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:12.391383 27341 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.359601 27531 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:12.394688 27531 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.357403 27369 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:12.398164 27303 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.398597 27303 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:12.398938 27303 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.385396 21916 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:12.345839 21768 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 13, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 13 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:12.365300 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:12.315825 27358 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.400691 21768 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:12.316376 27390 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.402195 21768 catalog_manager.cc:5697] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 5 to 10, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:12.403710 27390 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.366814 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.404394 22024 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:12.350847 22018 raft_consensus.cc:1275] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:12.347646 27265 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.358912 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.409287 22016 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.411746 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:12.411005 27292 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.367408 27518 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.412657 27390 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.413118 27390 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.413425 27390 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.369474 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.371126 27428 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:12.371774 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.417601 27350 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.418557 27535 raft_consensus.cc:2764] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:12.368038 27271 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:12.419351 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.419476 27271 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:12.373023 27470 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.419952 27271 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.420286 27470 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.422030 27265 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:12.367542 27442 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.003s
I20260709 13:08:12.424873 27442 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.425091 27518 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.425572 27442 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:12.425689 22021 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.425976 27442 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:12.426362 27442 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.428628 27531 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.347999 27196 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.365717 27282 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:12.429706 27282 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:12.429620 27375 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:12.430219 27282 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.431452 27350 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.374665 27431 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:12.433378 27375 consensus_queue.cc:1048] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:12.381296 27374 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.436510 22021 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:12.436872 27374 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.437281 27374 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.437758 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.438397 22018 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:12.440212 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.402215 27358 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.372740 27345 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.440909 22018 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:12.441146 27345 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.441560 27345 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.373625 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.442986 22022 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:12.444720 22020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 3192) took 1063 ms. Trace:
I20260709 13:08:12.445186 27358 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:12.446575 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.447582 27380 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:12.445102 22020 rpcz_store.cc:276] 0709 13:08:11.381597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.511982 (+130385us) service_pool.cc:224] Handling call
0709 13:08:12.444522 (+932540us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400365e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:12.444665 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320245504}
I20260709 13:08:12.450994 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1788) took 1739 ms. Trace:
I20260709 13:08:12.451388 21947 rpcz_store.cc:276] 0709 13:08:10.711174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.711536 (+   362us) service_pool.cc:224] Handling call
0709 13:08:10.738361 (+ 26825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.401543 (+663182us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:11.816659 (+415116us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.105125 (+288466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.105198 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:12.105256 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.450755 (+345499us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54000fc654. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:12.450800 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.450934 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178779,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":109,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6175,"spinlock_wait_cycles":1524690176,"thread_start_us":682389,"threads_started":2,"wal-append.queue_time_us":383252}
I20260709 13:08:12.430943 27196 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:12.460769 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 108044us
I20260709 13:08:12.431488 22016 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:12.485319 22024 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 21.
I20260709 13:08:12.403985 21768 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 10 to 12, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 12 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:12.488157 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 122975us
I20260709 13:08:12.490190 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:12.495239 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:12.494982 21768 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 8 to 9, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 9 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:12.495800 22601 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.500208 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:12.502629 27292 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:12.503223 27350 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.512312 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:12.523559 21869 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.513101 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:12.517493 27410 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.525554 21987 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:12.498740 21871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:44780
I20260709 13:08:12.531288 21875 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:12.499361 27358 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.533233 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:12.544234 21916 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:12.537038 27282 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.531127 27370 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.552490 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.540781 27271 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.540086 27374 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.542183 27390 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.496794 27341 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.544415 21870 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.534451 27345 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.572783 27196 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.574298 27345 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.576241 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:12.521314 27537 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.553639 21768 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 11, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 11 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.579620 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:12.579864 27271 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.580542 27370 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.581040 27370 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:12.581455 27370 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.555693 21869 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:12.583274 27374 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.583529 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:12.584482 27321 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:12.585170 27321 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:12.586055 27321 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.584323 27040 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:12.588953 27040 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:12.589303 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.589844 27040 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.590539 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.591089 27040 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.591182 21869 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:12.593505 21869 pending_rounds.cc:85] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 9
I20260709 13:08:12.593878 21869 pending_rounds.cc:107] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:08:12.594238 21869 raft_consensus.cc:2889] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:12.493883 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47387.6us
I20260709 13:08:12.565114 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.594791 27336 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:12.597303 21875 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 15 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:12.597268 27336 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:12.598460 27363 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.598176 27336 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.577461 27417 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.607564 22573 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:12.608507 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:12.609982 21870 raft_consensus.cc:2410] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:12.579537 21768 catalog_manager.cc:5697] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:12.614001 22605 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:12.596513 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:12.572386 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:12.589372 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:12.617532 21867 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:12.600097 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 74641.9us
I20260709 13:08:12.613039 21916 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:12.622560 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:12.623464 22610 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:12.625031 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:12.596761 27410 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.567272 27375 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:12.631536 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.631791 22610 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:12.599061 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 213744us
I20260709 13:08:12.601658 21871 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:08:12.560529 21841 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.757s (SENT)
I20260709 13:08:12.627452 21943 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 13:08:12.633136 21871 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.633261 21943 pending_rounds.cc:85] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 14
I20260709 13:08:12.633384 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:12.633821 21943 pending_rounds.cc:107] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:08:12.634123 21943 raft_consensus.cc:2889] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.633236 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.548215 22601 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:12.635771 21768 catalog_manager.cc:5697] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 12, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 12 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:12.637158 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:12.638520 21947 raft_consensus.cc:1217] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.7->[9.8-14.10]   Dedup: 9.8->[11.9-14.10]
I20260709 13:08:12.639015 21947 pending_rounds.cc:85] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 8
I20260709 13:08:12.639225 21947 pending_rounds.cc:107] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:12.639430 21947 raft_consensus.cc:2889] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.640846 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:12.641485 21941 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.641590 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:12.642850 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.643173 22024 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:12.643397 22015 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.643814 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.643854 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:12.644539 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.644848 21946 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:12.645112 22024 raft_consensus.cc:2376] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17. Re-sending same reply.
I20260709 13:08:12.645259 21948 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:12.646301 21942 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:12.640976 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:12.647745 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.648415 22016 raft_consensus.cc:2368] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:08:12.648662 22018 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:12.649123 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.566021 27442 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.650733 21768 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 10, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:12.657384 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:12.659042 22015 raft_consensus.cc:2468] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:12.667874 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.650048 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.670778 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.619910 27122 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:12.671423 22018 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
W20260709 13:08:12.678759 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45617.4us
I20260709 13:08:12.687690 21768 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:12.626819 27374 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:12.680132 22024 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.629720 27505 raft_consensus.cc:2804] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.626641 27336 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.696033 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.720963 27505 raft_consensus.cc:697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:12.627107 27431 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.688947 21838 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:12.553792 27303 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.721886 27505 consensus_queue.cc:237] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.723487 27303 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.697422 22601 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:12.724776 21873 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:12.698256 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 137753us
W20260709 13:08:12.725632 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.599097 27531 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:08:12.690778 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.702838 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:12.733393 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44533.9us
I20260709 13:08:12.700533 21941 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:12.734167 21839 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:12.691362 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.674757 21987 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:12.656925 27269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.010s	sys 0.017s
I20260709 13:08:12.699393 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.702152 21916 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:12.708488 21871 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.591174 27370 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.646032 27380 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:12.733578 21944 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:12.735366 21838 leader_election.cc:400] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:12.743085 21838 leader_election.cc:403] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.742962 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.715960 27321 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:12.736239 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:12.690155 27358 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:12.677340 27375 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:12.690646 27522 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.688858 27054 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:12.732793 27470 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:12.629484 27428 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:08:12.678196 27514 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:12.678013 27429 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:12.759995 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.794927 22016 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:12.745869 27444 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:12.762347 21768 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 8 to 11, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 11 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.698742 27537 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.760128 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.729847 27350 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:12.742561 27269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.010s	sys 0.018s
I20260709 13:08:12.733035 27467 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.746743 21872 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 14. Ops: []
I20260709 13:08:12.782773 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.804280 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:12.772789 27303 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.787041 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.787930 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.727777 27544 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.794844 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.812304 21875 raft_consensus.cc:2368] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12.
I20260709 13:08:12.796077 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:12.796834 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 61561.2us
I20260709 13:08:12.702888 27411 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.797008 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.760450 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.742136 27380 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:12.751049 27431 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:12.799484 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:12.765403 27434 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.761196 27122 raft_consensus.cc:697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:12.803391 21768 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:12.842916 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:12.843742 21870 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 19: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:08:12.805429 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.799317 27444 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.836719 27380 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.854818 27434 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.855415 27434 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.784746 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:12.816938 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:12.816799 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:12.766171 27321 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.789377 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.860556 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.861271 22024 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:12.807691 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:12.861778 21866 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.861999 21870 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:12.831374 21838 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:12.863101 21768 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:12.835373 27467 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.848173 27442 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.803772 27429 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.849319 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:12.799594 27470 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.810386 27303 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.852746 27444 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.913790 21768 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 8, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 8 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:12.920509 21869 raft_consensus.cc:2410] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:12.803529 27549 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:08:12.857949 22603 raft_consensus.cc:2393] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:12.858731 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:12.841897 21841 leader_election.cc:400] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:08:12.929627 21841 leader_election.cc:403] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.807556 27054 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:12.779296 27522 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:12.829886 27544 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:12.948767 21768 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:12.851387 27543 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:12.897029 21867 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
W20260709 13:08:12.904443 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 125462us
I20260709 13:08:12.808457 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.925415 21866 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:08:12.803838 27514 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:12.891196 27410 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.956472 27410 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.956923 27410 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.957876 27514 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.837487 27258 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:08:12.948196 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 212935us
W20260709 13:08:12.955197 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 113543us
I20260709 13:08:12.916550 27303 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.965672 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.965982 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.971570 22015 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.966444 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:12.968828 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.971558 22024 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 10.
I20260709 13:08:12.973588 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.974748 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.905964 27430 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:12.982784 21768 catalog_manager.cc:5697] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 12, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 12 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:12.974385 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:12.922370 27282 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.001729 21768 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 12, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 12 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:13.005797 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:13.007799 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:12.950255 27390 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:12.975402 27548 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:08:12.965061 27472 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:12.954509 27341 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:12.964447 27428 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:12.952652 27544 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.972098 27040 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:08:13.012488 27562 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.899646 27375 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.037462 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:13.026367 21768 catalog_manager.cc:5697] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 8 to 12, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 12 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:13.210297 21768 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 12 to 13, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 13 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.080440 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:13.099969 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 60812.4us
I20260709 13:08:12.949975 27431 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.214823 27380 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:13.217726 27417 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.003s
I20260709 13:08:13.020534 22015 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:13.219161 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:13.220361 27383 raft_consensus.cc:2804] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.220531 27522 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.221097 27383 raft_consensus.cc:697] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:13.222252 27383 consensus_queue.cc:237] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.223407 27321 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:13.032272 27551 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:13.227057 27537 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:13.227677 27537 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.228873 27514 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.029969 27545 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:08:13.229441 27514 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.232249 22017 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:08:13.191699 27369 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.794s	user 0.009s	sys 0.009s
I20260709 13:08:13.233110 27369 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.234177 22607 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.235061 27410 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.235746 27369 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.237548 27429 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.238509 21871 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.238126 27428 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.239681 27358 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:13.240973 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.240839 27358 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.032898 27054 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:13.117508 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 488603us
I20260709 13:08:13.243480 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:13.139087 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:13.120142 27384 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:13.029138 27565 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:13.021580 27434 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.024703 27122 consensus_queue.cc:237] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:13.252780 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 291381us
I20260709 13:08:13.253052 22018 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:13.190552 22024 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 19: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:13.107337 27370 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:13.100332 27470 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.237643 27467 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:13.242478 27507 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.865s	user 0.010s	sys 0.000s
I20260709 13:08:13.245477 22023 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:08:13.116019 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 441316us
I20260709 13:08:13.188247 27374 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:13.120899 27515 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.253558 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:13.233891 22017 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:08:13.245230 27550 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
I20260709 13:08:13.293886 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:13.185077 27549 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.263196 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:13.306685 22606 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:13.307072 22607 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 21.
I20260709 13:08:13.307083 22606 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:13.306067 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:13.310348 22015 raft_consensus.cc:2410] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:13.313643 21946 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:13.314891 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:13.316145 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:13.319077 21941 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:13.259377 27265 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.322652 21944 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:08:13.265100 21768 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 9, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 9 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.249243 22021 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.284983 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:13.326515 21943 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:13.083081 27546 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.172s
I20260709 13:08:13.328675 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:13.303704 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:13.308219 22606 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.259064 27084 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:13.264338 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:13.305127 27282 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.322109 27428 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.330803 27515 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:13.334201 27336 consensus_meta.cc:287] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.001s
I20260709 13:08:13.252470 27565 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:13.309583 27567 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.335368 27374 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.337941 27507 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.339674 27544 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.344751 27370 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.344496 27429 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:13.345240 27265 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:13.412184 27265 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.345737 27514 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.346333 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:08:13.415373 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 69108.1us
I20260709 13:08:13.346894 27568 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.348021 27564 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.349045 27196 consensus_meta.cc:287] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.776s	user 0.005s	sys 0.005s
I20260709 13:08:13.348790 27562 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:13.349347 22021 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:13.350215 27410 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.351112 27380 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.321873 27417 consensus_queue.cc:1059] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:13.354125 27303 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.324499 27549 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.359602 22610 raft_consensus.cc:1240] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:13.360711 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 495910us
I20260709 13:08:13.310359 22023 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:13.379211 22605 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:13.324331 27262 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.381345 22606 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:08:13.382282 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 680190us
I20260709 13:08:13.385368 27084 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.393563 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:13.424137 27428 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:13.418414 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:13.412401 27556 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.376s	user 0.004s	sys 0.000s
I20260709 13:08:13.403440 27515 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:13.416450 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:08:13.463255 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44961.4us
I20260709 13:08:13.447558 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:13.448637 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:13.421684 27567 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:13.456317 21942 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:13.409240 27345 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:13.430774 27196 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.401868 27444 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.425585 27564 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.406663 27507 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.424752 27522 consensus_queue.cc:1059] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:13.418016 27370 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.468752 27567 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:13.485865 27567 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.489369 27384 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:13.489928 27384 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:13.473858 27568 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.472314 27054 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.491918 27054 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.497025 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:13.497112 27515 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.489387 22020 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:13.479203 27546 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:13.500062 27573 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:13.501996 27084 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.502821 27054 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.479831 27282 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:13.460505 27262 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.459745 27428 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:13.505913 27537 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.513520 22606 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:13.498065 22605 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:13.522734 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:13.523345 21867 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:13.488350 27547 log.cc:927] Time spent T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.636s	user 0.000s	sys 0.011s
I20260709 13:08:13.532881 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:13.534511 21839 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:13.456377 27410 consensus_queue.cc:1059] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:08:13.551050 21942 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:13.551465 27343 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:13.551915 27343 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:13.554203 27549 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.555902 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57074 (request call id 789) took 1173 ms. Trace:
I20260709 13:08:13.556479 27303 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.524588 27282 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.558048 27282 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:13.559966 27544 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.561692 27546 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.562373 27546 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:13.563469 27564 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:13.563357 27546 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.565603 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 1797) took 1632 ms. Trace:
I20260709 13:08:13.565874 27370 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:13.541501 27428 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.567507 27428 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:13.461149 27565 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.548969 27444 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.549162 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 978) took 1066 ms. Trace:
I20260709 13:08:13.575197 21872 rpcz_store.cc:276] 0709 13:08:12.483102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.483226 (+   124us) service_pool.cc:224] Handling call
0709 13:08:12.483535 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.806682 (+323147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.548892 (+742210us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400025154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:13.549100 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586669440}
I20260709 13:08:13.576538 21875 raft_consensus.cc:1240] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:13.549952 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 981) took 1041 ms. Trace:
I20260709 13:08:13.578626 21873 rpcz_store.cc:276] 0709 13:08:12.508459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.508628 (+   169us) service_pool.cc:224] Handling call
0709 13:08:12.509060 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.725180 (+216120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.549727 (+824547us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540002b554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:13.549893 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495662336}
I20260709 13:08:13.579396 22023 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:13.561821 27507 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.575657 21868 raft_consensus.cc:1240] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:13.556306 22607 rpcz_store.cc:276] 0709 13:08:12.382246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.384705 (+  2459us) service_pool.cc:224] Handling call
0709 13:08:13.555720 (+1171015us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b540062a7d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:13.555818 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951618816}
I20260709 13:08:13.591408 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:13.593308 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:13.594491 22019 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:13.546036 27262 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.601312 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:13.566071 21949 rpcz_store.cc:276] 0709 13:08:11.933299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.310317 (+377018us) service_pool.cc:224] Handling call
0709 13:08:12.329577 (+ 19260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.433263 (+103686us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:12.433605 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.626309 (+192704us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.115027 (+488718us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b1800467fe0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f635606a060 00007f635607c716 00007f635608d287 00007f635608d208
0709 13:08:13.115190 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:13.115238 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:13.115286 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.565360 (+450074us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400140ad4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:13.565412 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.565541 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55987,"prepare.queue_time_us":1160,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":1362,"raft.queue_time_us":490917,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":68869,"spinlock_wait_cycles":280076672,"thread_start_us":176614,"threads_started":1,"wal-append.queue_time_us":344418}
I20260709 13:08:13.604518 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:13.630071 22020 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:13.604833 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:13.611011 22603 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:13.613747 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:13.614059 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:13.614404 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:13.642542 21870 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:13.614868 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:13.643765 21873 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.616933 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:13.646081 21943 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:13.617648 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:13.617882 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:13.648020 22607 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.620101 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:13.650115 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:13.615219 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:13.652379 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:13.653239 21869 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:13.614027 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:13.614002 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:13.655589 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:13.615509 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:13.658803 21875 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 10: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:13.660068 21988 leader_election.cc:400] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12.
I20260709 13:08:13.660425 21988 leader_election.cc:403] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.606437 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:13.661294 22018 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:13.661660 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:13.663975 21870 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:13.666115 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50687.2us
I20260709 13:08:13.666843 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:13.669027 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 252745us
I20260709 13:08:13.670101 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:13.610206 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:13.674805 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64715.7us
I20260709 13:08:13.683866 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:13.658617 27369 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:08:13.692698 27575 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.213s	user 0.000s	sys 0.011s
W20260709 13:08:13.658442 27570 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.132s	user 0.007s	sys 0.004s
I20260709 13:08:13.695518 21875 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:13.696420 27542 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:13.696686 27553 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.844s	user 0.004s	sys 0.004s
I20260709 13:08:13.696798 27564 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.697793 27583 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.698119 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2914) took 1141 ms. Trace:
I20260709 13:08:13.698359 27583 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.698643 21874 rpcz_store.cc:276] 0709 13:08:12.557013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.557113 (+   100us) service_pool.cc:224] Handling call
0709 13:08:12.557426 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.557764 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.557789 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.558204 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.776394 (+218190us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:12.776437 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.776517 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.582328 (+805811us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:13.697786 (+115458us) raft_consensus.cc:1685] finished
0709 13:08:13.697813 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.698050 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":969,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2281,"spinlock_wait_cycles":24309504,"thread_start_us":217838,"threads_started":1,"wal-append.queue_time_us":294462}
I20260709 13:08:13.702368 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:13.712466 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:13.721524 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47804.8us
W20260709 13:08:13.730878 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64116.9us
I20260709 13:08:13.596542 27532 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:13.605700 27442 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:13.760648 21873 raft_consensus.cc:2468] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
W20260709 13:08:13.744135 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 84190.5us
I20260709 13:08:13.700882 27427 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:13.752072 27567 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:13.710896 27571 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.147s	user 0.003s	sys 0.001s
I20260709 13:08:13.605294 27122 raft_consensus.cc:3055] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:13.737548 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:13.722965 27431 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:13.711076 27470 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:13.710858 27370 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.768276 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:13.768401 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 96071.6us
I20260709 13:08:13.751705 22607 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:13.723176 27531 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12.
W20260709 13:08:13.774703 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 104706us
I20260709 13:08:13.711226 27281 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:08:13.803385 21988 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:13.781071 27567 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.755944 27258 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.754345 27474 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.760852 27532 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.755457 27544 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:13.793548 21839 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:13.758724 27442 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:13.791862 21916 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:13.763794 27569 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:13.728991 27542 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:08:13.777329 27122 raft_consensus.cc:740] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:13.798774 27431 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.798170 27345 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.802932 27470 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.817083 27532 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:13.772076 27369 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:08:13.836007 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44187.4us
I20260709 13:08:13.817049 27196 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:13.824458 27303 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:13.824731 27514 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:13.827152 27336 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:13.842664 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 112792us
I20260709 13:08:13.822551 27569 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:13.778365 27427 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.836326 27431 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:13.735914 27343 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.840301 27380 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.837144 27470 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:13.820930 27258 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.822232 27544 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.862165 27569 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:13.863055 27303 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:13.856451 27271 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:08:13.872162 27350 consensus_queue.cc:1175] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" responder_term: 16 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: [15.9-15.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:13.861853 27336 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.897601 27303 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.900296 27258 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:13.873171 27122 consensus_queue.cc:260] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.914600 27544 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.926095 27427 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:13.856993 27442 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:13.932119 27281 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:13.885409 27542 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:13.923770 27384 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:13.955997 22602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57070 (request call id 1095) took 1342 ms. Trace:
I20260709 13:08:13.993793 22602 rpcz_store.cc:276] 0709 13:08:12.613136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.616198 (+  3062us) service_pool.cc:224] Handling call
0709 13:08:13.955673 (+1339475us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54004fc9d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:13.955891 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720292608}
I20260709 13:08:14.015297 27336 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.019637 27470 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.021011 27384 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.022660 27470 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.019637 27532 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.025592 27532 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.026320 27431 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:14.039547 27590 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:14.034055 27442 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.949934 27542 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.059881 27537 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:14.072811 27593 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
W20260709 13:08:14.117789 21871 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.010s	sys 0.020s
W20260709 13:08:14.118813 21871 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.011s	sys 0.021s
W20260709 13:08:14.119882 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.127807 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.144661 21868 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:14.147178 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.148659 22601 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:14.151752 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.153273 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.152385 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.151387 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.167943 27040 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:14.168663 22016 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:14.186182 27336 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:14.007803 27122 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:14.171820 27282 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.002s
I20260709 13:08:14.197098 27282 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.201263 27336 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.205108 27336 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.185840 27306 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:14.208904 27306 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.212249 27306 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.213141 27306 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.214502 27306 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.181082 27196 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:14.217985 27196 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.221616 27196 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.207702 27282 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.169009 27040 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.227533 27040 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.230772 27306 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.237344 27431 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.271569 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.272562 22603 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:14.274471 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.275719 22606 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:14.251603 27542 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.252475 22605 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:14.299620 27596 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.300767 27535 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:08:14.300698 27596 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.301190 27591 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.304792 27591 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.305346 27003 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.306041 27003 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:14.308351 27595 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.309021 27596 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.307476 27591 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.309198 27595 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.312271 27595 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.323083 22610 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:14.325528 27552 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 1.474s	user 0.007s	sys 0.000s
I20260709 13:08:14.328017 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3214) took 1848 ms. Trace:
I20260709 13:08:14.328490 22022 rpcz_store.cc:276] 0709 13:08:12.479217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.479367 (+   150us) service_pool.cc:224] Handling call
0709 13:08:12.494775 (+ 15408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.529304 (+ 34529us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:12.529354 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.542090 (+ 12736us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.688191 (+146101us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:12.688231 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.688299 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.069855 (+1381556us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:14.327300 (+257445us) raft_consensus.cc:1685] finished
0709 13:08:14.327348 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.327759 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34053,"raft.queue_time_us":46720,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":27666176,"thread_start_us":145766,"threads_started":1,"wal-append.queue_time_us":258782}
W20260709 13:08:14.337603 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.003s	sys 0.000s
W20260709 13:08:14.338294 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 525936us
W20260709 13:08:14.287009 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 442011us
W20260709 13:08:14.349099 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 492398us
W20260709 13:08:14.356196 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57477.9us
I20260709 13:08:14.363051 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 730) took 1397 ms. Trace:
I20260709 13:08:14.363665 22021 rpcz_store.cc:276] 0709 13:08:12.965881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.026127 (+ 60246us) service_pool.cc:224] Handling call
0709 13:08:14.362566 (+1336439us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b540017b1d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:14.362779 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81564544}
I20260709 13:08:14.365542 27084 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:14.366235 27084 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:14.368489 21871 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:14.369143 21942 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.370306 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:14.371197 21947 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:14.371380 21871 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:14.373433 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60038 (request call id 731) took 1407 ms. Trace:
I20260709 13:08:14.373978 22015 rpcz_store.cc:276] 0709 13:08:12.966141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.218824 (+252683us) service_pool.cc:224] Handling call
0709 13:08:14.372926 (+1154102us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b540017c0d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:14.373220 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207476096}
I20260709 13:08:14.379722 27583 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.380827 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:14.381494 21868 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.381639 22606 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.367550 27084 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:14.387636 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48265us
I20260709 13:08:14.392022 27472 raft_consensus.cc:3055] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.392500 27472 raft_consensus.cc:740] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:14.393808 27472 consensus_queue.cc:260] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.395009 27472 raft_consensus.cc:3060] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:14.388435 21914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.012s
W20260709 13:08:14.399853 21914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.009s	sys 0.012s
I20260709 13:08:14.391347 27084 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.411641 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:14.408897 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 588120us
I20260709 13:08:14.422331 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:14.423300 27369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.022s
W20260709 13:08:14.435647 27369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.010s	sys 0.023s
I20260709 13:08:14.415573 27003 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.443228 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.442061 27431 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.447649 21949 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:14.441686 27605 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.448976 21942 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:14.448681 27605 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.451740 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:14.454269 27366 consensus_queue.cc:1175] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95296a4420ed41b69191d3d4353cf2b0" responder_term: 14 status { last_received { term: 13 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:14.455509 27607 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:14.455080 27564 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.456574 27564 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.459591 27003 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.461146 27444 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:14.461700 27444 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.462170 27444 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.463269 22021 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:14.463464 27564 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.464358 27605 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.461699 27343 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.462141 21914 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:14.467240 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:14.467567 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:14.468120 27375 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.474578 27565 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.476999 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:14.478016 22016 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 20: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:08:14.478431 27604 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
W20260709 13:08:14.480716 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 66752.5us
I20260709 13:08:14.467289 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:14.489872 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.490466 27258 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:14.497004 27429 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.497753 27429 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.500079 27429 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.501161 27582 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:08:14.524857 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 118790us
W20260709 13:08:14.525403 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 62814.4us
I20260709 13:08:14.538921 21947 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:14.534030 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:14.512482 27608 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.115s
W20260709 13:08:14.549305 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 82107.6us
I20260709 13:08:14.549829 21950 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:14.550176 22016 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:14.550480 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:14.552785 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:14.553267 27507 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.554250 27374 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.559481 27303 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.560040 27303 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.562328 27303 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.568390 27507 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.569499 27507 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.570315 27383 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:14.570968 27383 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.571934 27507 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.568801 27363 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:14.573323 27363 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.575585 27363 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.570334 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:14.576442 21988 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:14.579589 27569 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.007s
I20260709 13:08:14.585170 27562 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.585988 27562 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:14.586410 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.587143 27562 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.533615 27582 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:14.595564 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:14.597869 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.598515 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.600082 27303 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.603760 21942 raft_consensus.cc:1275] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:14.615736 21914 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:14.618855 22606 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:14.580113 27569 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.531324 27444 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.623929 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:14.629657 21949 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.648473 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.662325 21950 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 19. Current term is 20. Ops: [17.15-19.16]
I20260709 13:08:14.637135 27608 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:14.663544 27569 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.624058 27303 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.663784 27608 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.665663 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:14.666117 27303 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.638792 27564 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.650285 27374 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:14.666999 27564 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.667738 27374 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:14.625530 27429 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.669005 27429 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:14.671654 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 44830.8us
I20260709 13:08:14.672638 21868 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:14.669234 27564 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.673913 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:14.676698 27429 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.684206 27383 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.684587 21872 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:14.685359 22022 raft_consensus.cc:1240] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:14.685685 27595 consensus_queue.cc:1059] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:14.686751 27595 raft_consensus.cc:3055] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:14.687171 27595 raft_consensus.cc:740] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:14.666145 27608 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:14.692061 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.688943 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:14.674593 27431 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.689570 22016 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:14.696651 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 144020us
I20260709 13:08:14.684300 22015 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:14.701198 21949 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:14.704959 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.718474 27582 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.721628 27564 raft_consensus.cc:2764] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:14.725052 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:14.725488 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.725940 21950 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:14.726300 27444 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.736299 27434 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:14.737308 21943 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:14.737983 27434 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:14.743395 27429 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:14.745455 27122 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:14.739388 27434 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:14.747805 27434 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.749500 27434 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.753839 27122 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.713726 27431 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.756086 27122 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.756901 27122 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:14.758564 27122 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.760777 27122 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.762236 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:14.763087 22605 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.766388 27608 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.767021 27608 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.757026 22021 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.706838 27374 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.756901 27431 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.754225 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:14.720487 27582 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:14.785367 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.794659 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.688566 27595 consensus_queue.cc:260] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.800853 21987 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:14.801393 27595 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.805539 27431 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.808224 27431 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:14.808573 27608 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.808712 27431 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:14.801901 27564 consensus_queue.cc:1175] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61893f17f34b4cc9b898114d3c0a7023" responder_term: 14 status { last_received { term: 14 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 14 index: 10 } }
I20260709 13:08:14.805702 27562 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.811141 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.811178 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:14.818533 22021 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
W20260709 13:08:14.830613 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76476.6us
I20260709 13:08:14.830678 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.842249 27429 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:14.841354 27336 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.843340 27429 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 20 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:14.843397 27336 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.846693 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.850271 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:14.851226 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.852126 21950 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:14.855212 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.856899 27281 consensus_queue.cc:1048] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:14.857635 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:14.857519 27366 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:14.858501 27366 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:14.858868 27366 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:14.860206 27366 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.861508 27366 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:14.858814 27597 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.862936 27597 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.865000 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.858814 21988 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:14.834615 27572 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.867439 21943 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 18: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:14.852768 27599 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.869396 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:14.872713 27569 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:14.872741 27562 raft_consensus.cc:2804] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:14.875074 27122 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:14.875458 27562 raft_consensus.cc:697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:14.875674 27537 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:14.876080 27537 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.876436 27537 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.876523 27562 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:14.870260 22576 leader_election.cc:336] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.512s (SENT)
I20260709 13:08:14.879470 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:14.880287 27608 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.868515 27003 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:14.881191 27003 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.875697 27122 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:14.882333 27572 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.882846 27122 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.884639 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:14.885320 27572 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.885571 27306 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:14.886579 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:14.888651 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:14.866752 27429 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.881650 27003 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.897426 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.902951 22605 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:14.906925 22603 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:14.907943 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.910409 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.911203 22603 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 18: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:14.901523 27306 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.912850 27306 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.913211 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.917060 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.917187 27431 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.917888 22610 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:14.920301 27599 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.923133 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:14.925019 27599 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.925618 27431 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.920356 21950 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:14.928808 27003 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.930593 27597 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:14.931545 21943 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:14.935606 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:14.936530 21987 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:14.936872 27597 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:14.937453 27597 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:14.937513 27431 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.938359 27431 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:14.938616 27597 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:14.934355 27306 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.953588 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:14.954541 22610 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
I20260709 13:08:14.948729 27599 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.956194 27599 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.957899 27336 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.959327 27599 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:14.939402 27431 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.967501 21943 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:14.968035 21950 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:08:14.936894 27003 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:14.968021 27434 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:14.978282 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:14.984654 21868 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:14.987617 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.973986 27383 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:14.993364 27383 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:14.993755 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:14.974258 27564 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.997706 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:14.998833 21868 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:14.974888 27428 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:08:14.989585 27434 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.008333 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.010454 21868 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:08:15.004424 27429 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.017537 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:15.022069 21868 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:15.026199 27537 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.029311 27537 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:15.056735 27383 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:15.059706 21875 raft_consensus.cc:1240] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:15.029538 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 52000.1us
W20260709 13:08:15.030272 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 77857.7us
I20260709 13:08:15.009197 27564 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:15.032187 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 58161.5us
I20260709 13:08:15.032756 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.032953 27336 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:15.035442 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.036302 27434 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.038434 27306 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:15.039633 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.066505 21946 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.044571 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.053216 22608 raft_consensus.cc:2410] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:08:15.054060 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.062623 21947 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.113726 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:15.068150 27565 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.119961 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.069674 27383 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:08:15.127144 21868 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:15.117811 27349 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.142657 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.122308 27565 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.158300 21868 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:15.139880 27306 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:15.159842 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 88950.2us
I20260709 13:08:15.159701 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.147446 27349 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.173661 21945 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:15.174180 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:15.185734 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 79199.2us
I20260709 13:08:15.187430 21946 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:15.190982 21870 raft_consensus.cc:2368] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18.
I20260709 13:08:15.189416 21942 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:15.166298 27306 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:15.196967 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 85384.1us
I20260709 13:08:15.172542 27349 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:15.201105 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:15.149590 27599 consensus_queue.cc:1059] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:15.209820 21947 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:15.210063 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:15.202145 27306 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.211812 27597 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.219034 27599 raft_consensus.cc:3055] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:15.219468 21870 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:08:15.219621 27599 raft_consensus.cc:740] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:15.219946 27565 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:15.220782 27599 consensus_queue.cc:260] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.222167 27599 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.231865 27122 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.238039 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.238746 21941 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.244552 21873 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:15.244861 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:15.248281 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:15.249814 27434 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.250118 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:15.250515 27537 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:15.250931 27537 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:15.251307 27537 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.251700 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:15.252781 27429 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.253509 27429 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:15.253856 27429 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.254222 27429 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:15.254699 21867 raft_consensus.cc:1275] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:15.269551 27564 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:15.219964 21870 pending_rounds.cc:85] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 8
I20260709 13:08:15.270531 21870 pending_rounds.cc:107] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:08:15.270838 21870 raft_consensus.cc:2889] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:15.271358 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 610586us
I20260709 13:08:15.276700 27258 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.277377 27258 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.277817 27444 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:15.278352 27444 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:15.278347 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.279254 27444 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:15.284886 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.551s (SENT) [suppressed 17 similar messages]
I20260709 13:08:15.291678 22606 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:15.293488 22603 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:15.293527 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:15.299278 22607 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.297968 22574 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:15.307864 21872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2921) took 1679 ms (client timeout 1595 ms). Trace:
W20260709 13:08:15.310037 21872 rpcz_store.cc:269] 0709 13:08:13.613622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.613730 (+   108us) service_pool.cc:224] Handling call
0709 13:08:15.292262 (+1678532us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b540044f054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:15.292539 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290619520}
W20260709 13:08:15.346112 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 144075us
I20260709 13:08:15.310669 27343 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:15.381366 27643 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.382014 27643 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.385450 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.386173 21870 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:15.390450 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:15.400285 27643 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:15.407737 27644 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:15.425974 27343 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:15.436914 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.437606 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.438133 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.439880 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.439917 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.440737 21870 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:15.440846 21871 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:15.442725 21871 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:15.444485 21871 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:15.446372 21871 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:15.450634 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.451404 21867 raft_consensus.cc:2368] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18.
I20260709 13:08:15.452247 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.453583 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.453732 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.453936 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:15.454538 21871 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.455021 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.455629 21869 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:15.454553 21870 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:15.457042 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.458679 27645 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.459232 27645 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.461452 27645 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.447216 27343 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.461553 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.462843 21867 raft_consensus.cc:2410] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:08:15.464869 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 67441.9us
I20260709 13:08:15.473049 21871 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:15.488152 22607 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:15.496068 27429 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.500224 27429 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.307977 27003 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.515159 27003 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.515605 27003 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.543210 27003 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.545877 27003 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:15.553450 27306 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.556432 27306 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.558441 21941 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:15.583647 27258 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:15.584826 27537 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.586931 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:15.587530 27537 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.587761 22610 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
W20260709 13:08:15.599494 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.611943 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.626220 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 426134us
I20260709 13:08:15.627415 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:15.628578 27639 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:15.633141 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:15.633991 27639 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:15.634366 27639 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:15.634730 27639 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.643952 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.645368 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.645995 21941 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:08:15.647226 21944 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:15.649590 21944 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.650971 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.652701 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.653234 21944 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.660672 21944 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:15.642671 27639 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.664945 27639 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.665833 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.666615 21947 raft_consensus.cc:2393] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 10: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:15.668074 21947 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:15.669529 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.670145 21947 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.673730 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.674444 21949 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.677917 27429 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.678539 27429 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.679425 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.680188 21944 raft_consensus.cc:2368] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18.
I20260709 13:08:15.680694 27429 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.681545 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.681820 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.682349 21947 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:15.682492 22016 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:15.683357 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.683866 22021 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:15.683403 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.685065 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:15.685117 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 433464us
I20260709 13:08:15.686489 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.686616 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.687230 21945 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:15.687402 22021 raft_consensus.cc:2368] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18.
I20260709 13:08:15.686489 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.688557 22019 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:15.689764 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.690371 22022 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:15.690390 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.691978 27306 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.692276 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.692955 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.692776 27306 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.693755 22024 raft_consensus.cc:2410] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:15.694859 27306 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:15.695386 22024 raft_consensus.cc:1240] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 17. Ops: [15.9-15.9]
I20260709 13:08:15.698451 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.698642 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.705379 27434 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:15.708890 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.699055 27537 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.711270 27537 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:15.715046 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 485838us
I20260709 13:08:15.705365 22024 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:15.716648 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.717502 21942 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.699407 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.683713 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.699929 27431 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.700579 27644 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.699362 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.722395 27282 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.723865 27282 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.701467 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.701875 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.702071 27564 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:15.703162 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:15.703356 22020 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:08:15.703675 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.691936 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.764971 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.845645 22023 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:15.814716 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.752442 21872 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:15.720022 21949 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:15.752946 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.751267 22015 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:15.848325 21941 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:08:15.844002 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.753324 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.745431 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.850795 22016 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:15.725214 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:15.850956 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 147872us
I20260709 13:08:15.851872 21946 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:15.854725 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:15.856999 22022 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:15.857201 22019 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.857214 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.859421 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.861111 21949 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:08:15.856492 22576 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.951s (SENT)
I20260709 13:08:15.862918 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:15.863667 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.864194 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.865193 21941 raft_consensus.cc:2376] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14. Re-sending same reply.
I20260709 13:08:15.866482 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.858253 21873 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:15.863705 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.864676 21866 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:15.879172 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:15.880638 21869 raft_consensus.cc:2410] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:08:15.880553 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.881443 22016 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.881443 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.881996 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.882365 21950 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.883338 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:15.884202 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:15.880511 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:15.929821 21875 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:15.889211 22018 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:15.727442 27431 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.891999 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.892958 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.930802 22020 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.893725 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.896195 27564 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:15.846405 27282 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:15.898985 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.727569 27644 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.900066 27306 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:15.901340 21942 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:15.905043 21950 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:15.935288 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.935973 22021 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:15.932930 21941 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:15.881665 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:15.935300 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.942376 21950 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:15.945209 22023 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:15.948124 22019 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:15.950857 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.961014 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:15.957832 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.961683 22021 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.963223 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.964983 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.966542 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:15.967964 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.968324 27605 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.968964 27605 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:15.969889 27431 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:15.970134 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:15.947815 27306 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:15.971496 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:15.972185 22607 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:15.971952 27306 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:15.973546 22606 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:15.971608 27608 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:15.974761 22605 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:08:15.976003 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 102134us
I20260709 13:08:15.974849 22574 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:15.978165 21948 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:08:15.974826 27281 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.981628 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.962092 22024 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:15.985517 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:15.986238 22601 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
W20260709 13:08:15.992569 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.946220 27564 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:15.993512 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:15.994022 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 137994us
I20260709 13:08:15.994047 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:15.989007 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:15.995414 21875 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.995456 22016 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:15.996863 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:15.997816 22022 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:15.998122 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.001385 22022 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:15.975440 27537 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:16.003436 22024 raft_consensus.cc:1240] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:16.007103 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.007958 22023 raft_consensus.cc:2376] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14. Re-sending same reply.
I20260709 13:08:15.999604 27582 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:16.014019 22020 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
W20260709 13:08:16.014703 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.034955 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.038136 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.039095 22020 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:16.042694 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:16.043449 21950 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:08:16.044003 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:16.035722 22024 raft_consensus.cc:2376] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18. Re-sending same reply.
I20260709 13:08:16.046123 22021 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:16.050804 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.051713 22021 raft_consensus.cc:2368] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18.
I20260709 13:08:15.992704 27608 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.067682 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.069033 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.071653 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.072989 22016 raft_consensus.cc:2410] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:16.074642 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.072466 22022 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:16.032977 27582 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.049114 27605 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.097824 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:16.101686 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.102610 22023 raft_consensus.cc:2368] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18.
I20260709 13:08:16.102487 27564 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:16.107724 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.093863 27582 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.115396 22024 raft_consensus.cc:2368] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 20. Current term is 22.
I20260709 13:08:16.115691 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.117520 22021 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:16.125749 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.126598 22023 raft_consensus.cc:2376] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12. Re-sending same reply.
I20260709 13:08:16.130533 22606 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:16.158475 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:16.139793 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.141829 27608 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.143679 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.143978 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.145054 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:16.145701 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 299916us
I20260709 13:08:16.149083 27644 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.152055 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:16.135241 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.155895 21875 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:16.160585 22021 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 12.
I20260709 13:08:16.172056 21874 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:16.176119 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:16.176883 22610 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:16.182883 22023 raft_consensus.cc:2393] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 19: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:16.185379 21868 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:08:16.185917 21868 pending_rounds.cc:85] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 4
I20260709 13:08:16.186197 21868 pending_rounds.cc:107] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:08:16.186478 21868 raft_consensus.cc:2889] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:16.186668 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.192759 21875 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
W20260709 13:08:16.196920 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 119588us
I20260709 13:08:16.200042 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:16.200994 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:16.201561 22017 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:16.193444 21875 pending_rounds.cc:85] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 7
I20260709 13:08:16.230019 21875 pending_rounds.cc:107] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:16.230438 21875 raft_consensus.cc:2889] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.240835 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:16.240886 22576 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.990s (SENT)
W20260709 13:08:16.244920 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 86502.4us
I20260709 13:08:16.248039 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:16.249001 22605 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:16.294180 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.295167 22023 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.299332 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.301105 22017 raft_consensus.cc:2393] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 18: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:16.305502 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.307204 22021 raft_consensus.cc:2368] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 20. Current term is 22.
I20260709 13:08:16.171363 27639 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:08:16.298277 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:16.337256 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.304634 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:16.346427 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:16.347553 21872 raft_consensus.cc:2393] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:16.341421 22017 raft_consensus.cc:2376] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16. Re-sending same reply.
I20260709 13:08:16.348400 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:16.303524 27434 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.355600 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:16.379226 21916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.168s	user 0.006s	sys 0.001s
I20260709 13:08:16.379607 22602 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:16.379635 21916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.006s	sys 0.001s
I20260709 13:08:16.354384 21943 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.355425 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.309787 27306 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.388422 22021 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 15: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:16.416136 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:16.418764 22021 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:16.425081 21872 raft_consensus.cc:2410] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:16.424853 22021 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 20 LEADER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 19. Current term is 20. Ops: [17.15-19.16]
W20260709 13:08:16.424117 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 119687us
I20260709 13:08:16.428207 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:16.394691 27656 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
W20260709 13:08:16.427989 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 246829us
I20260709 13:08:16.430604 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:16.430915 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:16.371698 27661 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:16.431288 21874 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:16.414394 27640 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:16.439846 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:16.440528 21872 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.443343 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:16.443547 27657 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:08:16.443630 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:16.437829 27661 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:16.446657 27661 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.448010 27537 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:16.448457 27537 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:16.448848 27537 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.448923 27429 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:16.449607 27429 consensus_queue.cc:1243] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:16.451049 27429 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:16.452162 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08003097e0 after lost signal to thread 20759
I20260709 13:08:16.421607 27306 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:16.453298 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08000db280 after lost signal to thread 21807
I20260709 13:08:16.413964 27434 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.454659 27306 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:16.437551 27651 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:16.455701 27434 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:16.455598 27651 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.445791 27659 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:16.461865 27659 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.464116 27659 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.439118 27640 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:16.465345 27640 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.466583 21867 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:16.474200 27672 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.424015 27431 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:16.475179 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:16.483747 21943 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:16.485358 22017 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:16.439540 27605 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:16.474840 27672 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:16.505759 27651 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.508888 22602 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
W20260709 13:08:16.510284 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08002be9a0 after lost signal to thread 21899
W20260709 13:08:16.510653 21896 debug-util.cc:398] Leaking SignalData structure 0x7b080031e4a0 after lost signal to thread 21900
W20260709 13:08:16.511721 21896 debug-util.cc:398] Leaking SignalData structure 0x7b0800309200 after lost signal to thread 21974
W20260709 13:08:16.512001 21896 debug-util.cc:398] Leaking SignalData structure 0x7b0800309220 after lost signal to thread 21975
I20260709 13:08:16.517663 22017 raft_consensus.cc:1240] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:16.524657 27661 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:16.544286 27467 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.545001 27467 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.545343 27582 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.547909 27467 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:16.548388 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:16.548967 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.549141 21875 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.552006 22015 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:16.479162 27668 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:08:16.554368 21874 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.484710 27431 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:16.554404 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.557686 21948 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:16.518996 27605 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:16.560647 27668 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:16.566174 22015 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:16.567524 21875 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:16.567902 22015 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:16.514254 27639 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:16.561540 27668 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.583400 21949 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:16.604382 27582 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:16.604650 22608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 853) took 1716 ms (client timeout 2067 ms). Trace:
W20260709 13:08:16.605147 22608 rpcz_store.cc:269] 0709 13:08:14.888160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.888320 (+   160us) service_pool.cc:224] Handling call
0709 13:08:16.604397 (+1716077us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54006504d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:16.604549 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345418624}
W20260709 13:08:16.615077 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 173483us
W20260709 13:08:16.612372 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.619774 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 174451us
W20260709 13:08:16.620836 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.621323 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.623011 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:16.631242 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 195372us
I20260709 13:08:16.628819 21987 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:16.633628 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:16.634370 21942 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:16.640167 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:16.617410 27582 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.637180 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:16.665395 22576 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.977s (SENT)
I20260709 13:08:16.670709 21988 leader_election.cc:400] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18.
I20260709 13:08:16.670536 21870 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:08:16.676405 21988 leader_election.cc:403] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.625380 27467 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:16.687517 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 71711us
I20260709 13:08:16.690936 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:16.666312 27306 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:16.629048 27564 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:08:16.688400 27632 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 1.289s	user 0.000s	sys 0.007s
I20260709 13:08:16.370060 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:16.729594 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100074us
I20260709 13:08:16.730926 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:16.703821 27306 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:16.744688 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 79398.4us
I20260709 13:08:16.733927 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:16.755388 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 123191us
W20260709 13:08:16.753641 22610 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.566s	user 0.020s	sys 0.000s
I20260709 13:08:16.760766 22610 raft_consensus.cc:2468] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 22.
I20260709 13:08:16.674921 27582 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.726925 27661 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.756193 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:16.762142 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:16.745550 27306 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.767283 21872 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:16.712321 27467 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:16.777834 22576 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.091s (SENT)
I20260709 13:08:16.781790 22576 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:16.726724 27428 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:08:16.762874 27670 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18.
I20260709 13:08:16.784456 22023 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:16.729890 27434 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:08:16.789882 27669 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:16.790755 27669 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.806167 27669 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:16.807058 27669 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.807767 27669 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:16.809814 27666 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.336s	user 0.001s	sys 0.001s
I20260709 13:08:16.810634 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:16.797307 27507 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.797385 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:16.799006 21870 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:16.816162 22574 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:16.800405 21875 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:16.801929 21867 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:16.799116 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:16.803738 21872 pending_rounds.cc:85] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 8
I20260709 13:08:16.817620 22574 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:16.817857 21872 pending_rounds.cc:107] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:08:16.818128 21872 raft_consensus.cc:2889] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.811291 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:16.812055 27669 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.768378 27672 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:16.813303 21896 debug-util.cc:398] Leaking SignalData structure 0x7b080039d820 after lost signal to thread 22048
I20260709 13:08:16.813270 22610 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
W20260709 13:08:16.786285 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 116143us
I20260709 13:08:16.699435 27605 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.796312 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.825804 21866 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
W20260709 13:08:16.823918 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08002d74c0 after lost signal to thread 22049
I20260709 13:08:16.825886 22018 raft_consensus.cc:2368] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 16. Current term is 17.
W20260709 13:08:16.830489 21896 debug-util.cc:398] Leaking SignalData structure 0x7b0800383c80 after lost signal to thread 22634
W20260709 13:08:16.830806 21896 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa1e0 after lost signal to thread 22635
I20260709 13:08:16.763048 27682 consensus_queue.cc:1059] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:08:16.838438 21873 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
W20260709 13:08:16.850845 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 213730us
I20260709 13:08:16.815569 27679 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.820550 27431 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:16.823467 27659 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:16.823796 27651 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.840389 27595 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:16.787063 27537 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:16.856055 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:16.851691 21841 leader_election.cc:336] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.533s (SENT)
I20260709 13:08:16.853241 27681 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:16.846401 27429 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:16.857666 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 83431.2us
I20260709 13:08:16.877883 22603 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:16.852227 27700 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.853823 27122 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.870841 27659 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:16.885349 27608 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.885946 27608 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.886006 27659 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.837491 27640 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:16.856304 27668 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:16.891625 22576 leader_election.cc:336] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.197s (SENT)
I20260709 13:08:16.892925 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:16.880355 27678 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:08:16.904256 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:16.905380 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:16.906189 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 150073us
I20260709 13:08:16.904350 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.880313 27651 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:16.910251 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:16.913393 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.914847 21948 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.915223 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.916771 22015 raft_consensus.cc:2368] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18.
I20260709 13:08:16.907603 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:16.919054 21988 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:16.918964 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:16.923700 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 71942.3us
I20260709 13:08:16.924258 22017 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:16.926286 27706 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:16.895138 27681 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:16.934118 21916 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:16.930925 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.932086 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.912312 21874 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:16.937994 22023 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:08:16.939014 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 78341.9us
I20260709 13:08:16.940579 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:16.912744 27692 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.918192 27679 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.922748 27122 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.942894 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:16.945418 21988 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:16.949536 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:16.880214 27696 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:08:16.933934 27595 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:16.948961 22015 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
W20260709 13:08:16.955286 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 65718.4us
I20260709 13:08:16.928431 27608 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.889278 27700 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:16.953715 21914 leader_election.cc:400] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18.
I20260709 13:08:16.953852 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:16.958758 21914 leader_election.cc:403] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.956772 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:16.959897 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:16.941138 27693 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:16.964020 27651 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.964908 27662 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:16.965472 27686 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:08:16.962630 27671 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.404s	user 0.004s	sys 0.000s
W20260709 13:08:16.966856 27676 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 13:08:16.942822 27668 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:16.968235 27685 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:08:16.968729 27595 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:16.948372 27431 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:16.969439 27690 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:08:16.964920 27467 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:16.969897 27595 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.970652 27467 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:08:16.971009 27675 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.496s	user 0.002s	sys 0.001s
I20260709 13:08:16.971062 27467 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:16.965040 27688 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:08:16.974942 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3251) took 1085 ms. Trace:
I20260709 13:08:16.975664 21944 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:16.976706 27694 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:16.977180 27694 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.977556 27694 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.978103 21869 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:16.978616 21869 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:16.979514 21869 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:16.980928 27698 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:16.981442 27698 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.981796 27698 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:16.985004 27689 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:08:16.955011 27434 raft_consensus.cc:2804] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:08:16.989522 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 1.26589e+06us
I20260709 13:08:16.989874 27681 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:16.969370 27431 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.993582 27431 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.969064 27582 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:16.957984 27003 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.962325 27693 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:16.997753 27687 log.cc:927] Time spent T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:08:16.997498 27003 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.002000 21869 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.975395 22019 rpcz_store.cc:276] 0709 13:08:15.889724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.005714 (+115990us) service_pool.cc:224] Handling call
0709 13:08:16.011393 (+  5679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.041095 (+ 29702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.041143 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.077300 (+ 36157us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.424830 (+347530us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:16.424870 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.424934 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.970363 (+545429us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:16.972663 (+  2300us) raft_consensus.cc:1685] finished
0709 13:08:16.972686 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.974855 (+  2169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22915,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":23663,"spinlock_wait_cycles":6790528,"thread_start_us":306059,"threads_started":1,"wal-append.queue_time_us":368023}
W20260709 13:08:17.004021 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 46428.8us
W20260709 13:08:17.005528 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 45700.2us
I20260709 13:08:16.939443 27682 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:16.958076 27661 consensus_queue.cc:1059] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
W20260709 13:08:17.007750 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 48031.5us
I20260709 13:08:17.034924 22576 leader_election.cc:400] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 20. Current term is 22.
I20260709 13:08:17.035684 22576 leader_election.cc:403] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.034405 27434 raft_consensus.cc:697] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:17.038376 27434 consensus_queue.cc:237] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.038925 27700 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:17.040261 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 227775us
I20260709 13:08:16.972132 27467 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:16.997517 27693 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:17.042222 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:17.016032 27582 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:17.023313 27670 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.043426 27685 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.045620 21949 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:17.046600 27537 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.044040 27651 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 20. Current term is 22.
I20260709 13:08:17.053314 21943 raft_consensus.cc:3055] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:17.091672 21943 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:17.045162 27672 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18.
W20260709 13:08:17.054956 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.057247 27661 raft_consensus.cc:3055] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:08:17.057729 27680 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
W20260709 13:08:17.084992 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 52421.4us
I20260709 13:08:17.043028 21841 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:17.089424 21944 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:08:17.090423 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 44379.4us
W20260709 13:08:17.113914 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70972.4us
W20260709 13:08:17.114575 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 105784us
I20260709 13:08:17.116176 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.059094 27700 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.059666 27003 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:17.092782 21943 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.122815 27702 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.123427 27702 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.123708 21943 raft_consensus.cc:3060] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.125795 27702 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:17.126408 27702 raft_consensus.cc:2764] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:17.127084 27702 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:17.109087 27640 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:17.129220 27709 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:08:17.129347 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.129675 27709 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:17.106155 21838 connection.cc:256] RPC call timeout handler was delayed by -1.2181608849999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:08:17.130563 27709 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:17.130927 21838 connection.cc:256] RPC call timeout handler was delayed by -1.0039608849999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:08:17.131659 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.132643 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:17.135488 27694 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.084714 27507 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.118968 27672 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:17.089171 27692 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:08:17.121852 27700 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.104311 27467 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.114573 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:17.144210 21943 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:17.103470 27661 raft_consensus.cc:740] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:17.163759 21869 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:08:17.164819 21869 pending_rounds.cc:85] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 9
W20260709 13:08:17.168316 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 214535us
W20260709 13:08:17.171450 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 56819.4us
I20260709 13:08:17.176761 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:17.177021 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.172554 21869 pending_rounds.cc:107] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:08:17.173511 27716 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.178169 21869 raft_consensus.cc:2889] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.092648 27685 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.154688 27003 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.177899 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:17.183012 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:17.192971 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 151631us
I20260709 13:08:17.195744 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:17.197402 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:17.198005 21945 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.155491 27682 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:08:17.200117 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:17.205422 22021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.021s
W20260709 13:08:17.206264 22021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.011s	sys 0.021s
W20260709 13:08:17.206542 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 92078.3us
I20260709 13:08:17.160715 27507 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.213048 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 750) took 1100 ms. Trace:
I20260709 13:08:17.160359 27431 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.169323 27428 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:08:17.214418 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:17.213483 22021 rpcz_store.cc:276] 0709 13:08:16.112634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.426341 (+313707us) service_pool.cc:224] Handling call
0709 13:08:16.427927 (+  1586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.434326 (+  6399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.434357 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.442195 (+  7838us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.566258 (+124063us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b18000d26a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1 00007f635602da0f
0709 13:08:16.635565 (+ 69307us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:16.697777 (+ 62212us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.206695 (+508918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.206767 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.206811 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:17.212829 (+  6018us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.212981 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20609,"prepare.queue_time_us":57451,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":122076,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":23098,"spinlock_wait_cycles":22098688,"thread_start_us":577654,"threads_started":2,"wal-append.queue_time_us":327815}
I20260709 13:08:17.220808 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:17.170082 27582 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:17.224956 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.228159 27714 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:17.228647 27717 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.229238 27717 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.233378 27719 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:17.236737 27719 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:17.237272 27262 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:08:17.237470 27682 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:17.237955 27682 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:17.214241 27595 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.219058 27703 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.255566 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:17.258617 21948 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:17.186769 27716 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.273130 27507 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:17.274962 27682 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.276649 27682 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.279193 27003 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.228767 27714 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.282090 27306 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.283190 27725 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.283819 27714 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:17.288041 27707 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:08:17.289135 27710 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.289722 27700 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:17.290373 27700 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:17.284730 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 62828.4us
I20260709 13:08:17.290995 27700 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.291265 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:17.235414 27366 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.291944 21950 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 20.
I20260709 13:08:17.292332 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:17.292285 27366 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:17.293748 22576 leader_election.cc:400] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18.
I20260709 13:08:17.294543 22576 leader_election.cc:403] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:17.295298 27659 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18.
I20260709 13:08:17.287087 27431 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.291424 27700 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:17.293685 27003 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:17.290318 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:17.237955 27705 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.217309 27661 consensus_queue.cc:260] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.319434 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:17.320298 22021 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:08:17.280853 27724 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:17.235378 27704 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:17.284049 27725 consensus_queue.cc:1059] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:17.284315 27306 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.286788 27717 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.308856 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:17.310341 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 57091.8us
I20260709 13:08:17.351560 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:17.316295 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 120597us
I20260709 13:08:17.352885 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:17.318650 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 140813us
I20260709 13:08:17.353843 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:17.333498 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 163261us
I20260709 13:08:17.334668 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:17.338624 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:17.355937 22019 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:17.288062 27714 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:17.343817 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50223.2us
I20260709 13:08:17.358564 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:17.354655 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 406578us
I20260709 13:08:17.257578 27595 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.360538 22022 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:08:17.359799 21838 leader_election.cc:336] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.533s (SENT)
I20260709 13:08:17.362373 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.360951 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:17.364324 27281 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.361559 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.373875 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:17.344655 27724 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:17.354724 27564 raft_consensus.cc:3055] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:17.267333 27703 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.359050 27582 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:17.362071 27366 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:17.361268 27704 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:17.438385 27724 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.440521 27694 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:17.431057 27727 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:17.471395 27727 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.471889 27727 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:17.425762 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 72952.5us
I20260709 13:08:17.369911 27651 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.418695 27710 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.430727 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:17.474246 27651 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:17.474586 22019 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:17.474730 27651 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.417141 27582 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.339352 27705 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.476016 27582 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.477701 27705 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:17.439599 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 80574.8us
I20260709 13:08:17.484879 27605 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:17.485562 27605 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.490044 27605 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.487577 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.495128 27582 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.498778 27605 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:17.499683 27605 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:17.491537 27713 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
I20260709 13:08:17.505501 27605 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.506374 27582 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.435737 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:17.415849 27678 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:08:17.419787 27366 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:17.549980 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 114322us
I20260709 13:08:17.540904 27701 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:17.517259 27639 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:08:17.521422 27737 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:17.541483 27698 consensus_meta.cc:287] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.006s
I20260709 13:08:17.396240 27431 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 13:08:17.525060 27731 consensus_queue.cc:1048] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:17.397735 27564 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:17.523702 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 88218.3us
I20260709 13:08:17.541121 27704 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:17.531716 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 328847us
W20260709 13:08:17.616570 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.575405 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.628499 21945 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
W20260709 13:08:17.599745 27726 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 13:08:17.618920 27281 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.600018 27366 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:17.601215 27716 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.600464 27262 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:17.651180 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 157012us
W20260709 13:08:17.661713 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 175324us
I20260709 13:08:17.650945 27685 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:17.640918 27731 consensus_queue.cc:1243] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 95296a4420ed41b69191d3d4353cf2b0 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:17.656749 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.674530 27537 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:08:17.677664 27704 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:17.678318 27564 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:17.680133 27741 log.cc:927] Time spent T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:17.658077 27434 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.685294 27434 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.687551 27434 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.671511 27262 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.688591 27262 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:17.655555 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 295736us
I20260709 13:08:17.626533 27697 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 13:08:17.722422 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 65810.1us
W20260709 13:08:17.723158 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 343876us
I20260709 13:08:17.636868 27698 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:17.666078 27428 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:08:17.671563 27122 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:17.742662 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:17.742599 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:17.756795 21941 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.731127 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:17.755234 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 106980us
I20260709 13:08:17.757761 21943 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:17.673419 27281 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.724442 27719 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:17.724790 27306 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:17.769326 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:17.774008 21950 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.739095 27595 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:17.726305 27703 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:17.772256 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48918.4us
I20260709 13:08:17.772650 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:17.739718 27705 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.758333 21916 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:17.779692 27736 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.780315 27699 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:17.787132 21941 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:08:17.746556 27651 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:17.790261 27693 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
W20260709 13:08:17.791640 27467 consensus_meta.cc:287] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.001s
I20260709 13:08:17.794126 27281 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:17.794919 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:17.845449 21943 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:08:17.851941 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:17.863902 21941 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:17.864323 21943 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:08:17.865530 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 165671us
W20260709 13:08:17.868466 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 119687us
I20260709 13:08:17.851004 27736 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:17.866216 21838 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.551s (SENT)
I20260709 13:08:17.870481 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.871065 21950 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:17.770426 27694 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:08:17.866159 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.844682 27669 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:17.850965 27705 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:17.876194 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 117979us
I20260709 13:08:17.879909 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:17.880450 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:17.880635 21950 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:17.796309 27431 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 13:08:17.873829 27682 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 13:08:17.916317 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:17.919762 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:17.920493 27753 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:17.920562 27698 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:17.920778 27660 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.872009 27736 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:17.883047 27700 consensus_meta.cc:287] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.573s	user 0.006s	sys 0.007s
I20260709 13:08:17.922616 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:17.923384 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:17.877702 27281 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:17.882522 27705 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.847746 27727 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.929858 22610 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:17.921136 27761 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:17.864104 27693 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.877842 27669 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:17.942289 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:17.867070 27755 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:08:18.009724 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:17.955051 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 85627.5us
W20260709 13:08:17.947860 27749 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:08:18.006436 22607 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:17.952916 21987 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:17.873925 27699 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:17.937315 27281 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:18.006501 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 90329us
I20260709 13:08:17.940647 27595 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.011787 21944 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.013746 22610 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:17.917510 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:18.014571 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:17.949229 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:17.952965 27737 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:18.020716 21941 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:18.022605 22608 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:18.023167 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.047480 21942 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:17.976790 27761 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.949880 27698 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:08:18.026404 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:18.026706 22015 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:18.027498 27651 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.021253 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:18.037066 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 88379.8us
I20260709 13:08:18.058254 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:18.059801 21987 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:17.937049 27700 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.043604 22019 raft_consensus.cc:606] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:18.060798 22019 raft_consensus.cc:614] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:18.062098 27700 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.062358 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:18.063010 27717 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:18.063261 22019 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.063524 27717 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.064038 27717 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.043800 21943 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.068830 27701 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:18.070479 27701 raft_consensus.cc:2804] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:18.071013 27701 raft_consensus.cc:697] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:18.052011 27737 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.073771 27727 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:18.074268 27737 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:18.053357 27735 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.621s	user 0.004s	sys 0.000s
I20260709 13:08:18.052240 27761 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.075691 27693 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:18.054070 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:18.076730 22015 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.077584 21987 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:18.043902 22023 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:18.068719 27721 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.144s
I20260709 13:08:18.044068 27281 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.086956 21943 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:18.010200 27262 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.046883 27431 raft_consensus.cc:2804] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:18.096236 21950 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:18.084713 27429 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:18.087705 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 66554.4us
I20260709 13:08:18.097862 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:18.071965 27701 consensus_queue.cc:237] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.101994 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:18.099659 27429 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.105386 27429 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:18.105717 27754 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:08:18.107882 22016 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:18.108289 27717 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.048768 27669 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.112022 27669 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:18.112293 27729 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.586s	user 0.003s	sys 0.000s
I20260709 13:08:18.112914 27717 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:18.114240 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2434) took 1163 ms. Trace:
I20260709 13:08:18.114749 21868 rpcz_store.cc:276] 0709 13:08:16.950921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.951077 (+   156us) service_pool.cc:224] Handling call
0709 13:08:16.960318 (+  9241us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:17.146097 (+185779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.146128 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:17.169601 (+ 23473us) log.cc:844] Serialized 78 byte log entry
0709 13:08:17.312889 (+143288us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:17.348425 (+ 35536us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.360338 (+ 11913us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.367117 (+  6779us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.508824 (+141707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.508908 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.111696 (+602788us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:18.113926 (+  2230us) raft_consensus.cc:1685] finished
0709 13:08:18.113961 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.114155 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143325,"prepare.queue_time_us":165670,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":681510,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":104054,"spinlock_wait_cycles":159448832,"thread_start_us":425803,"threads_started":3,"wal-append.queue_time_us":163906}
I20260709 13:08:18.120115 21946 raft_consensus.cc:2393] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:18.094262 27682 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:18.123876 27756 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:08:18.104466 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:18.125324 27703 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.125761 27703 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:18.126183 27703 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.127468 27262 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.117592 27755 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.129206 27755 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:18.129621 27755 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.099390 27431 raft_consensus.cc:697] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:18.086341 27693 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:18.134613 22019 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:18.082279 27595 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.133844 21914 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:18.137748 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "590d7eea40954779924038b15b716b58"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:18.139003 22022 raft_consensus.cc:606] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:18.139308 22022 raft_consensus.cc:614] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:18.124665 22015 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:18.147109 27736 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.150900 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:18.151229 22608 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:18.151764 22602 raft_consensus.cc:2368] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17.
I20260709 13:08:18.155027 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:18.128583 27429 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.157500 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:18.142567 27693 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.161489 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.161765 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.162114 21946 raft_consensus.cc:2376] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12. Re-sending same reply.
I20260709 13:08:18.162525 21948 raft_consensus.cc:2368] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:08:18.162652 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.163103 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.163323 21943 raft_consensus.cc:2368] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:18.164793 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.164973 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.166594 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.167343 21943 raft_consensus.cc:2368] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18.
I20260709 13:08:18.168136 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 839) took 1009 ms. Trace:
I20260709 13:08:18.168491 21944 rpcz_store.cc:276] 0709 13:08:17.161818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.162076 (+   258us) service_pool.cc:224] Handling call
0709 13:08:17.178846 (+ 16770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.042543 (+863697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.167922 (+125379us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54003d2054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:18.168073 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915157376}
I20260709 13:08:18.169198 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.169917 21943 raft_consensus.cc:2368] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11.
I20260709 13:08:18.169860 27429 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:18.171121 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.173765 27709 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.174552 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:18.175484 27640 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.176940 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:18.178969 27640 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.179363 27640 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:18.179721 27640 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.181959 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.182803 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.182803 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:18.186848 21943 raft_consensus.cc:2393] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:18.187676 27757 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:18.189090 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:18.189724 22022 raft_consensus.cc:606] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:18.190114 27661 raft_consensus.cc:3060] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.191778 27595 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:18.193388 27366 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.197283 22603 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:18.198244 27366 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.198966 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.136363 27431 consensus_queue.cc:237] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.201746 27716 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:18.202207 27716 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:18.203123 27716 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.204316 27716 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.205039 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:18.205268 27306 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:18.210961 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.228325 27306 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:18.228462 27605 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:18.228905 27605 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.228972 22576 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:18.229317 27605 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:18.230648 27651 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:18.231312 27651 consensus_queue.cc:1243] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:18.233016 27651 raft_consensus.cc:2804] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:18.234350 27651 raft_consensus.cc:697] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:18.211556 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:18.221626 27750 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.211s	user 0.003s	sys 0.000s
I20260709 13:08:18.186342 27668 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:08:18.216496 27281 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:18.217134 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.244143 21914 leader_election.cc:400] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17.
I20260709 13:08:18.219257 27757 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:18.246429 27757 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.248042 27755 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.221599 27640 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.225530 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:18.226241 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.251259 21942 raft_consensus.cc:2368] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:08:18.243139 22023 pending_rounds.cc:85] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 8
I20260709 13:08:18.251895 22023 pending_rounds.cc:107] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:18.171059 27762 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.252305 22023 raft_consensus.cc:2889] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:18.251308 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.245301 21914 leader_election.cc:403] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.256975 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:18.260555 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:18.261264 22022 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.263484 22610 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.254686 27693 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:18.282014 27693 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:18.283233 27693 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.286036 27714 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:18.287773 27722 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.744s	user 0.000s	sys 0.005s
I20260709 13:08:18.293314 22573 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:18.296787 22573 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:18.237285 27651 consensus_queue.cc:237] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.309648 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:18.310315 21873 raft_consensus.cc:3060] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.300940 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:18.305627 27003 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.315951 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2728) took 1290 ms. Trace:
I20260709 13:08:18.316396 27736 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:18.316152 27003 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.265859 27699 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:18.317018 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2428) took 1522 ms. Trace:
I20260709 13:08:18.317421 27698 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.317941 27698 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.319159 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:18.319784 21869 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.317423 21872 rpcz_store.cc:276] 0709 13:08:16.795016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.803036 (+  8020us) service_pool.cc:224] Handling call
0709 13:08:16.803483 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:16.920947 (+117464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.924847 (+  3900us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:16.925394 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 13:08:17.142436 (+217042us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:17.205045 (+ 62609us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.490653 (+285608us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:17.588705 (+ 98052us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.290001 (+701296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.290074 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.316722 (+ 26648us) raft_consensus.cc:1685] finished
0709 13:08:18.316753 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.316939 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":714296,"prepare.queue_time_us":135368,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":258316,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":36510,"spinlock_wait_cycles":5033728,"thread_start_us":602451,"threads_started":5,"wal-append.queue_time_us":227095}
I20260709 13:08:18.321897 27306 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.322739 21872 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:08:18.323086 21872 pending_rounds.cc:85] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 8
I20260709 13:08:18.323297 21872 pending_rounds.cc:107] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:18.323524 21872 raft_consensus.cc:2889] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.324819 27740 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.325356 27740 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.326509 22015 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:18.326673 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 657378us
I20260709 13:08:18.261838 27639 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17.
W20260709 13:08:18.327620 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 658231us
I20260709 13:08:18.318393 27003 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:18.264216 27682 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:18.316524 21947 rpcz_store.cc:276] 0709 13:08:17.015538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.015754 (+   216us) service_pool.cc:224] Handling call
0709 13:08:17.034952 (+ 19198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.085704 (+ 50752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.085733 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.089688 (+  3955us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.309273 (+219585us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:17.309310 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.309382 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.286986 (+977604us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:18.289944 (+  2958us) raft_consensus.cc:1685] finished
0709 13:08:18.289965 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.305804 (+ 15839us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23568,"raft.queue_time_us":27250,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"spinlock_wait_cycles":27113344,"thread_start_us":171740,"threads_started":1,"wal-append.queue_time_us":264237}
I20260709 13:08:18.287838 27714 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.333320 27003 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:18.341089 21869 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:18.347122 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:18.347779 21867 raft_consensus.cc:3060] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.351743 21870 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:18.357355 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.357595 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.358045 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.358074 21869 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:08:18.358736 21874 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:08:18.358947 21872 raft_consensus.cc:2410] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:08:18.309033 27660 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.327086 27366 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.362916 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:18.369668 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:18.369709 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:18.351061 27756 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:18.333842 27306 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:18.371300 22608 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:18.373003 22601 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.375980 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:18.374277 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.332664 27659 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:18.313927 27705 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.260270 27762 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.387002 21874 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:18.392686 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.393311 21872 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:18.330140 27605 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.369134 27660 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:18.374011 27366 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:18.401227 22016 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:18.406543 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 540310us
I20260709 13:08:18.406741 27762 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:18.407251 21838 leader_election.cc:336] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.724s (SENT)
I20260709 13:08:18.407368 27366 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:18.408160 21838 leader_election.cc:336] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.027s (SENT)
I20260709 13:08:18.408818 27714 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:18.409977 21838 leader_election.cc:336] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.710s (SENT)
W20260709 13:08:18.411366 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.410845 21873 raft_consensus.cc:2468] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:08:18.414376 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.414597 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.417069 21867 raft_consensus.cc:2468] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:18.417899 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.418462 21867 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
W20260709 13:08:18.419134 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 88001.9us
I20260709 13:08:18.422924 22601 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:18.426522 27659 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:18.414994 21873 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:18.357160 27730 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:18.430548 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:18.433249 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.434616 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.435422 21942 raft_consensus.cc:2376] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18. Re-sending same reply.
I20260709 13:08:18.401599 27660 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.442414 21947 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:18.448462 21867 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.453687 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.376461 27761 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.459393 22601 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:18.487171 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:18.436673 27702 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:18.488651 21867 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.427917 27659 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.494501 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:18.502355 21869 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.497578 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:18.542264 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:18.543638 27281 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.569116 22022 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:08:18.586665 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.587108 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.578871 21867 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:18.567737 27779 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:08:18.579458 21869 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:18.611366 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:18.573264 27761 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.589437 21943 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:18.592814 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.430015 27703 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.619669 21949 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:18.505209 27702 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.645005 21949 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 21.
I20260709 13:08:18.724411 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.724785 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:18.725584 22601 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:18.725798 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:18.726698 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 343262us
I20260709 13:08:18.727777 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.728843 21869 raft_consensus.cc:2393] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:18.731345 21867 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:08:18.733263 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 163147us
W20260709 13:08:18.734318 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 236852us
I20260709 13:08:18.642700 27762 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:18.837255 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.838461 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:18.841552 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:18.842150 21869 raft_consensus.cc:3060] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:08:18.847561 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 117688us
I20260709 13:08:18.848811 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:18.831595 27779 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:18.852782 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:18.834919 27740 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.839655 27705 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:18.857673 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:18.840482 27762 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:18.844398 27730 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:18.852814 27779 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:08:18.861907 27777 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:08:18.861970 27779 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.863458 27779 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:18.863790 27783 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:08:18.869457 27773 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
W20260709 13:08:18.870930 27775 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
W20260709 13:08:18.872316 27786 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:08:18.873795 27774 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
W20260709 13:08:18.875095 27782 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:08:18.880383 27672 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:18.880530 21869 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:18.882962 27672 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:18.886531 27582 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:18.891822 27564 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.893675 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 866) took 1027 ms. Trace:
I20260709 13:08:18.896248 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:18.898448 21869 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:18.901849 21874 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:18.904318 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:18.905124 21948 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.869628 21838 leader_election.cc:400] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:08:18.906263 21838 leader_election.cc:403] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.846956 27682 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:18.905792 22603 rpcz_store.cc:276] 0709 13:08:17.866691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.866852 (+   161us) service_pool.cc:224] Handling call
0709 13:08:17.875666 (+  8814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.197737 (+322071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.893416 (+695679us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54006504d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:18.893610 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739116288}
W20260709 13:08:18.914775 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57175.3us
I20260709 13:08:18.916455 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:18.917507 21869 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:18.908564 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:18.852285 27605 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.904798 27720 raft_consensus.cc:2764] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:08:18.918903 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49420us
I20260709 13:08:18.860220 27700 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.958510 27700 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.958911 21838 leader_election.cc:400] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:18.959396 21838 leader_election.cc:403] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.919459 27740 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Leader election lost for term 13. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:08:18.920125 27706 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.921120 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:19.069862 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 148785us
W20260709 13:08:18.928146 27366 consensus_meta.cc:287] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.000s
I20260709 13:08:18.929216 27703 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:18.930760 27702 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:18.932132 21944 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:08:18.933028 27762 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:18.935796 27660 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.937146 21942 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:18.847434 27467 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:08:18.938403 27791 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:19.101647 27791 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:19.102855 27791 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.939083 27748 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.952819 27760 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:19.105187 27760 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:19.105706 27698 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:19.107856 27760 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:18.957026 27661 consensus_meta.cc:287] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.002s
I20260709 13:08:19.111011 21945 raft_consensus.cc:1275] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:08:19.111447 21945 pending_rounds.cc:85] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 14
I20260709 13:08:19.111703 21945 pending_rounds.cc:107] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:08:19.111989 21945 raft_consensus.cc:2889] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.114122 27755 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:19.131191 27699 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.135187 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.135833 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.136801 27306 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.137369 27306 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:19.148833 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.149780 27595 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.150461 27595 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:19.153347 27705 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:19.154119 27705 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:19.165200 27765 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.166003 27765 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:18.966271 27720 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
W20260709 13:08:19.076164 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 117482us
I20260709 13:08:19.177361 21838 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:18.958961 27700 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.890558 27672 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:19.069442 27706 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:19.202131 27706 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.966886 27682 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:19.079332 27366 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:19.207231 22603 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:19.079052 27714 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:19.210940 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:19.213230 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:19.214322 21944 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:19.215342 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:19.221166 27306 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:19.190330 27467 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.192584 27660 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:19.193334 22605 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:19.197781 27751 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.414618 27751 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:19.415372 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 1140) took 1057 ms. Trace:
I20260709 13:08:19.415977 22605 rpcz_store.cc:276] 0709 13:08:18.357716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.394151 (+ 36435us) service_pool.cc:224] Handling call
0709 13:08:18.405512 (+ 11361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.414327 (+1008815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.415041 (+   714us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b540067fcd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:19.415293 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1811237632}
I20260709 13:08:18.908102 27730 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:19.419832 27730 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:19.420800 27751 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:19.236093 21839 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:19.426546 27730 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:19.427242 27730 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:19.428138 27730 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:19.431648 27694 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:19.433641 27694 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:19.242309 27366 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:19.244287 27716 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:19.438035 27716 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:19.251766 27682 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:19.258364 27700 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:19.259573 27780 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.809s	user 0.030s	sys 0.080s
I20260709 13:08:19.261587 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 809) took 1111 ms. Trace:
I20260709 13:08:19.261801 27706 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:19.262619 27640 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:19.266332 22016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3285) took 1039 ms. Trace:
I20260709 13:08:19.276330 27811 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.312143 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2747) took 1514 ms. Trace:
I20260709 13:08:19.551403 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:19.317216 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3282) took 1097 ms. Trace:
I20260709 13:08:19.552317 21875 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:19.552884 22015 rpcz_store.cc:276] 0709 13:08:18.220197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.221595 (+  1398us) service_pool.cc:224] Handling call
0709 13:08:18.221913 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.326907 (+104994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.316845 (+989938us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54004191d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:19.317124 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240152832}
I20260709 13:08:19.345732 21869 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:19.346901 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:19.555438 21868 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:19.357730 27771 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.963s	user 0.000s	sys 0.004s
I20260709 13:08:19.375520 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:19.379632 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:19.557577 21867 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:19.183936 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:19.098626 27781 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.249s	user 0.000s	sys 0.002s
I20260709 13:08:19.562270 21871 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 18: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:19.388693 27765 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:19.131958 27699 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:19.406157 27672 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:19.426460 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 190458us
I20260709 13:08:19.237162 27714 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:19.238624 27595 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:19.510548 27762 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:19.602898 22576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.028s	sys 0.061s
I20260709 13:08:19.451339 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:19.445501 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:19.518850 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:19.513408 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:19.510756 22610 rpcz_store.cc:276] 0709 13:08:18.149796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.150557 (+   761us) service_pool.cc:224] Handling call
0709 13:08:18.150844 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.263897 (+113053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.261294 (+997397us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54000b54d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:19.261487 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258615552}
I20260709 13:08:19.605656 22020 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:19.521102 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:19.607638 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 86682.8us
I20260709 13:08:19.608724 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:19.531764 21948 consensus_meta.cc:287] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.624s	user 0.004s	sys 0.008s
I20260709 13:08:19.551184 22016 rpcz_store.cc:276] 0709 13:08:18.226782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.226912 (+   130us) service_pool.cc:224] Handling call
0709 13:08:18.230260 (+  3348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.401720 (+171460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.266002 (+864282us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54001f04d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:19.266249 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392724736}
I20260709 13:08:19.551741 21945 rpcz_store.cc:276] 0709 13:08:17.798282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.799215 (+   933us) service_pool.cc:224] Handling call
0709 13:08:17.799541 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.112514 (+1312973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.311801 (+199287us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001405d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:19.312060 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3015030656}
I20260709 13:08:19.610762 21948 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:19.434206 27694 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:19.567481 22023 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:08:19.571435 21914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.079s	sys 0.064s
W20260709 13:08:19.572190 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 388355us
W20260709 13:08:19.616813 21914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.079s	sys 0.064s
I20260709 13:08:19.617269 21838 leader_election.cc:400] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18.
I20260709 13:08:19.617619 21838 leader_election.cc:403] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:19.572932 21947 raft_consensus.cc:1240] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:19.573971 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:19.531185 27693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.024s	sys 0.006s
W20260709 13:08:19.574834 21949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.037s	sys 0.106s
W20260709 13:08:19.582252 22573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.033s	sys 0.053s
W20260709 13:08:19.626637 21949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.037s	sys 0.106s
I20260709 13:08:19.485284 27716 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:19.528306 27751 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:19.603155 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:19.606607 22576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.028s	sys 0.061s
W20260709 13:08:19.644485 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.647262 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:19.552906 27306 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:19.588519 27651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.020s	sys 0.065s
I20260709 13:08:19.620644 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:19.660290 21871 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:19.662941 27003 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:19.663727 27003 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:19.668431 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:19.669062 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.640384 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:19.587926 27719 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:19.604226 27564 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:19.565806 27811 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:19.707733 21870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.046s	sys 0.130s
W20260709 13:08:19.788996 21870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.048s	sys 0.140s
I20260709 13:08:19.625236 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1863) took 1432 ms. Trace:
I20260709 13:08:19.791046 21946 rpcz_store.cc:276] 0709 13:08:18.173609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.174868 (+  1259us) service_pool.cc:224] Handling call
0709 13:08:19.272706 (+1097838us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:08:19.513169 (+240463us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4de9c 00007f6352f4da5b 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:08:19.606250 (+ 93081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16570496}
W20260709 13:08:19.626734 22573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.033s	sys 0.053s
W20260709 13:08:19.627187 22574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.042s	sys 0.054s
I20260709 13:08:19.632031 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:19.633438 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:19.635162 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:19.638209 21838 leader_election.cc:400] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11.
I20260709 13:08:19.655676 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:19.736925 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.787464 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 147205us
W20260709 13:08:19.550619 21941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.041s	sys 0.078s
W20260709 13:08:19.621685 21872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.017s	sys 0.014s
W20260709 13:08:19.641451 27693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.024s	sys 0.007s
I20260709 13:08:19.250716 27705 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:19.716836 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2438) took 1409 ms. Trace:
W20260709 13:08:19.771665 27781 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:08:19.668777 27651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.020s	sys 0.066s
I20260709 13:08:19.852699 27003 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:19.638465 27815 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:08:19.917524 22022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.013s
W20260709 13:08:19.920460 22022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.013s
I20260709 13:08:19.863826 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:19.665412 27682 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.930493 22019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.000s	sys 0.010s
W20260709 13:08:19.931035 22019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.000s	sys 0.011s
I20260709 13:08:19.860562 22021 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:19.680253 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:19.933483 21869 raft_consensus.cc:2368] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17.
W20260709 13:08:19.909559 21872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.027s	sys 0.014s
I20260709 13:08:19.912432 21946 raft_consensus.cc:1275] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:19.912864 21838 leader_election.cc:403] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:08:19.913221 21941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.041s	sys 0.078s
I20260709 13:08:19.625289 27762 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:19.914072 22574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.048s	sys 0.057s
I20260709 13:08:19.914625 21875 raft_consensus.cc:2368] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17.
I20260709 13:08:19.910588 27705 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:19.850854 27709 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.718084 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.922665 21867 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.716509 27428 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:19.860587 21871 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:19.645224 27813 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.248s
I20260709 13:08:19.910673 21866 rpcz_store.cc:276] 0709 13:08:18.307487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.307614 (+   127us) service_pool.cc:224] Handling call
0709 13:08:18.324996 (+ 17382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.325311 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.325338 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.325781 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.366273 (+ 40492us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:18.507605 (+141332us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.830893 (+323288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.830992 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.258955 (+427963us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:19.701823 (+442868us) raft_consensus.cc:1685] finished
0709 13:08:19.716502 (+ 14679us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.716746 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":344174,"prepare.queue_time_us":182980,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":293330,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":17003,"spinlock_wait_cycles":74621824,"thread_start_us":153330,"threads_started":2,"wal-append.queue_time_us":66757}
I20260709 13:08:19.859441 27434 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:19.863401 21868 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:19.860138 27564 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:19.860908 27694 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:19.644974 27743 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.249s
W20260709 13:08:19.645365 27685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.726s	user 0.036s	sys 0.079s
I20260709 13:08:19.671185 27751 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:19.683147 27306 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:19.701332 27748 consensus_queue.cc:1059] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.258s
I20260709 13:08:19.850687 27716 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:20.604241 21874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.007s	sys 0.012s
I20260709 13:08:20.207610 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:08:20.567935 21945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.026s	sys 0.070s
W20260709 13:08:20.843626 21945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.026s	sys 0.074s
W20260709 13:08:20.030272 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 392254us
W20260709 13:08:20.844918 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 2.10779e+06us
I20260709 13:08:20.847769 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:19.948299 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:20.849907 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50258 (request call id 2462) took 1505 ms. Trace:
I20260709 13:08:20.095041 22610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:36026
W20260709 13:08:20.557547 21873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.207s	user 0.007s	sys 0.017s
W20260709 13:08:20.449839 22609 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.008s	sys 0.013s
W20260709 13:08:20.538208 21839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.000s	sys 0.015s
I20260709 13:08:20.120965 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:20.406914 21870 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.028s	sys 0.068s
I20260709 13:08:19.716034 21770 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 8 to 15, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 15 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:19.954850 22604 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:20.075161 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.215699 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:19.917261 27659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.275s	user 0.032s	sys 0.103s
I20260709 13:08:19.859059 27731 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.236238 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:20.844856 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:20.957850 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:20.958523 22603 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:20.958793 21948 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:20.958972 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 114269us
W20260709 13:08:20.670015 27801 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
W20260709 13:08:20.949285 21870 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.034s	sys 0.074s
I20260709 13:08:19.950623 27693 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:20.950165 21869 raft_consensus.cc:2468] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:20.991228 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2956) took 1044 ms. Trace:
W20260709 13:08:20.842948 21874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.009s	sys 0.013s
I20260709 13:08:20.950278 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:20.991703 21869 rpcz_store.cc:276] 0709 13:08:19.947068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.947817 (+   749us) service_pool.cc:224] Handling call
0709 13:08:20.991133 (+1043316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.370559 27728 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:20.873198 21872 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.002s	sys 0.015s
W20260709 13:08:20.951133 21873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.601s	user 0.014s	sys 0.022s
W20260709 13:08:21.002003 21872 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.018s	sys 0.055s
W20260709 13:08:20.949239 22609 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.592s	user 0.015s	sys 0.019s
I20260709 13:08:20.950489 21868 rpcz_store.cc:276] 0709 13:08:19.344228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.346530 (+  2302us) service_pool.cc:224] Handling call
0709 13:08:20.849808 (+1503278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:20.951496 21914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.562s (SENT) [suppressed 28 similar messages]
I20260709 13:08:20.948680 21946 raft_consensus.cc:1275] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:21.003511 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:21.003872 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2769) took 1567 ms. Trace:
I20260709 13:08:21.004437 21946 rpcz_store.cc:276] 0709 13:08:19.436307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.947956 (+1511649us) service_pool.cc:224] Handling call
0709 13:08:20.948327 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.003523 (+ 55196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.003786 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:20.952528 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.000s	sys 0.024s
W20260709 13:08:20.879372 21875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2950) took 1353 ms (client timeout 1595 ms). Trace:
I20260709 13:08:20.596681 27811 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:20.927951 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:20.350328 27699 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.015368 21947 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:21.015939 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 862) took 1085 ms. Trace:
I20260709 13:08:21.016351 21947 rpcz_store.cc:276] 0709 13:08:19.930219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.927558 (+997339us) service_pool.cc:224] Handling call
0709 13:08:21.015874 (+ 88316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.016847 27699 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:21.017426 27699 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.018042 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2774) took 1432 ms. Trace:
I20260709 13:08:20.388774 22024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 768) took 2491 ms. Trace:
I20260709 13:08:20.948637 22610 raft_consensus.cc:606] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:21.018435 21947 rpcz_store.cc:276] 0709 13:08:19.585799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.017193 (+1431394us) service_pool.cc:224] Handling call
0709 13:08:21.017532 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.017715 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.017742 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.017782 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:21.017819 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.017873 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.017990 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:20.316222 27763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.213s	user 0.044s	sys 0.066s
W20260709 13:08:20.669503 27802 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 13:08:20.975093 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 860) took 1045 ms. Trace:
W20260709 13:08:19.917421 27757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.007s	sys 0.007s
W20260709 13:08:20.443790 27794 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:08:19.992723 27682 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:20.668450 27806 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:08:20.666667 27820 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:08:20.841686 27799 log.cc:927] Time spent T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.579s	user 0.002s	sys 0.000s
W20260709 13:08:20.876660 27685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.957s	user 0.052s	sys 0.109s
I20260709 13:08:20.028617 27660 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.119293 27719 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11.
I20260709 13:08:20.086578 27700 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:20.961894 21838 leader_election.cc:400] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:08:21.079890 21838 leader_election.cc:403] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:21.042973 27366 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:08:20.891585 21915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.002s	sys 0.009s
W20260709 13:08:21.083215 21915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.004s	sys 0.011s
I20260709 13:08:20.249588 27706 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:20.962102 27659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.312s	user 0.043s	sys 0.113s
I20260709 13:08:20.710258 27800 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:20.236203 27803 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:21.108246 27803 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.111810 27803 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:20.989499 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:21.113035 21943 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.863267 27681 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.053507 27651 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.926347 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.119673 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.996111 21871 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 10.
W20260709 13:08:21.005854 21875 rpcz_store.cc:269] 0709 13:08:19.526332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.579040 (+ 52708us) service_pool.cc:224] Handling call
0709 13:08:20.879272 (+1300232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:21.120750 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.929561 21944 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:21.006949 21988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.366s	user 0.021s	sys 0.005s
W20260709 13:08:21.121665 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.021s	sys 0.005s
W20260709 13:08:21.122514 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 1.5138e+06us
I20260709 13:08:21.020541 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:21.123994 21866 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.371063 27796 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.616s
I20260709 13:08:21.031358 21867 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
W20260709 13:08:21.125638 21867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2952) took 1598 ms (client timeout 2118 ms). Trace:
I20260709 13:08:20.897837 27826 consensus_queue.cc:1059] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.135s
I20260709 13:08:20.985285 27694 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.034610 21948 rpcz_store.cc:276] 0709 13:08:19.929625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.027247 (+ 97622us) service_pool.cc:224] Handling call
0709 13:08:20.975017 (+947770us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.957572 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:20.948724 27705 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:20.948344 27709 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:21.136344 27825 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:21.137856 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2764) took 2004 ms. Trace:
I20260709 13:08:21.138427 27709 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:20.993708 27743 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:21.033766 27763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.930s	user 0.049s	sys 0.081s
I20260709 13:08:21.139252 27682 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.138372 21945 rpcz_store.cc:276] 0709 13:08:19.133467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.625369 (+491902us) service_pool.cc:224] Handling call
0709 13:08:19.625788 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.643651 (+ 17863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.643697 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.667215 (+ 23518us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.844332 (+1177117us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:20.844395 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.844506 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.137623 (+293117us) raft_consensus.cc:1685] finished
0709 13:08:21.137649 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.137790 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46357,"raft.queue_time_us":18599,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":17746,"thread_start_us":924462,"threads_started":1,"wal-append.queue_time_us":1203720}
I20260709 13:08:21.046288 21941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2753) took 2139 ms. Trace:
I20260709 13:08:21.140206 27751 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.007143 27704 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18.
I20260709 13:08:21.140618 27763 raft_consensus.cc:3055] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:21.054585 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:21.036530 27757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.077s	user 0.025s	sys 0.025s
I20260709 13:08:21.019375 22024 rpcz_store.cc:276] 0709 13:08:17.881206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.881312 (+   106us) service_pool.cc:224] Handling call
0709 13:08:17.922079 (+ 40767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.926428 (+  4349us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:18.208308 (+281880us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b180036d060. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352effc0a 00007f635c63f219 00007f6352f87a40 00007f6352f824e4 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf 00007f635608c038
0709 13:08:18.340146 (+131838us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.097851 (+757705us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:19.143162 (+ 45311us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.143771 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.143975 (+   204us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:19.144221 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.144380 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.144475 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.372670 (+1228195us) raft_consensus.cc:1685] finished
0709 13:08:20.372698 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.372895 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":748650,"prepare.queue_time_us":278109,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":75,"raft.queue_time_us":734035,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":14005,"spinlock_wait_cycles":54857728,"thread_start_us":126187,"threads_started":2,"wal-append.queue_time_us":282688}
I20260709 13:08:21.140292 21941 rpcz_store.cc:276] 0709 13:08:18.901547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.904785 (+  3238us) service_pool.cc:224] Handling call
0709 13:08:18.905174 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.908197 (+  3023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.908243 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.908925 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.122696 (+213771us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4800002dd8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:08:21.040548 (+1917852us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b180031d320. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1
0709 13:08:21.040761 (+   213us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:21.040804 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.040880 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.040938 (+    58us) raft_consensus.cc:1685] finished
0709 13:08:21.040950 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.041097 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2525,"raft.queue_time_us":32323,"raft.run_cpu_time_us":2653,"raft.run_wall_time_us":184990,"spinlock_wait_cycles":89943296,"thread_start_us":1011083,"threads_started":1,"wal-append.queue_time_us":1003362,"wal-append.run_cpu_time_us":1954,"wal-append.run_wall_time_us":1135400}
I20260709 13:08:21.019658 27699 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.143249 27699 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:21.073935 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3290) took 1693 ms. Trace:
I20260709 13:08:21.144361 27705 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:20.980612 27731 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.077905 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3288) took 1699 ms. Trace:
I20260709 13:08:21.145042 27705 consensus_queue.cc:1048] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:21.145423 22019 rpcz_store.cc:276] 0709 13:08:19.378676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.382666 (+  3990us) service_pool.cc:224] Handling call
0709 13:08:19.383029 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.383284 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:19.383921 (+   637us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.077419 (+1693498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.077491 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:21.077563 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.077658 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.077824 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":923247,"prepare.queue_time_us":172,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":1084155,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":54,"spinlock_wait_cycles":155256064,"thread_start_us":769702,"threads_started":2,"wal-append.queue_time_us":1537034}
I20260709 13:08:21.146622 27705 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:21.146891 27731 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.067607 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:21.149102 21868 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:21.149452 27306 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:21.150020 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:21.150416 27762 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.127187 27700 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.151227 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:21.151883 21868 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.079473 27595 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:21.043598 27824 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:21.153692 27824 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.154505 27595 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:21.155136 27595 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:21.091945 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 884356us
I20260709 13:08:21.136472 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:21.094393 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 196775us
I20260709 13:08:21.121173 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50242 (request call id 2957) took 1037 ms. Trace:
I20260709 13:08:21.122756 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2755) took 2220 ms. Trace:
I20260709 13:08:21.019584 22610 raft_consensus.cc:614] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:21.126539 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2768) took 1690 ms. Trace:
W20260709 13:08:21.126094 21867 rpcz_store.cc:269] 0709 13:08:19.527047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.592202 (+ 65155us) service_pool.cc:224] Handling call
0709 13:08:21.125557 (+1533355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.096521 27748 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:21.092870 27719 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:21.168524 27003 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:21.112560 27803 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.133098 27835 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.126821 27651 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.178903 21944 rpcz_store.cc:276] 0709 13:08:19.436000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.928901 (+1492901us) service_pool.cc:224] Handling call
0709 13:08:20.929323 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.126254 (+196931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.126480 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.179801 27651 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.180408 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3300) took 1534 ms. Trace:
I20260709 13:08:21.181109 22608 raft_consensus.cc:2410] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:21.181774 27835 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.185976 21868 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:21.133517 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:21.204993 21875 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.205361 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:21.142235 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:21.209108 21869 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:21.210070 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:21.210700 21869 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
W20260709 13:08:21.211055 27672 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.614s	user 0.014s	sys 0.000s
I20260709 13:08:21.211567 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:21.006644 27821 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:21.212374 27821 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:20.869555 27714 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.212618 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44146.6us
I20260709 13:08:21.212731 27682 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:21.213124 27714 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.014729 27693 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:21.214066 27682 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:21.214509 27682 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:21.215375 27682 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:21.216012 27693 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.215906 27640 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:21.217721 27682 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.122177 27681 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:21.212378 27719 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:21.221590 27821 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.223066 27821 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.102609 27366 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 21 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:21.168965 27306 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:08:21.225709 27366 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.226692 22610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36026 (request call id 3) took 1281 ms. Trace:
I20260709 13:08:21.227222 22610 rpcz_store.cc:276] 0709 13:08:19.924212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.951138 (+ 26926us) service_pool.cc:224] Handling call
0709 13:08:21.168351 (+1217213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.031931 27728 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:21.229079 21868 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.230401 27728 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.080510 27660 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.233348 27660 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.159068 21871 rpcz_store.cc:276] 0709 13:08:20.083903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.950031 (+866128us) service_pool.cc:224] Handling call
0709 13:08:21.121116 (+171085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:21.235639 21871 raft_consensus.cc:1240] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:08:21.235841 27720 raft_consensus.cc:3055] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:21.236404 27720 raft_consensus.cc:740] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:21.236727 21868 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:21.167366 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:21.237759 21867 raft_consensus.cc:2410] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:21.237654 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:21.238310 22019 raft_consensus.cc:606] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:21.238665 22019 raft_consensus.cc:614] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:21.239022 21867 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:21.165305 27834 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:21.240012 27834 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:21.144759 22022 rpcz_store.cc:276] 0709 13:08:19.380591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.380772 (+   181us) service_pool.cc:224] Handling call
0709 13:08:19.381162 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.381425 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:19.381820 (+   395us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.073383 (+1691563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.073467 (+    84us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:21.073546 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.073650 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.073844 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5723,"prepare.queue_time_us":723,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":1094481,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":755348,"threads_started":2,"wal-append.queue_time_us":1104655}
I20260709 13:08:21.159651 21949 rpcz_store.cc:276] 0709 13:08:18.902285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.902428 (+   143us) service_pool.cc:224] Handling call
0709 13:08:18.902734 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.903065 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.903089 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.903606 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.627318 (+723712us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:19.627377 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.627466 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.122513 (+1495047us) raft_consensus.cc:1685] finished
0709 13:08:21.122534 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.122688 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5294,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":43297,"thread_start_us":723238,"threads_started":1,"wal-append.queue_time_us":1190650}
I20260709 13:08:21.168056 27659 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.170913 27582 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.141239 27763 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:21.135901 27832 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:21.189682 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2449) took 2835 ms. Trace:
I20260709 13:08:21.170295 27748 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.192343 27595 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.211840 27639 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.120051 27800 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.180900 22015 rpcz_store.cc:276] 0709 13:08:19.646556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.668232 (+ 21676us) service_pool.cc:224] Handling call
0709 13:08:19.874311 (+206079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.982545 (+1108234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.982581 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.982623 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:20.982664 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.180129 (+197465us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540017a7d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:21.180186 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.180335 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548157824}
I20260709 13:08:21.240528 21867 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:21.256975 22573 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:21.302639 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45781.8us
I20260709 13:08:21.241750 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:21.259770 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 1138) took 2915 ms. Trace:
W20260709 13:08:21.266201 21950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54888 (request call id 1861) took 3093 ms (client timeout 2150 ms). Trace:
W20260709 13:08:21.281980 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 113001us
I20260709 13:08:21.239516 21871 pending_rounds.cc:85] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 7
I20260709 13:08:21.305922 21871 pending_rounds.cc:107] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:21.237392 27720 consensus_queue.cc:260] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:21.304788 21950 rpcz_store.cc:269] 0709 13:08:18.173044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.175156 (+  2112us) service_pool.cc:224] Handling call
0709 13:08:18.210750 (+ 35594us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b5800190298. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4db71 00007f6352f4da22 00007f635be66c09 00007f635afc0ee0 00007f635b08a0ab 00007f635b08a131 00007f635b0380a0 00007f635b037984 00007f63545b26d4 00007f63545b2662
0709 13:08:21.256057 (+3045307us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b540009bfd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:21.266093 (+ 10036us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6713897216}
I20260709 13:08:21.304544 22604 rpcz_store.cc:276] 0709 13:08:18.345990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.346456 (+   466us) service_pool.cc:224] Handling call
0709 13:08:18.346704 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.953951 (+2607247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.259456 (+305505us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400650ed4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:21.259679 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3697747200}
I20260709 13:08:21.307972 21871 raft_consensus.cc:2889] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.308805 22019 raft_consensus.cc:606] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:21.315084 22019 raft_consensus.cc:614] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:21.309309 21943 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:21.316329 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35490 (request call id 861) took 1386 ms. Trace:
I20260709 13:08:21.159693 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:21.311805 21875 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:21.312965 21866 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:21.166803 22609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 813) took 2853 ms. Trace:
I20260709 13:08:21.320947 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3306) took 1360 ms. Trace:
I20260709 13:08:21.322595 21875 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:21.322922 22021 rpcz_store.cc:276] 0709 13:08:19.960833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.048501 (+ 87668us) service_pool.cc:224] Handling call
0709 13:08:20.049498 (+   997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.153009 (+1103511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.153058 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.153117 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:21.153173 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.320688 (+167515us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400199454. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:21.320737 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.320877 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537110272}
W20260709 13:08:21.325048 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 165423us
I20260709 13:08:21.316926 21943 rpcz_store.cc:276] 0709 13:08:19.929929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.954642 (+1024713us) service_pool.cc:224] Handling call
0709 13:08:21.316247 (+361605us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:21.247999 27807 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:08:21.326668 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:21.299050 21870 rpcz_store.cc:276] 0709 13:08:18.354558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.354778 (+   220us) service_pool.cc:224] Handling call
0709 13:08:18.370986 (+ 16208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.443368 (+ 72382us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:18.831326 (+387958us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.984555 (+2153229us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.986885 (+  2330us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.987099 (+   214us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:20.987157 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.987258 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.176449 (+189191us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b24001956c8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352e0b9c4 00007f6352e09acb 00007f6352fc4dc9 00007f6352fc4a55 00007f6352fc3fb0 00007f6355c3a488 00007f6355c3abe8 00007f6355c12398 00007f6355c0d76a 00007f6355c0cbb6
0709 13:08:21.189304 (+ 12855us) raft_consensus.cc:1685] finished
0709 13:08:21.189424 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.189586 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":300547,"prepare.queue_time_us":106120,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":205343,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":71142,"spinlock_wait_cycles":49266432,"thread_start_us":2504831,"threads_started":3,"wal-append.queue_time_us":1760313}
I20260709 13:08:21.159579 27824 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.312783 21770 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 12, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 12 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.220366 27681 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.384208 22605 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
W20260709 13:08:21.275410 27816 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.352s	user 0.003s	sys 0.005s
I20260709 13:08:21.220289 27719 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:21.265395 27819 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.344s	user 0.000s	sys 0.007s
I20260709 13:08:21.386509 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:21.398967 21943 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
W20260709 13:08:21.259490 27798 log.cc:927] Time spent T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.997s	user 0.002s	sys 0.002s
W20260709 13:08:21.386936 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 60378.6us
I20260709 13:08:21.269047 27564 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.398279 22573 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:21.324335 22609 rpcz_store.cc:276] 0709 13:08:18.281111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.284859 (+  3748us) service_pool.cc:224] Handling call
0709 13:08:18.285248 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:18.285681 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:19.322296 (+1036615us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b180019e700. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f6359a6a3c7 00007f635607c9a7 00007f635608c0bf
0709 13:08:19.322495 (+   199us) log.cc:844] Serialized 14 byte log entry
0709 13:08:19.355254 (+ 32759us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:19.356304 (+  1050us) log.cc:844] Serialized 52 byte log entry
0709 13:08:19.356560 (+   256us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:21.002657 (+1646097us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.128438 (+125781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.128521 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.134151 (+  5630us) raft_consensus.cc:1685] finished
0709 13:08:21.134206 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.134447 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1653899,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":101,"raft.queue_time_us":90164,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":37476,"spinlock_wait_cycles":19562752,"thread_start_us":1852662,"threads_started":4,"wal-append.queue_time_us":14635}
I20260709 13:08:21.390894 21867 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:08:21.392895 21875 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:21.403463 27003 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.404142 27003 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.278375 27791 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.318825 27660 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:21.312285 27743 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.330941 22608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 876) took 1175 ms. Trace:
I20260709 13:08:21.403985 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:21.248401 27835 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.396097 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:21.327293 27832 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.410530 27796 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:21.422215 27796 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:21.423300 27796 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.424072 27832 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.327829 27810 raft_consensus.cc:2764] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:21.421485 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:21.445695 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:21.426753 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:21.429365 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 874) took 1277 ms. Trace:
I20260709 13:08:21.459388 22605 rpcz_store.cc:276] 0709 13:08:20.152418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.152552 (+   134us) service_pool.cc:224] Handling call
0709 13:08:21.429120 (+1276568us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540051f754. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:21.429282 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581098240}
I20260709 13:08:21.389605 27705 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:21.458683 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:21.416522 22608 rpcz_store.cc:276] 0709 13:08:20.155913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.156835 (+   922us) service_pool.cc:224] Handling call
0709 13:08:21.330664 (+1173829us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54006d1d54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:21.330850 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532943232}
I20260709 13:08:21.332783 27306 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:08:21.398994 27700 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:08:21.312361 27659 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.499060 21988 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:21.312299 27639 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:21.312467 27582 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.315651 27803 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.414551 27660 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:21.514634 21770 catalog_manager.cc:5697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 13, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 13 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.446731 27564 raft_consensus.cc:2764] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:08:21.559108 27003 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.504513 27685 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:21.570932 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47721.8us
I20260709 13:08:21.582316 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:21.506181 27836 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:21.505440 27837 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:21.448179 27743 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.648157 27823 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.240954 27834 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:21.584154 21988 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:21.651338 21770 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 15, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 15 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.595902 21873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2460) took 2252 ms. Trace:
I20260709 13:08:21.585282 27829 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:21.609772 27003 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:21.612783 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:21.614494 27582 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.616668 27659 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.617010 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:21.618960 27595 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.526027 27660 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.570130 27699 raft_consensus.cc:2804] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:21.426970 27763 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:21.633003 27803 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.640144 27800 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:21.641251 27714 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.528717 27716 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:21.640309 27639 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:21.645288 21768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 277) took 30300 ms (client timeout 15000 ms). Trace:
I20260709 13:08:21.587448 27685 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:21.647555 27748 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:21.657310 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73316.1us
W20260709 13:08:21.683861 22574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.040s	sys 0.028s
W20260709 13:08:21.684206 22574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.040s	sys 0.028s
I20260709 13:08:21.663515 27306 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:21.652884 21873 rpcz_store.cc:276] 0709 13:08:19.343461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.348156 (+  4695us) service_pool.cc:224] Handling call
0709 13:08:19.348587 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.349076 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.349117 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.349730 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.002212 (+1652482us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:21.002257 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.002344 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.186523 (+184179us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:21.587322 (+400799us) raft_consensus.cc:1685] finished
0709 13:08:21.587346 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.595822 (+  8476us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1422,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":108,"spinlock_wait_cycles":145536256,"thread_start_us":1652022,"threads_started":1,"wal-append.queue_time_us":1573438}
I20260709 13:08:21.685580 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:21.696970 21770 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 14, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.675376 27699 raft_consensus.cc:697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:21.588380 27720 raft_consensus.cc:3060] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:21.671204 21838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.038s	sys 0.046s
W20260709 13:08:21.672425 21947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.029s	sys 0.036s
I20260709 13:08:21.588145 27836 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.657481 27829 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:21.684834 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 837096us
I20260709 13:08:21.648953 27823 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:21.658286 21943 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:08:21.689447 22576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.015s	sys 0.053s
I20260709 13:08:21.734510 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:21.735168 22016 raft_consensus.cc:2376] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18. Re-sending same reply.
I20260709 13:08:21.684309 27685 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.743700 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:21.669927 21869 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:08:21.710342 21838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.038s	sys 0.047s
W20260709 13:08:21.744995 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 783250us
I20260709 13:08:21.699597 27639 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.712479 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:21.715328 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:21.725620 21841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.018s	sys 0.032s
I20260709 13:08:21.733891 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:21.734544 22576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.016s	sys 0.053s
I20260709 13:08:21.738091 27003 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:21.739549 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:21.740228 21874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.011s	sys 0.040s
W20260709 13:08:21.742046 21839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.027s	sys 0.007s
W20260709 13:08:21.703394 27434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.016s	sys 0.022s
W20260709 13:08:21.710497 21947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.029s	sys 0.036s
I20260709 13:08:21.744508 22016 raft_consensus.cc:2376] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18. Re-sending same reply.
I20260709 13:08:21.746222 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:21.699946 27705 consensus_queue.cc:1048] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:21.701336 27835 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:08:21.795694 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.102053 21839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.044s	sys 0.022s
W20260709 13:08:22.102574 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.804163 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.103089 27003 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.827747 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:21.816268 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:22.031658 21950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.013s	sys 0.007s
I20260709 13:08:21.757625 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:22.105279 21950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.018s	sys 0.007s
I20260709 13:08:21.762787 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:21.760267 21989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.009s	sys 0.029s
I20260709 13:08:22.106381 21869 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:22.106436 21989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.019s	sys 0.048s
W20260709 13:08:21.748020 21913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.003s	sys 0.032s
I20260709 13:08:22.103869 27003 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:22.107466 21913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.013s	sys 0.054s
I20260709 13:08:21.833720 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:22.108412 22021 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:22.098515 21946 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.002s	sys 0.028s
W20260709 13:08:22.109089 21946 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.002s	sys 0.028s
I20260709 13:08:22.108935 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:22.098292 21871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.014s	sys 0.015s
I20260709 13:08:22.109892 21949 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
W20260709 13:08:22.110648 21871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.015s	sys 0.015s
I20260709 13:08:21.815896 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:22.101466 21874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.014s	sys 0.063s
I20260709 13:08:22.111562 22605 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:22.112227 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:21.829622 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.113175 21949 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:21.806932 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:21.798961 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:22.114604 22022 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:22.101850 21873 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
W20260709 13:08:22.100617 21841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.018s	sys 0.038s
I20260709 13:08:21.827025 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.116495 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:22.116938 22017 raft_consensus.cc:2368] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:22.117666 21949 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:21.848754 21942 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.016s	sys 0.027s
W20260709 13:08:22.118513 21942 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.022s	sys 0.044s
W20260709 13:08:21.794728 21915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.018s	sys 0.024s
W20260709 13:08:22.119751 21915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.029s	sys 0.039s
W20260709 13:08:21.848555 21872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.017s	sys 0.026s
W20260709 13:08:21.810473 21914 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.007s	sys 0.037s
I20260709 13:08:21.811451 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:21.701562 27428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.015s	sys 0.023s
I20260709 13:08:21.704320 27743 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:21.749253 21770 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:22.120658 21872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.028s	sys 0.038s
W20260709 13:08:22.121043 21914 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.007s	sys 0.060s
W20260709 13:08:22.143324 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 1.19175e+06us
I20260709 13:08:22.145726 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:22.067427 27839 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
W20260709 13:08:22.147401 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 401205us
I20260709 13:08:22.147720 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:22.151621 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2453) took 3757 ms. Trace:
W20260709 13:08:22.152290 21914 leader_election.cc:336] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Timed out: RequestConsensusVote RPC to 127.20.69.1:38039 timed out after 1.595s (SENT)
I20260709 13:08:22.157080 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.157232 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:21.745880 27836 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:22.140014 27428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.016s	sys 0.031s
I20260709 13:08:22.171947 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:21.982331 27791 consensus_meta.cc:287] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.002s
I20260709 13:08:22.158206 22601 raft_consensus.cc:2393] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:22.158764 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:22.157083 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:21.742198 27306 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:21.794837 27830 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:21.858713 27763 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.745457 27829 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.847491 27564 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:22.228075 27660 consensus_meta.cc:287] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.003s
W20260709 13:08:22.228423 27855 log.cc:927] Time spent T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:21.810521 27821 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.177349 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:22.101212 27434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.019s	sys 0.026s
I20260709 13:08:22.179328 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:22.233214 22603 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:22.180966 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.172394 21770 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.215306 22018 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:22.233851 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:22.102407 27582 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:22.120563 27796 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:22.215874 27003 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.179986 27714 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.145931 27724 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.225432 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:22.227281 27716 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.001s
I20260709 13:08:22.229048 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.159829 27693 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.252727 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:22.269735 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 117479us
I20260709 13:08:22.233821 27797 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.284678 22016 raft_consensus.cc:2368] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 11. Current term is 12.
I20260709 13:08:22.290422 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:22.291059 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0312144240000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:08:22.156760 27682 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.252717 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:22.287374 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:22.281584 21944 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:08:22.150192 27847 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:21.747644 27800 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.432s
I20260709 13:08:22.288784 21770 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 12, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 12 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:22.291508 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0015144239999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 13:08:22.292346 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.175205 27848 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:22.171376 27844 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.675843 21768 rpcz_store.cc:269] 0709 13:07:51.345294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.345547 (+   253us) service_pool.cc:224] Handling call
0709 13:08:21.645076 (+30299529us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:13.744965 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:13.745641 (+   676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:13.745697 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:08:13.745723 (+    26us) tablet.cc:662] Decoding operations
0709 13:08:13.748485 (+  2762us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:13.748569 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:13.748633 (+    64us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:08:13.750490 (+  1857us) tablet.cc:701] Row locks acquired
0709 13:08:13.750519 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:08:13.750697 (+   178us) write_op.cc:270] Start()
0709 13:08:13.750844 (+   147us) write_op.cc:276] Timestamp: P: 1783602493750641 usec, L: 0
0709 13:08:13.750885 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:08:13.751812 (+   927us) log.cc:844] Serialized 8861 byte log entry
0709 13:08:14.080483 (+328671us) op_driver.cc:464] REPLICATION: finished
0709 13:08:14.337984 (+257501us) write_op.cc:301] APPLY: starting
0709 13:08:14.338178 (+   194us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:14.518567 (+180389us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:14.518678 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:14.820020 (+301342us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:14.820509 (+   489us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:08:14.820563 (+    54us) write_op.cc:312] APPLY: finished
0709 13:08:14.837630 (+ 17067us) log.cc:844] Serialized 204 byte log entry
0709 13:08:14.837869 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:14.838443 (+   574us) write_op.cc:454] Released schema lock
0709 13:08:14.838522 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:14.838991 (+   469us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:14.839018 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":801,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":257061,"apply.run_cpu_time_us":38036,"apply.run_wall_time_us":501079,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100405,"num_ops":23,"prepare.queue_time_us":328285,"prepare.run_cpu_time_us":22848,"prepare.run_wall_time_us":140196,"raft.queue_time_us":5653,"raft.run_cpu_time_us":2481,"raft.run_wall_time_us":222073,"replication_time_us":329371,"spinlock_wait_cycles":44288,"thread_start_us":429558,"threads_started":4,"wal-append.queue_time_us":195072,"wal-append.run_cpu_time_us":16226,"wal-append.run_wall_time_us":2871467}]]}
I20260709 13:08:22.316998 27844 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.297178 22018 raft_consensus.cc:2410] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:22.297050 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:21.794399 27659 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.405s
I20260709 13:08:22.298877 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:22.191361 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.322834 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 859) took 2393 ms. Trace:
I20260709 13:08:22.138227 27639 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.315114 22605 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
I20260709 13:08:22.316133 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.328008 22016 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:22.315716 21770 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 14, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.842681 27699 consensus_queue.cc:237] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.319742 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.330152 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.331449 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:22.332160 22018 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:22.266968 21841 connection.cc:256] RPC call timeout handler was delayed by -1.3052133350000759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 13:08:22.323257 21947 rpcz_store.cc:276] 0709 13:08:19.929302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.039766 (+1110464us) service_pool.cc:224] Handling call
0709 13:08:21.066632 (+ 26866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.147931 (+ 81299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.147965 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.148450 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.105934 (+957484us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:22.105972 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.137276 (+ 31304us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b54000fd554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:22.137354 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.313548 (+176194us) raft_consensus.cc:1685] finished
0709 13:08:22.313585 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.322776 (+  9191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3080,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"spinlock_wait_cycles":186035072,"thread_start_us":957075,"threads_started":1,"wal-append.queue_time_us":687424}
I20260709 13:08:22.332684 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:22.250442 27434 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:22.253443 27306 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:22.180359 27428 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:22.254413 27595 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:22.228278 27564 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.327100 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.332587 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.231017 27748 consensus_queue.cc:1059] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:08:22.284540 27714 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.229561 27821 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.180377 27743 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.345127 21869 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
W20260709 13:08:22.356086 21870 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.010s
W20260709 13:08:22.459851 21870 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.007s	sys 0.010s
W20260709 13:08:22.356498 22604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.013s
W20260709 13:08:22.460592 22604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.006s	sys 0.013s
W20260709 13:08:22.356992 22609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.005s	sys 0.012s
W20260709 13:08:22.461508 22609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.006s	sys 0.012s
I20260709 13:08:22.291319 22022 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:22.303865 22021 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:22.300872 27682 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.299542 27693 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:22.410116 22573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.057s	sys 0.081s
I20260709 13:08:22.480358 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:22.480873 22573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.057s	sys 0.081s
I20260709 13:08:22.413501 21770 catalog_manager.cc:5697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 15, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 15 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.414495 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.234428 27830 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.327581 27852 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.290653 27796 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:22.357795 27811 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.017s
I20260709 13:08:22.153973 21872 rpcz_store.cc:276] 0709 13:08:18.394230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.395005 (+   775us) service_pool.cc:224] Handling call
0709 13:08:18.418319 (+ 23314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.494945 (+ 76626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.495010 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.613325 (+118315us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.281127 (+667802us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b48000801d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:08:19.934915 (+653788us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:21.011103 (+1076188us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.142806 (+1131703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.142937 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.142994 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:22.151373 (+  8379us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.151552 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100349,"prepare.queue_time_us":1106034,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":51,"raft.queue_time_us":161569,"raft.run_cpu_time_us":1833,"raft.run_wall_time_us":778487,"spinlock_wait_cycles":77681920,"thread_start_us":3141565,"threads_started":3,"wal-append.queue_time_us":1519657,"wal-append.run_cpu_time_us":23971,"wal-append.run_wall_time_us":1898239}
I20260709 13:08:22.451818 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:22.457607 21946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2773) took 2893 ms. Trace:
I20260709 13:08:22.471191 22015 raft_consensus.cc:2410] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:22.291574 27582 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.541797 21946 rpcz_store.cc:276] 0709 13:08:19.564272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.014062 (+1449790us) service_pool.cc:224] Handling call
0709 13:08:21.014464 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.217021 (+202557us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:22.109715 (+892694us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.423363 (+313648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.423423 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:22.423476 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.457257 (+ 33781us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540019d054. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:22.457326 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.457521 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":854868,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":1999,"spinlock_wait_cycles":465119616,"thread_start_us":1205601,"threads_started":2}
I20260709 13:08:22.482650 27838 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.473860 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:22.564378 22022 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.228570 27660 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.475752 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.408567 27651 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:22.408183 27803 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:22.301939 27797 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:22.485486 21914 connection.cc:256] RPC call timeout handler was delayed by -1.3742328710000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28340000000000004s for a response
W20260709 13:08:22.578233 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2951585009999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:08:22.334074 21841 connection.cc:256] RPC call timeout handler was delayed by -1.2656133350001255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:08:22.579414 21841 leader_election.cc:336] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.539s (SENT)
I20260709 13:08:22.472280 27743 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.509763 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.325980 27848 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:22.593008 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.593221 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.541761 22023 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.472834 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.594538 22021 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:22.595240 22605 raft_consensus.cc:1240] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:22.544335 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.418444 27595 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.602149 27595 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:22.540223 27811 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.000s	sys 0.018s
I20260709 13:08:22.602532 27823 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:22.580235 21841 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.625s (SENT)
W20260709 13:08:22.603628 27837 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.955s	user 0.009s	sys 0.002s
I20260709 13:08:22.604086 27837 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:22.481734 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:22.580348 22606 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.605063 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:22.593708 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.531632 21770 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 16, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 16 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:22.596760 22602 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:22.595526 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.567746 27863 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:22.598273 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.612486 27796 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.625458 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.583436 27428 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.626507 22602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.627250 22610 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:22.628526 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.629812 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.630298 27564 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:22.630431 27797 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.630929 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.631549 22021 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:22.632164 27582 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.613286 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.633561 22017 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:22.633692 27693 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:22.624147 27743 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.634479 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:22.615160 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.635249 22017 raft_consensus.cc:2393] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 18: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:22.635378 22605 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:22.635660 27714 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.636117 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.617511 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.637212 27682 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.637760 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.575835 27834 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.637303 21770 catalog_manager.cc:5697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 14, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.638403 27834 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.639147 22015 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:22.639509 21770 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:22.641130 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 159503us
I20260709 13:08:22.642717 27859 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:22.621616 27821 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.644919 27863 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.649821 27830 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.651070 27863 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:22.640368 22015 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:08:22.652899 27848 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.653056 21770 catalog_manager.cc:5697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 10, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:22.655035 22015 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:22.648917 27859 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.664170 27859 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.561591 27434 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.664649 22016 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:22.655249 21770 catalog_manager.cc:5697] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:22.571707 27838 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.656421 22017 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:22.656818 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.565250 27694 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.657191 27639 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.585172 27803 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.656430 27829 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.612386 22606 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
W20260709 13:08:22.624024 27845 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:08:22.573213 27724 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:22.530009 27852 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:22.662936 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.662976 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:22.646193 22023 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:22.695039 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:22.574505 27306 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:22.674393 21869 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:22.683277 22017 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:22.591017 27844 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.591536 27849 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:22.683049 22018 raft_consensus.cc:2410] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:08:22.682049 27720 consensus_meta.cc:287] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.940s	user 0.009s	sys 0.002s
W20260709 13:08:22.682775 22576 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.046s
I20260709 13:08:22.689242 21770 catalog_manager.cc:5697] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 7, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 7 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:22.659062 27660 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:22.640384 27834 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:22.692272 22022 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
W20260709 13:08:22.721575 22576 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.007s	sys 0.046s
W20260709 13:08:22.690671 27685 consensus_meta.cc:287] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.874s	user 0.011s	sys 0.000s
I20260709 13:08:22.726840 22021 raft_consensus.cc:1240] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:22.727175 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 618750us
W20260709 13:08:22.728717 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.732307 21987 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.020s	sys 0.023s
W20260709 13:08:22.733059 21987 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.021s	sys 0.023s
I20260709 13:08:22.733232 22015 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:08:22.733381 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 611980us
W20260709 13:08:22.680686 27842 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.011s	sys 0.033s
I20260709 13:08:22.773379 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:22.774770 27842 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.011s	sys 0.033s
I20260709 13:08:22.777478 21947 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:22.777141 21770 catalog_manager.cc:5697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.774887 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:22.782166 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:22.794121 21873 raft_consensus.cc:2468] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:22.780055 21946 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:22.797962 21770 catalog_manager.cc:5697] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:22.696930 27724 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.689021 27694 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.727576 27847 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:22.818605 21770 catalog_manager.cc:5697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 13, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 13 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:22.775272 27685 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.844969 21770 catalog_manager.cc:5697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:22.856940 21874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2951) took 3330 ms. Trace:
I20260709 13:08:22.860879 21770 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.727504 27849 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.855811 27748 consensus_queue.cc:1243] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer bcc802f7bc374bed98e2ee0596a8ebda log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:22.857587 21874 rpcz_store.cc:276] 0709 13:08:19.526722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.626076 (+ 99354us) service_pool.cc:224] Handling call
0709 13:08:19.626536 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.993016 (+1366480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.993052 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.993531 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.111762 (+1118231us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:22.565922 (+454160us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.856462 (+290540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.856579 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.856660 (+    81us) raft_consensus.cc:1685] finished
0709 13:08:22.856681 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.856865 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56194,"prepare.queue_time_us":478894,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":300797,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":50863,"thread_start_us":3129055,"threads_started":4,"wal-append.queue_time_us":1122818}
W20260709 13:08:22.873582 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 400979us
I20260709 13:08:22.843961 27366 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:22.869335 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:22.869459 22019 raft_consensus.cc:1240] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:22.881757 21942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2772) took 3326 ms. Trace:
I20260709 13:08:22.881910 21770 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.891413 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:22.892335 21946 raft_consensus.cc:2410] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:08:22.823791 27876 consensus_queue.cc:1048] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:08:22.882474 21942 rpcz_store.cc:276] 0709 13:08:19.555710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.011502 (+1455792us) service_pool.cc:224] Handling call
0709 13:08:21.041014 (+ 29512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.041290 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:22.119036 (+1077746us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.881250 (+762214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.881329 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:22.881398 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.881491 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.881668 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":978516,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":74625,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":1804407,"threads_started":3,"wal-append.queue_time_us":736274}
I20260709 13:08:22.901944 21947 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:22.904250 21770 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 10, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 10 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.858409 27834 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 13:08:22.908560 21838 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.002s	sys 0.026s
W20260709 13:08:22.908980 21838 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.002s	sys 0.026s
W20260709 13:08:22.909329 21838 connection.cc:256] RPC call timeout handler was delayed by -2.8613459410000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 13:08:22.915943 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 336135us
I20260709 13:08:22.917310 21946 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:08:22.904021 27872 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:22.922127 27873 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:08:22.937322 27871 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:08:22.900238 27366 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:22.921267 27748 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:22.905743 27847 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:22.973425 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 51646.2us
W20260709 13:08:22.977157 21871 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.011s	sys 0.009s
I20260709 13:08:22.995375 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:23.008530 21871 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.011s	sys 0.009s
W20260709 13:08:23.006222 21838 leader_election.cc:336] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.150s (SENT)
W20260709 13:08:23.187916 21914 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.018s	sys 0.050s
W20260709 13:08:23.495963 21914 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.053s	sys 0.080s
I20260709 13:08:23.015021 22609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 880) took 1266 ms. Trace:
I20260709 13:08:23.367034 22015 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:23.496492 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 917679us
I20260709 13:08:23.110128 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2472) took 1373 ms. Trace:
I20260709 13:08:23.330888 21872 raft_consensus.cc:3055] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:23.495522 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:23.138983 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2475) took 1401 ms. Trace:
I20260709 13:08:23.188984 22607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 1145) took 1085 ms. Trace:
I20260709 13:08:23.069540 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.137676 21871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 2964) took 2306 ms. Trace:
W20260709 13:08:23.016801 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 412396us
W20260709 13:08:23.499109 21914 connection.cc:256] RPC call timeout handler was delayed by -1.2645585010000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:08:23.233664 21866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.021s
W20260709 13:08:23.501085 21866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.018s	sys 0.029s
I20260709 13:08:23.499032 21872 raft_consensus.cc:740] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:23.110720 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:23.501924 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2476) took 1747 ms. Trace:
I20260709 13:08:23.502313 21866 rpcz_store.cc:276] 0709 13:08:21.755125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.319907 (+564782us) service_pool.cc:224] Handling call
0709 13:08:22.320193 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.320422 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:22.693524 (+373102us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.501616 (+808092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:23.501669 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:23.501717 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.501774 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.501872 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":339512,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":1169352,"threads_started":2}
W20260709 13:08:23.197271 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 131553us
I20260709 13:08:23.125124 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:22.973791 27872 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:23.340495 22576 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.495452 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.025180 21988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.002s	sys 0.022s
I20260709 13:08:23.504547 22574 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:23.501228 21914 connection.cc:256] RPC call timeout handler was delayed by -1.1984847430001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33290000000000003s for a response
I20260709 13:08:23.497716 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:23.498517 21867 rpcz_store.cc:276] 0709 13:08:21.737048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.298386 (+561338us) service_pool.cc:224] Handling call
0709 13:08:22.301348 (+  2962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.301559 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:22.695772 (+394213us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.138266 (+442494us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:23.138342 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:23.138409 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.138755 (+   346us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.138902 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50645,"prepare.queue_time_us":358124,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":98040,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":770769,"threads_started":2}
W20260709 13:08:23.493500 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.010690 21946 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:08:23.502337 21841 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.777s (SENT)
I20260709 13:08:23.499778 21871 rpcz_store.cc:276] 0709 13:08:20.831329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.236479 (+405150us) service_pool.cc:224] Handling call
0709 13:08:21.239315 (+  2836us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:21.319005 (+ 79690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.319054 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:21.381595 (+ 62541us) log.cc:844] Serialized 52 byte log entry
0709 13:08:22.111150 (+729555us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:23.009577 (+898427us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.113600 (+104023us) log.cc:844] Serialized 14 byte log entry
0709 13:08:23.137236 (+ 23636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.137345 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.137401 (+    56us) raft_consensus.cc:1685] finished
0709 13:08:23.137419 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.137601 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15183,"prepare.queue_time_us":431614,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":97,"raft.queue_time_us":93290,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":54149,"thread_start_us":1529759,"threads_started":2,"wal-append.queue_time_us":683381}
I20260709 13:08:23.563236 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:23.563825 21914 connection.cc:256] RPC call timeout handler was delayed by -1.120558501000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 13:08:23.346949 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:23.564705 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.010s	sys 0.053s
W20260709 13:08:23.564384 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.566056 21914 connection.cc:256] RPC call timeout handler was delayed by -1.0152585009999484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:08:23.567806 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.567857 21947 raft_consensus.cc:1240] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:23.568089 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.568648 21945 raft_consensus.cc:2410] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:08:23.568760 21874 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:23.570122 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.570286 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.570572 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.571211 21941 raft_consensus.cc:2410] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:23.573392 21948 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:08:23.480868 27856 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.908s	user 0.003s	sys 0.001s
I20260709 13:08:23.583264 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:23.491997 27867 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.897s	user 0.004s	sys 0.000s
I20260709 13:08:23.574412 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:23.584172 21941 raft_consensus.cc:2393] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 17: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:23.575241 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 1.34517e+06us
W20260709 13:08:23.576617 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.576951 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:23.517058 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:23.577236 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72797.1us
I20260709 13:08:23.578083 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:23.497602 21870 rpcz_store.cc:276] 0709 13:08:21.736210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.737229 (+  1019us) service_pool.cc:224] Handling call
0709 13:08:21.796542 (+ 59313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.797077 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:22.460362 (+663285us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.846372 (+386010us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.846986 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.847171 (+   185us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:22.847465 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.847654 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.847738 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.109846 (+262108us) raft_consensus.cc:1685] finished
0709 13:08:23.109873 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.110047 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28005,"prepare.queue_time_us":733264,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":100,"raft.queue_time_us":557,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":10085,"thread_start_us":943125,"threads_started":2,"wal-append.queue_time_us":623624}
I20260709 13:08:23.496620 22609 rpcz_store.cc:276] 0709 13:08:21.748508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.748678 (+   170us) service_pool.cc:224] Handling call
0709 13:08:21.815073 (+ 66395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.461951 (+646878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.461997 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.475448 (+ 13451us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.842563 (+367115us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:22.842630 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.842737 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.014750 (+172013us) raft_consensus.cc:1685] finished
0709 13:08:23.014778 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.014948 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45725,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":120,"thread_start_us":936673,"threads_started":2,"wal-append.queue_time_us":499145}
W20260709 13:08:22.996367 27836 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.780s	user 0.014s	sys 0.000s
I20260709 13:08:23.498665 22607 rpcz_store.cc:276] 0709 13:08:22.103601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.103727 (+   126us) service_pool.cc:224] Handling call
0709 13:08:22.104117 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.104442 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.104471 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.145260 (+ 40789us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.482451 (+337191us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:22.482487 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.482551 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.188746 (+706195us) raft_consensus.cc:1685] finished
0709 13:08:23.188774 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.188926 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":504,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":25423,"thread_start_us":336782,"threads_started":1,"wal-append.queue_time_us":578824}
W20260709 13:08:23.580479 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 78174.3us
W20260709 13:08:23.587188 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70225.4us
W20260709 13:08:23.352901 27842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.000s	sys 0.011s
I20260709 13:08:23.593454 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.162503 27838 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:23.025662 27875 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.137s	user 0.000s	sys 0.004s
I20260709 13:08:23.504828 27852 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:23.517724 27434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.010s	sys 0.010s
I20260709 13:08:23.344811 27685 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:23.592020 21916 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:23.024490 27869 log.cc:927] Time spent T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.208s	user 0.000s	sys 0.007s
W20260709 13:08:23.014604 27865 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.432s	user 0.002s	sys 0.000s
W20260709 13:08:23.592254 21841 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.836s (SENT)
I20260709 13:08:23.591727 27860 raft_consensus.cc:2804] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:23.594231 21945 raft_consensus.cc:2393] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:23.574777 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.594792 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.585544 21987 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:23.589875 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.587029 27694 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:23.493093 27829 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:23.634131 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.597667 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:23.025354 27880 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.132s	user 0.000s	sys 0.007s
I20260709 13:08:23.603215 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:23.591420 27847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.034s	sys 0.042s
I20260709 13:08:23.582279 27872 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:23.599700 27842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.000s	sys 0.018s
W20260709 13:08:23.136765 27428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.024s	sys 0.029s
I20260709 13:08:23.662918 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.663669 21946 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:23.665076 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.665692 21944 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
W20260709 13:08:23.613072 21841 connection.cc:256] RPC call timeout handler was delayed by -1.0955133350000779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 13:08:23.012292 27881 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.592s
I20260709 13:08:23.611519 27863 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:23.637014 27847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.034s	sys 0.042s
I20260709 13:08:23.586313 27891 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:23.689936 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:23.607159 27434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.010s	sys 0.010s
I20260709 13:08:23.588120 27885 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.694187 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:23.694921 21841 connection.cc:256] RPC call timeout handler was delayed by -1.5418236690001095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3421s for a response
I20260709 13:08:23.593318 27899 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.584848 27893 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.617542 21948 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:23.635443 21941 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
W20260709 13:08:23.638346 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 632124us
I20260709 13:08:23.024756 27748 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:23.664546 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:23.692236 27875 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:23.585139 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:23.613916 27803 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:23.623471 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.685045 27849 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:23.672735 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.706642 21944 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
I20260709 13:08:23.678083 22019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 775) took 1966 ms. Trace:
I20260709 13:08:23.600183 27836 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:23.627801 27685 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.688179 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.707360 22019 rpcz_store.cc:276] 0709 13:08:21.711753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.711893 (+   140us) service_pool.cc:224] Handling call
0709 13:08:21.712188 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.881443 (+1169255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.677670 (+796227us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003ca0d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:23.677970 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2660940672}
I20260709 13:08:23.562207 27660 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:08:23.708766 22604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 881) took 1945 ms. Trace:
I20260709 13:08:23.709165 22604 rpcz_store.cc:276] 0709 13:08:21.763800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.763999 (+   199us) service_pool.cc:224] Handling call
0709 13:08:21.764435 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.768613 (+  4178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.768656 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.810897 (+ 42241us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.461118 (+650221us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:22.461180 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.461276 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.014034 (+552758us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:23.704663 (+690629us) raft_consensus.cc:1685] finished
0709 13:08:23.704685 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.708700 (+  4015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3607,"raft.queue_time_us":30157,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":4811,"spinlock_wait_cycles":449156352,"thread_start_us":622303,"threads_started":1,"wal-append.queue_time_us":644619}
I20260709 13:08:23.706175 21947 raft_consensus.cc:2468] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
W20260709 13:08:23.668850 27428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.039s	sys 0.099s
I20260709 13:08:23.692883 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35490 (request call id 865) took 2371 ms. Trace:
W20260709 13:08:23.696621 21841 leader_election.cc:336] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.012s (SENT)
I20260709 13:08:23.627024 27886 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:08:23.699928 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.701961 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.718839 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.703624 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.703240 21870 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:23.623327 27852 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:23.705379 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.614138 27864 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:08:23.729338 21946 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:08:23.707820 21869 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:23.688905 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:23.713728 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 128683us
I20260709 13:08:23.716656 21841 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:23.683820 27863 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:23.698729 27899 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.719750 21947 raft_consensus.cc:2410] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:08:23.720523 27724 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.004s
I20260709 13:08:23.731244 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:23.716320 21950 rpcz_store.cc:276] 0709 13:08:21.322030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.322183 (+   153us) service_pool.cc:224] Handling call
0709 13:08:21.394010 (+ 71827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.394509 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.394552 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.420528 (+ 25976us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.105935 (+685407us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:22.106012 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.106081 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.295673 (+1189592us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:23.683780 (+388107us) raft_consensus.cc:1685] finished
0709 13:08:23.683805 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.692796 (+  8991us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":15472,"spinlock_wait_cycles":462253952,"thread_start_us":591514,"threads_started":1,"wal-append.queue_time_us":971917}
I20260709 13:08:23.714413 27685 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.693502 27693 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:23.734951 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:23.743242 21944 raft_consensus.cc:2410] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:23.703783 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.736653 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.739692 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.740459 22608 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:23.740747 27895 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.716526 27803 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.716941 27434 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.744500 21947 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:23.741353 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44790.9us
I20260709 13:08:23.752825 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.753906 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:23.720258 27881 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.743897 21867 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:23.695724 27891 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:23.756652 27428 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:23.737825 27899 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:23.760133 27903 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:23.761358 21949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2785) took 1544 ms. Trace:
I20260709 13:08:23.761725 21949 rpcz_store.cc:276] 0709 13:08:22.216779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.220229 (+  3450us) service_pool.cc:224] Handling call
0709 13:08:22.220721 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.698052 (+477331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.698083 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.726655 (+ 28572us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.227775 (+501120us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:23.227817 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.229991 (+  2174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.761152 (+531161us) raft_consensus.cc:1685] finished
0709 13:08:23.761173 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.761302 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2207,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":897558,"threads_started":2,"wal-append.queue_time_us":904941}
I20260709 13:08:23.735468 27842 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:23.724225 27849 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:23.763207 27842 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.718556 27838 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:23.773095 21872 consensus_queue.cc:260] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:23.799727 21872 raft_consensus.cc:3060] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:23.752980 21841 leader_election.cc:336] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.201s (SENT)
I20260709 13:08:23.719161 27885 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.728961 27852 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.773011 27836 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:23.755295 27864 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.776262 21949 pending_rounds.cc:85] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 12
I20260709 13:08:23.750922 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:23.803217 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50262.2us
I20260709 13:08:23.807412 21873 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:23.743065 27685 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:23.818485 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.810824 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:23.811074 27748 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:23.811643 22604 raft_consensus.cc:1217] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Deduplicated request from leader. Original: 12.12->[14.13-14.13]   Dedup: 14.13->[]
I20260709 13:08:23.821568 22604 raft_consensus.cc:1240] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:08:23.813218 22609 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:23.808697 27852 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:23.816483 21949 pending_rounds.cc:107] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:08:23.832310 21949 raft_consensus.cc:2889] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:23.827247 27863 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:23.793022 27842 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:23.745565 27724 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:23.858242 21841 connection.cc:256] RPC call timeout handler was delayed by -1.1218436220000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 13:08:23.858656 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 107902us
I20260709 13:08:23.859874 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 1032) took 1692 ms. Trace:
I20260709 13:08:23.866127 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:23.862658 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 226194us
W20260709 13:08:23.880446 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 49339.4us
W20260709 13:08:23.876783 27699 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.266s	user 0.009s	sys 0.010s
I20260709 13:08:23.815755 27428 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:23.898200 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 199277us
I20260709 13:08:23.891911 27896 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:23.758329 27803 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:23.758316 27881 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:23.821038 27864 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:23.883217 27823 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:08:23.887802 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2470) took 2152 ms. Trace:
I20260709 13:08:23.911505 21868 rpcz_store.cc:276] 0709 13:08:21.735651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.749419 (+ 13768us) service_pool.cc:224] Handling call
0709 13:08:21.749864 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.750286 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:22.093171 (+342885us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.894583 (+801412us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.895334 (+   751us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.899121 (+  3787us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.899315 (+   194us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:22.899363 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.899468 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:23.887515 (+988047us) raft_consensus.cc:1685] finished
0709 13:08:23.887547 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.887724 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46550,"prepare.queue_time_us":728044,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":5644,"raft.queue_time_us":85739,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":21060,"thread_start_us":967561,"threads_started":3,"wal-append.queue_time_us":683960}
I20260709 13:08:23.806617 27838 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:23.911175 27864 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.898459 27925 consensus_queue.cc:1059] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:23.899305 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:23.836886 27895 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:23.865057 27836 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:23.905861 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:23.896793 27859 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 1.232s	user 0.014s	sys 0.002s
I20260709 13:08:23.916965 21870 raft_consensus.cc:2410] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:08:23.898365 27876 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:23.903412 27857 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 1.337s	user 0.004s	sys 0.000s
W20260709 13:08:23.897097 27699 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.010s	sys 0.010s
I20260709 13:08:23.935554 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:23.933347 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:23.939776 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:23.926961 27905 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:08:23.969866 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 22 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:23.936439 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:23.808377 27885 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:23.961323 21841 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:23.943190 27927 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:08:23.950520 27800 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.297s	user 0.020s	sys 0.002s
I20260709 13:08:23.926333 27918 raft_consensus.cc:3055] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:23.942183 27896 raft_consensus.cc:2764] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:23.928252 27891 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:23.916412 27838 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:23.939117 27836 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:23.998224 27800 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.350s	user 0.020s	sys 0.002s
I20260709 13:08:24.003942 21841 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:23.984362 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 51079.3us
I20260709 13:08:23.903256 27428 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:23.941928 27876 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:23.917774 27849 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
W20260709 13:08:24.037737 21838 leader_election.cc:336] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.884s (SENT)
I20260709 13:08:24.038393 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:23.940523 27920 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:24.022970 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:24.000823 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 108766us
I20260709 13:08:24.046478 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:23.997730 27908 log.cc:927] Time spent T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:08:23.913015 27926 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:08:24.001539 27699 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:23.996959 27848 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.002530 27918 raft_consensus.cc:740] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:23.947381 27859 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.048234 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:23.942363 27895 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:23.979836 27748 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:08:24.027336 27836 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.026592 27910 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.028327 27434 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.020526 27899 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.026073 27835 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:24.040699 27876 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.035226 27891 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:24.069877 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.073892 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 179536us
I20260709 13:08:24.051424 27838 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.988266 27934 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:24.132048 21945 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:24.126081 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 74659.2us
I20260709 13:08:24.105633 27860 raft_consensus.cc:697] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:24.141198 27934 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:24.166224 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 118087us
I20260709 13:08:24.061853 27930 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:08:24.098486 27925 consensus_queue.cc:1059] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:24.063007 27909 consensus_queue.cc:1059] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:08:24.155097 27699 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:24.116137 27931 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:24.181663 27724 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.191910 27938 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.192659 27938 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.195322 27938 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.196776 27699 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.200960 27595 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:24.201488 27595 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:24.202503 27595 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.203359 27852 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.204087 27595 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.183140 27918 consensus_queue.cc:260] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.206177 27918 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.106773 27910 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.110853 27434 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.180814 27934 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:24.116914 27835 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.242879 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:24.243213 27947 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.260411 22018 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:24.129348 27685 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.200309 27864 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.275441 22015 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:24.274010 21838 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.040s (SENT)
I20260709 13:08:24.290503 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:24.233438 27803 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:24.243314 27940 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.241616 27852 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:24.279228 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.233973 27948 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.244237 27428 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:24.277333 22018 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
W20260709 13:08:24.322427 21838 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.073s (SENT)
W20260709 13:08:24.336028 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 157422us
W20260709 13:08:24.357455 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 329216us
W20260709 13:08:24.359086 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.326184 27910 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:24.358486 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:24.322264 27944 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.336369 27885 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.359018 27803 raft_consensus.cc:3055] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:08:24.385053 27872 consensus_meta.cc:287] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
I20260709 13:08:24.383494 27934 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.393025 27872 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.394819 27926 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.395085 27872 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:24.386054 27859 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.306845 27940 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.388073 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:24.303432 27860 consensus_queue.cc:237] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.357712 27953 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.406626 27899 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:24.546238 22020 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43308 (request call id 3305) took 4622 ms (client timeout 2035 ms). Trace:
W20260709 13:08:24.546720 22020 rpcz_store.cc:269] 0709 13:08:19.923890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.948028 (+ 24138us) service_pool.cc:224] Handling call
0709 13:08:24.545989 (+4597961us) spinlock_profiling.cc:243] Waited 2.78 s on lock 0x7b5400199e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:24.546128 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6400289024}
I20260709 13:08:24.547461 27940 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:24.548379 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 160379us
W20260709 13:08:24.549427 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 209201us
W20260709 13:08:24.525803 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 179924us
I20260709 13:08:24.457131 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 1042) took 2225 ms. Trace:
W20260709 13:08:24.527952 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 385434us
I20260709 13:08:24.551270 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:24.437937 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:24.440140 22608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 878) took 2724 ms (client timeout 1909 ms). Trace:
I20260709 13:08:24.552223 21875 rpcz_store.cc:276] 0709 13:08:22.231231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.663770 (+432539us) service_pool.cc:224] Handling call
0709 13:08:22.664124 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.690088 (+ 25964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.690135 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.693243 (+  3108us) log.cc:844] Serialized 26 byte log entry
0709 13:08:23.243521 (+550278us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:23.243623 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.456765 (+1213142us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b540044fa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:24.456807 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:24.456848 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:24.456861 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.457065 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1454,"raft.queue_time_us":160,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5515,"spinlock_wait_cycles":58246912,"thread_start_us":463994,"threads_started":1,"wal-append.queue_time_us":896474}
W20260709 13:08:24.556576 22608 rpcz_store.cc:269] 0709 13:08:21.716085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.717413 (+  1328us) service_pool.cc:224] Handling call
0709 13:08:24.439797 (+2722384us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400685454. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:24.439992 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3759566208}
W20260709 13:08:24.474607 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.412160 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.557495 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 99586us
I20260709 13:08:24.456962 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:24.440727 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:24.417438 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:24.563724 22017 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.448803 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:24.437188 27842 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.004s
I20260709 13:08:24.407970 27434 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:24.566303 27842 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.566720 27955 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.408725 27685 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:24.567592 22022 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 22: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:24.392285 27803 raft_consensus.cc:740] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:24.568368 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:24.569195 27842 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:24.569242 27955 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:24.427552 27836 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.570597 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:24.415867 27926 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.527948 27920 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:24.583202 27920 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.585908 27920 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:24.405659 27901 log.cc:927] Time spent T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.735s	user 0.002s	sys 0.000s
W20260709 13:08:24.403203 27892 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.629s	user 0.001s	sys 0.002s
I20260709 13:08:24.582768 27953 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.583993 27955 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:24.569114 27803 consensus_queue.cc:260] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.588274 27800 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:08:24.396479 27864 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:24.566138 27899 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:24.401587 27835 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:24.453182 27895 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.434783 27881 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.606091 27836 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.614990 27803 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.617587 27849 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:24.618137 27849 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:24.619114 27849 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.621066 27917 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:24.621603 27917 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:24.622073 27714 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:24.622615 27714 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:24.622664 27917 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.625602 27939 raft_consensus.cc:3055] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:24.626154 27939 raft_consensus.cc:740] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:24.626609 27366 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.627193 27939 consensus_queue.cc:260] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:24.628454 27904 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.893s	user 0.001s	sys 0.001s
I20260709 13:08:24.623817 27714 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.630596 27934 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:24.631590 27714 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:24.633589 27898 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.932s	user 0.002s	sys 0.000s
I20260709 13:08:24.528944 27943 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 13:08:24.624584 27917 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.638429 27849 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:24.722404 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:24.724560 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:24.727834 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.729203 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:24.799357 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 70610.2us
I20260709 13:08:24.801326 27886 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:24.802132 27886 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:24.802614 27886 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:24.803926 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:08:24.730595 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.804250 27934 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:24.806044 27934 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:24.647037 27939 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.806879 27934 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:24.808872 27934 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.811142 27934 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:24.811792 27876 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
W20260709 13:08:24.743825 21841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.001s	sys 0.010s
W20260709 13:08:24.812916 21841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.001s	sys 0.010s
I20260709 13:08:24.812682 27876 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:24.755599 21948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.000s	sys 0.019s
W20260709 13:08:24.813494 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 758042us
I20260709 13:08:24.814621 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:24.817267 27965 raft_consensus.cc:2764] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:24.821884 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:24.744344 21866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.003s	sys 0.011s
W20260709 13:08:24.824196 21866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.003s	sys 0.012s
I20260709 13:08:24.760042 21943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2779) took 2631 ms. Trace:
I20260709 13:08:24.826390 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:24.824848 21943 rpcz_store.cc:276] 0709 13:08:22.128957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.129140 (+   183us) service_pool.cc:224] Handling call
0709 13:08:22.165550 (+ 36410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.537997 (+372447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.538051 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.538686 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.978989 (+440303us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:22.979028 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.979096 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:24.402542 (+1423446us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:24.759291 (+356749us) raft_consensus.cc:1685] finished
0709 13:08:24.759329 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.759777 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57204,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":16251264,"thread_start_us":768514,"threads_started":2,"wal-append.queue_time_us":1144274}
I20260709 13:08:24.827440 21866 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:24.765111 21874 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:24.766181 27977 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:08:24.758673 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 186451us
I20260709 13:08:24.412588 21916 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:24.829375 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:24.829727 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 417056us
I20260709 13:08:24.830416 21874 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:24.767289 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 200872us
I20260709 13:08:23.865895 21872 rpcz_store.cc:276] 0709 13:08:22.167126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.541000 (+373874us) service_pool.cc:224] Handling call
0709 13:08:22.541326 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.330774 (+789448us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54002934a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355fe9dc0 00007f63560741c0 00007f6356075231 00007f6356071d8f 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c
0709 13:08:23.772775 (+442001us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b54002934a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6355ff006f 00007f6356068f60 00007f635606a7de 00007f6356074b49 00007f6356075416 00007f6356071d8f 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62
0709 13:08:23.859223 (+ 86448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:23.859267 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:23.859422 (+   155us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:23.859472 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:23.859636 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:23.859801 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23245,"raft.queue_time_us":30117,"spinlock_wait_cycles":793965824}
I20260709 13:08:24.833139 27933 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:24.834041 27933 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:24.835597 27933 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:24.768260 27953 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:24.836915 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:24.773933 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:24.838093 22018 raft_consensus.cc:1275] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:24.765115 27743 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.839680 27743 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:24.788131 27859 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.842437 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:24.843122 27743 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:24.842947 27859 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:24.788985 22024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 1977) took 3049 ms (client timeout 1961 ms). Trace:
I20260709 13:08:24.793126 21868 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:24.596434 22016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.003s	sys 0.006s
I20260709 13:08:24.806301 27306 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.813031 21867 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
W20260709 13:08:24.813710 21948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.000s	sys 0.020s
W20260709 13:08:24.757941 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 184794us
I20260709 13:08:24.775954 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:24.846621 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:24.838049 22015 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
W20260709 13:08:24.846589 22024 rpcz_store.cc:269] 0709 13:08:21.739367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.813835 (+ 74468us) service_pool.cc:224] Handling call
0709 13:08:24.788253 (+2974418us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001f04d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:24.788571 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4051155200}
W20260709 13:08:24.885388 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.893391 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:24.894291 21950 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:24.895632 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:24.897817 27899 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:24.898643 27899 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:24.909885 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:24.910006 27306 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:24.912057 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.913846 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 110226us
I20260709 13:08:24.913693 27743 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:24.917873 22016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.004s	sys 0.006s
I20260709 13:08:24.932827 21948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2793) took 1313 ms. Trace:
I20260709 13:08:24.933328 21948 rpcz_store.cc:276] 0709 13:08:23.619748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.731331 (+111583us) service_pool.cc:224] Handling call
0709 13:08:23.738133 (+  6802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.738326 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:23.814197 (+ 75871us) log.cc:844] Serialized 14 byte log entry
0709 13:08:24.932120 (+1117923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:24.932254 (+   134us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:24.932469 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.932551 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:24.932745 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25199,"prepare.queue_time_us":75837,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":163483,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":14095,"thread_start_us":1108577,"threads_started":3,"wal-append.queue_time_us":579189}
W20260709 13:08:24.942379 27983 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:08:24.944566 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:24.953277 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.964394 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.948618 21875 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:24.980041 21874 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:24.978941 22015 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:24.985323 21873 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:24.949429 27876 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:24.948216 27306 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:24.990835 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 70249.7us
I20260709 13:08:24.900215 27899 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:25.041900 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:25.045338 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 88352.8us
I20260709 13:08:25.048489 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:25.054548 22015 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:25.062747 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:25.077696 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72322.1us
I20260709 13:08:25.081233 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:25.096485 22016 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 21. Current term is 22. Ops: []
W20260709 13:08:25.108659 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.110582 22022 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:25.109185 21948 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:25.089661 27859 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:25.120906 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:25.123826 22576 leader_election.cc:336] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.836s (SENT)
I20260709 13:08:25.124639 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:25.128767 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.130010 22021 raft_consensus.cc:2393] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:25.132819 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:25.144901 27876 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.145757 27876 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.148135 27876 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:25.148741 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51913.7us
I20260709 13:08:25.148886 22017 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:25.119633 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:25.149185 22604 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:08:25.162575 27366 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:25.164526 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.163080 21947 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:25.153288 27803 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.010s
I20260709 13:08:25.165421 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:25.173367 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.179629 21868 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:25.185750 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.199051 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:25.197031 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.197517 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.280929 27912 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:25.282538 27982 log.cc:927] Time spent T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:08:25.194605 27886 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:25.284174 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 189801us
I20260709 13:08:25.286093 27886 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:25.287937 27933 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:25.289592 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:25.290634 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.291980 22021 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:25.278502 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:25.293756 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 170172us
I20260709 13:08:25.294798 21945 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
W20260709 13:08:25.317780 27714 consensus_meta.cc:287] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.008s
I20260709 13:08:25.320212 21873 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:25.339715 22015 raft_consensus.cc:2376] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14. Re-sending same reply.
I20260709 13:08:25.339541 27925 consensus_queue.cc:1059] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:25.340567 27925 consensus_queue.cc:1243] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:25.341188 27925 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:25.341545 27925 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:25.342903 27920 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.756s	user 0.014s	sys 0.006s
I20260709 13:08:25.342654 27925 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.343384 27920 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.344636 21950 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:25.344247 27925 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.347326 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.348192 22021 raft_consensus.cc:2393] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:25.348819 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.349226 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.349506 22019 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:25.349920 22016 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:25.351017 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.351641 22017 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.301847 27933 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:25.353667 27933 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:25.358079 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:25.359344 27935 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:25.360033 27935 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:25.360706 22576 leader_election.cc:336] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.064s (SENT)
I20260709 13:08:25.361231 27935 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.362174 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.362905 22023 raft_consensus.cc:2376] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19. Re-sending same reply.
W20260709 13:08:25.363867 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.366513 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.367323 22018 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 13.
I20260709 13:08:25.368688 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:25.373080 27743 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:25.373811 27743 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.375756 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:25.385866 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:25.411651 21875 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:25.408697 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.409345 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:25.422787 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.441150 22015 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:25.442737 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 109510us
I20260709 13:08:25.447108 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.447852 22020 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:25.461248 21942 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:25.467434 22022 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:25.479015 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:25.487567 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.484118 27743 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:25.495668 22017 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:25.504237 27899 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.519057 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:25.522055 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.522699 22022 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:25.524726 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.527628 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.528239 22015 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:25.529510 22015 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:25.530726 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.530797 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:25.532351 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:25.537212 27939 consensus_meta.cc:287] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.008s
I20260709 13:08:25.541277 27943 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:25.542315 27943 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.548575 27920 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:25.526993 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:25.557036 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55094.7us
W20260709 13:08:25.541365 27917 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.884s	user 0.009s	sys 0.014s
I20260709 13:08:25.562348 27876 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:25.572053 27940 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:25.576251 27743 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:25.581023 27743 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.581135 27940 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:25.581739 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:25.582451 21950 raft_consensus.cc:2368] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15.
I20260709 13:08:25.583274 27743 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:25.584612 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:25.585575 21943 raft_consensus.cc:2410] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:25.586848 21950 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:25.590080 21948 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
W20260709 13:08:25.592234 21841 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.660s (SENT)
I20260709 13:08:25.577744 27876 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.593971 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.595788 21841 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:25.597062 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.597359 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:25.599525 21948 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:25.593946 21945 raft_consensus.cc:1275] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:25.602398 27876 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:25.614372 21945 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:25.652588 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.664412 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.665468 22018 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 18: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:25.667455 21945 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:25.668681 27950 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.669438 27950 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.645494 27714 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.704818 22022 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:08:25.717406 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.717674 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.717765 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.672551 27950 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:25.721531 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:25.723320 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 135768us
I20260709 13:08:25.722589 21950 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:25.725221 21987 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:25.715094 27943 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:25.743038 21841 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.760s (SENT)
I20260709 13:08:25.746320 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.748435 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:25.764034 27306 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:25.773604 28002 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:25.775636 27800 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:25.776315 27943 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:25.782325 27989 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.624s	user 0.002s	sys 0.000s
W20260709 13:08:25.784615 27985 log.cc:927] Time spent T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
W20260709 13:08:25.785223 27997 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:25.786211 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:25.789290 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.791070 27940 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:25.793491 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:25.795527 27996 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:08:25.796942 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.834674 22016 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:25.802904 27306 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.822342 27714 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:25.848568 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 405998us
I20260709 13:08:25.855695 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.824000 27934 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.859063 21987 leader_election.cc:400] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15.
I20260709 13:08:25.861477 21987 leader_election.cc:403] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:25.844157 27306 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.847019 27743 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.852319 27953 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:25.887157 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 511559us
I20260709 13:08:25.888059 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.889968 22016 raft_consensus.cc:2393] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 16: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:25.891943 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.893589 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:25.894098 21987 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:25.901716 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.894690 22021 raft_consensus.cc:2376] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17. Re-sending same reply.
W20260709 13:08:25.906075 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 163070us
I20260709 13:08:25.908799 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.893611 27940 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15.
W20260709 13:08:25.913970 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 44824.8us
I20260709 13:08:25.915926 22018 raft_consensus.cc:2368] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:08:25.881908 27743 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:25.887678 27934 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:25.916541 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 418079us
I20260709 13:08:25.920578 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:25.924746 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:25.940177 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.925981 21987 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:25.925547 21841 leader_election.cc:336] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.789s (SENT)
I20260709 13:08:25.946552 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:25.923327 27943 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:25.946991 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:25.910650 27953 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:25.948436 27940 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:25.958884 27940 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.959316 27940 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:25.959152 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.959789 27714 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:25.959156 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53688.6us
I20260709 13:08:25.965538 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:25.983974 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.970943 27800 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:25.972958 27939 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:25.969244 27943 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:25.987684 21874 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:25.987146 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:25.985760 27950 raft_consensus.cc:2804] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:26.013047 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:25.988787 27800 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.989061 27939 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:26.015904 27849 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.013526 27933 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:08:26.012660 28000 consensus_queue.cc:1048] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:08:26.021481 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:26.023058 27953 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:26.026064 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 1062) took 1070 ms. Trace:
W20260709 13:08:26.014674 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 168457us
I20260709 13:08:26.039433 27943 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.041668 27934 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:26.052567 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.052870 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.053668 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:26.054245 22023 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:26.054765 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.055168 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.055383 22019 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
W20260709 13:08:26.047528 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 125569us
W20260709 13:08:26.060878 21841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 3.227s (SENT) [suppressed 56 similar messages]
W20260709 13:08:26.061465 28007 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
W20260709 13:08:26.062943 21841 leader_election.cc:336] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.834s (SENT)
I20260709 13:08:26.044770 27800 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.047467 21870 rpcz_store.cc:276] 0709 13:08:24.954927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.056268 (+101341us) service_pool.cc:224] Handling call
0709 13:08:25.064403 (+  8135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.064795 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:25.087529 (+ 22734us) log.cc:844] Serialized 14 byte log entry
0709 13:08:25.518552 (+431023us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800386080. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f67e07 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c1223a 00007f635607ca2a
0709 13:08:26.007126 (+488574us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:26.007196 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:26.015262 (+  8066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.016902 (+  1640us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.025141 (+  8239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":713,"prepare.queue_time_us":34844,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":29867,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8946,"spinlock_wait_cycles":5405568,"thread_start_us":501407,"threads_started":3,"wal-append.queue_time_us":886886}
I20260709 13:08:26.065994 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.070381 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:26.070540 27939 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:26.072724 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51402us
I20260709 13:08:26.072970 28023 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:26.074935 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:26.013304 28010 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.076267 28010 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.075682 27743 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:26.079216 28010 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:26.086661 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.087945 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.074836 27876 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.088973 27933 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:26.065215 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:26.099431 22023 raft_consensus.cc:2393] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 18: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:26.101562 22016 raft_consensus.cc:2368] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19.
W20260709 13:08:26.106197 21841 leader_election.cc:336] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.840s (SENT)
W20260709 13:08:26.107532 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.108029 28029 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:26.113044 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.084098 27940 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.114037 22018 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:26.115813 27940 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:26.118057 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:26.119993 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:26.120345 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.121004 28015 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:26.065927 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.121747 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:26.122025 28015 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.122399 21871 raft_consensus.cc:3060] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:26.122996 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:26.123234 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.124500 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.124923 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.125115 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:26.122300 22019 raft_consensus.cc:2468] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:26.125564 21866 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:26.125806 21867 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.126657 22019 raft_consensus.cc:1240] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:26.121066 21874 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:08:26.125138 21868 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
W20260709 13:08:26.132845 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 173201us
I20260709 13:08:26.139510 27950 raft_consensus.cc:697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:26.141076 27950 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.089443 27933 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:26.149154 22021 raft_consensus.cc:2368] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
W20260709 13:08:26.122046 22576 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.562s (SENT)
I20260709 13:08:26.152462 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.164062 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:26.167299 22576 leader_election.cc:336] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.663s (SENT)
I20260709 13:08:26.167840 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:26.170547 21841 leader_election.cc:336] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.926s (SENT)
I20260709 13:08:26.168465 21870 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:26.153553 27933 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.116487 27940 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:08:26.175843 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.178468 22023 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:26.181322 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.185132 21873 raft_consensus.cc:2410] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:08:26.150141 27306 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.167351 28023 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:26.187557 21916 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:26.190366 21841 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.961s (SENT)
I20260709 13:08:26.192698 28000 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.195798 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:26.198081 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 78262.4us
W20260709 13:08:26.216833 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 82722.4us
I20260709 13:08:26.218210 22606 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
I20260709 13:08:26.222530 22021 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:26.223866 22023 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:26.225509 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:26.228118 21841 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:26.188318 28015 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:26.235215 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:26.213060 28023 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:26.242298 22017 raft_consensus.cc:2368] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 13. Current term is 14.
I20260709 13:08:26.236821 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.233855 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.204622 27934 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.246487 28023 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.242726 22020 raft_consensus.cc:2376] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16. Re-sending same reply.
I20260709 13:08:26.249545 21914 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:26.243220 21869 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
W20260709 13:08:26.249800 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 82547.2us
W20260709 13:08:26.255707 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.234509 27803 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.242250 28015 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:26.270470 22606 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:26.271425 21948 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:26.277537 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 50596.1us
I20260709 13:08:26.278381 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:26.251238 27920 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:08:26.265867 27803 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.271004 28015 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:26.254762 27934 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.271070 27876 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:26.335616 21867 raft_consensus.cc:2468] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
W20260709 13:08:26.336733 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 146425us
W20260709 13:08:26.342466 22576 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.869s (SENT)
I20260709 13:08:26.342054 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:26.346580 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.279796 28023 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:26.321108 27803 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.353224 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.354595 22576 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:26.269804 27917 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:08:26.266903 27899 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
W20260709 13:08:26.367093 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 138293us
I20260709 13:08:26.373729 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:26.374145 28026 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.374568 22608 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:26.374621 28026 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:26.375231 28026 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.371997 22609 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:26.372197 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:26.372076 27891 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:08:26.379316 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43622us
I20260709 13:08:26.343770 27935 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.393499 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:26.395171 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.396341 21871 raft_consensus.cc:2468] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:26.395872 22604 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
W20260709 13:08:26.398524 21841 leader_election.cc:336] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.968s (SENT)
I20260709 13:08:26.379379 27891 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.409415 22606 raft_consensus.cc:2368] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15.
I20260709 13:08:26.411149 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:26.411943 21947 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.413527 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:26.389220 28036 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.394273 28006 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.429376 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 99222.5us
I20260709 13:08:26.419585 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.433254 27743 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:26.434022 27743 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.435068 28006 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.436261 27743 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:26.437191 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 63576.7us
I20260709 13:08:26.437485 28006 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:26.439893 22576 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.807s (SENT)
I20260709 13:08:26.440387 27714 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:26.433334 28030 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.165s
I20260709 13:08:26.440428 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:26.410547 27891 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:26.447643 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:26.459626 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.464645 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.463917 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 22 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.475826 28024 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:26.494809 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.453920 27306 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:26.497931 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49153.2us
W20260709 13:08:26.499334 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 110099us
W20260709 13:08:26.506191 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 66367.1us
I20260709 13:08:26.433279 28040 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:26.408339 27935 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.498888 28006 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:08:26.516444 21838 leader_election.cc:336] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.926s (SENT)
W20260709 13:08:26.517447 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.519752 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:26.526185 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 138400us
I20260709 13:08:26.510251 28040 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.510267 28036 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:26.529626 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 310819us
I20260709 13:08:26.521667 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.544085 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:26.545017 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.547536 22017 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:26.551012 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:26.551699 21942 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.525146 27660 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.549165 22601 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:26.549021 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:26.556833 21941 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:26.563359 28035 log.cc:927] Time spent T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:08:26.569190 27995 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:26.570044 27909 consensus_queue.cc:1048] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:08:26.572693 27714 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:26.581501 28043 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:08:26.531591 28040 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:26.588268 27660 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:26.590219 27933 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.586658 27934 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:26.604892 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 88497.8us
W20260709 13:08:26.606439 21838 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.984s (SENT)
I20260709 13:08:26.606961 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:26.620721 21947 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:26.618402 27743 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:26.633618 21838 leader_election.cc:336] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.541s (SENT)
I20260709 13:08:26.549413 28036 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.637761 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:26.649693 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 119539us
W20260709 13:08:26.651307 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 99178.6us
I20260709 13:08:26.637045 27933 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:26.660910 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:26.661314 21838 leader_election.cc:336] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.060s (SENT)
I20260709 13:08:26.666033 21870 raft_consensus.cc:2410] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:26.666088 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:26.655263 27714 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.662349 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.663393 27935 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:26.663795 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.671550 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.671620 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.673472 21869 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:26.672286 21873 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
W20260709 13:08:26.668166 27800 consensus_meta.cc:287] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.000s
I20260709 13:08:26.676934 27714 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:26.687443 27714 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:26.688277 28036 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:26.677094 27912 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:08:26.719976 27912 consensus_queue.cc:1243] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:08:26.727476 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:26.730682 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:26.731765 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:26.736961 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75693.6us
I20260709 13:08:26.739105 27743 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:26.741309 27714 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.741847 27714 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.742239 27714 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:26.736985 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 62974.9us
I20260709 13:08:26.749970 27803 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:26.751360 28057 log.cc:927] Time spent T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.152s	user 0.003s	sys 0.000s
I20260709 13:08:26.754087 27891 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.756191 27891 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:26.759112 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.759852 21942 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:26.696539 27800 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.762864 27800 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:26.764132 27803 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:26.740154 27743 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:08:26.766315 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:26.766911 22606 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:26.768885 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:26.769493 21838 leader_election.cc:336] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.103s (SENT)
I20260709 13:08:26.743467 28066 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:26.773419 28066 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:26.773845 28066 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:26.778968 21942 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:26.781375 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50782.2us
I20260709 13:08:26.785116 21950 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:26.786384 27743 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:26.786825 27743 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:26.787366 28015 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.787658 27743 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.788930 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.789266 27743 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.789639 21873 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:26.794796 22606 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 20.
W20260709 13:08:26.795205 21838 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.654s (SENT)
I20260709 13:08:26.796638 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.805291 22601 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
W20260709 13:08:26.799978 28032 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.432s	user 0.002s	sys 0.000s
I20260709 13:08:26.801448 21941 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:26.808182 21942 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:26.814914 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:26.818795 27939 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:26.823761 21838 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.146s (SENT)
W20260709 13:08:26.825882 21838 leader_election.cc:336] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.170s (SENT)
I20260709 13:08:26.827966 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:26.710640 28040 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.839910 21945 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:26.845742 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:26.849277 21841 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.738s (SENT)
I20260709 13:08:26.849795 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:26.843376 21987 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:26.857777 28039 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:26.857865 21987 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:26.858549 28039 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:26.859509 28069 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:26.860157 28069 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:26.860857 28055 consensus_queue.cc:1059] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:26.861228 28069 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:26.862393 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.863088 27306 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:26.864576 27699 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:26.864995 27699 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:26.865216 21987 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:26.865967 27699 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.867375 27699 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.867637 28037 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:26.866488 28052 raft_consensus.cc:2804] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:26.869204 28052 raft_consensus.cc:697] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:26.870222 28052 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.871717 28047 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:26.872149 28047 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:26.873055 28047 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.874308 28047 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:26.876865 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 165953us
I20260709 13:08:26.878546 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:26.879664 27836 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:26.880231 27836 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:26.792301 27714 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.880007 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:26.851394 21873 raft_consensus.cc:2376] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13. Re-sending same reply.
W20260709 13:08:26.914723 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 369526us
I20260709 13:08:26.916949 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.917870 22015 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:26.918926 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:26.922416 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:26.922679 28072 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:26.923385 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.923341 28072 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:26.923871 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:26.924773 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:26.925375 22019 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.925578 22606 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:26.925963 28072 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:26.927291 22604 raft_consensus.cc:1240] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:26.923460 22601 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:26.858583 27891 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.937868 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:26.938524 22604 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:26.940784 28045 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.519s	user 0.003s	sys 0.003s
I20260709 13:08:26.941690 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:26.943220 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:26.943802 21871 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.936026 28036 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:26.946007 28036 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:26.946512 28036 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 20 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:26.947476 28036 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:26.953209 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 73280us
I20260709 13:08:26.954025 22019 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:26.958792 21871 raft_consensus.cc:2468] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:26.943759 22017 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
W20260709 13:08:26.959765 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 134080us
W20260709 13:08:26.968542 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 290427us
I20260709 13:08:26.944514 21867 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:26.954226 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:26.961647 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:26.965158 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.967684 22604 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 20.
I20260709 13:08:26.959764 27714 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:26.901504 27836 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:26.985728 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:26.994837 22604 raft_consensus.cc:2368] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:26.987174 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:26.995456 21945 raft_consensus.cc:3060] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.859572 28039 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:26.967262 27800 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:26.992974 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 143721us
I20260709 13:08:26.993782 28053 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.999329 28053 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.999742 28053 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.002573 28040 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:27.006701 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 52612us
I20260709 13:08:27.007450 21839 leader_election.cc:400] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:27.007793 21839 leader_election.cc:403] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:27.009251 21841 leader_election.cc:336] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.103s (SENT)
I20260709 13:08:27.009842 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.014209 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.011736 28000 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:27.030835 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.034850 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:27.040833 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:27.041496 21950 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.057176 21916 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:27.049152 21841 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 2.146s (SENT)
I20260709 13:08:27.066471 21841 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.072352 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:27.073397 22604 raft_consensus.cc:2393] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:27.050357 28077 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
W20260709 13:08:27.079161 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 71737.2us
I20260709 13:08:27.034857 27943 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:27.055270 28073 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:08:27.052934 28028 consensus_queue.cc:1059] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:27.084129 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:27.084477 28078 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:08:27.085178 28074 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:08:27.151969 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:27.090600 28026 consensus_meta.cc:287] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.001s
I20260709 13:08:27.037878 28000 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:27.045861 28015 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.048689 27743 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:27.093276 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 62512.9us
W20260709 13:08:27.163287 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.036904 28075 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:08:27.025897 28066 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.094784 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.164958 21943 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:27.165498 21945 raft_consensus.cc:2410] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:08:27.095964 28054 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:27.161890 22603 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:27.080698 27886 raft_consensus.cc:3055] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:27.097288 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:27.097638 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:27.098376 22606 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:27.096422 22574 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:27.114341 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:27.048478 27800 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:27.071226 27803 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.154448 21916 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:27.099474 27849 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:27.156340 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.160337 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.168452 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.117823 28072 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:27.170933 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 74600.6us
I20260709 13:08:27.172708 22601 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:27.111440 28006 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:08:27.172994 21944 raft_consensus.cc:2368] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:27.182052 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.183444 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.184201 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.158257 28000 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.185266 22607 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:27.160467 27939 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:27.189878 21916 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:27.205724 27934 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:27.206338 27934 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:27.207299 27934 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:27.210210 28004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.017s	sys 0.015s
W20260709 13:08:27.210659 28004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.017s	sys 0.015s
I20260709 13:08:27.199077 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.214612 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.215984 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.216238 28053 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.218573 28053 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.221058 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.222385 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.188117 28052 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:27.182364 27803 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.224923 28052 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:27.225895 28052 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.226706 27803 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.227159 28052 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:27.227363 28067 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.242s	user 0.000s	sys 0.003s
I20260709 13:08:27.174140 27849 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.228843 27849 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:27.230856 22018 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:27.169529 27886 raft_consensus.cc:740] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:27.233335 27886 consensus_queue.cc:260] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.234696 27886 raft_consensus.cc:3060] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.236063 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:27.238054 28078 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:27.238461 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.159143 28026 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.240654 28026 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.240780 28072 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:27.172931 27800 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:27.241515 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.241806 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.242111 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:27.240772 21947 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:27.246959 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 52706.7us
I20260709 13:08:27.185052 28015 raft_consensus.cc:2804] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:27.247931 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.251297 21950 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:27.246660 27925 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.252336 27925 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.252578 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:27.253417 27950 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:27.253893 27950 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:27.253973 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.254802 27950 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.255322 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.256325 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.244318 28072 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:27.257193 28072 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:27.257301 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.257437 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.258396 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.258159 28072 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.258607 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.259476 28072 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:27.260368 28066 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.260933 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.261983 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.262701 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.263010 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.263343 21874 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.263873 27836 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.264415 21950 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:27.262239 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:27.269789 28049 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:27.252718 27925 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.270257 28049 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.271232 28049 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:27.274302 21988 leader_election.cc:400] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15.
I20260709 13:08:27.275906 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.276854 28033 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:27.194435 27943 raft_consensus.cc:2804] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:27.281184 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.282414 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.259501 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:27.283212 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.283207 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.284946 27943 raft_consensus.cc:697] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:27.285974 27943 consensus_queue.cc:237] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.258227 27800 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.294438 27800 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:27.295475 28049 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.264915 28070 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:08:27.298527 28070 consensus_queue.cc:1059] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:27.299566 28070 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:27.299926 28015 raft_consensus.cc:697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:27.299978 28070 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:27.300902 28015 consensus_queue.cc:237] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.301152 28070 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.302902 28070 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:27.307183 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 258036us
I20260709 13:08:27.308630 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.308775 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:27.309628 27940 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:27.309937 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.310236 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.310890 21870 raft_consensus.cc:2376] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16. Re-sending same reply.
I20260709 13:08:27.311342 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.311858 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:27.312844 21871 raft_consensus.cc:2410] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:08:27.313078 21874 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:27.313124 28000 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.314519 22574 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:27.315487 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.315672 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.316309 27660 raft_consensus.cc:2804] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:27.316879 27660 raft_consensus.cc:697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:27.317384 28054 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:27.318019 27940 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:27.317819 27660 consensus_queue.cc:237] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.318429 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.317848 28054 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:27.321586 28054 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.316303 28000 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.326311 22609 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:27.329632 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.334942 28049 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:27.341773 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.342834 27699 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.343302 27699 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:27.343712 27699 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.345588 21839 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:27.346720 27891 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:27.347150 27891 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:27.347509 27891 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:27.349190 28090 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:27.350198 28090 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:27.350555 28090 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:27.351550 21947 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:27.351377 28090 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.353482 28090 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:27.355185 28047 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:27.360728 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.363207 27699 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.366264 27891 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.366672 21943 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:27.369028 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.369356 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.371122 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.372175 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:27.372310 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.373636 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:27.374738 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.370227 21950 raft_consensus.cc:2393] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 18: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:27.375934 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.376200 22018 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:27.376732 21950 raft_consensus.cc:2368] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:27.377446 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.377988 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:27.379972 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.380744 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.391283 21948 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 18: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:27.391443 22609 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:27.392886 21839 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:27.398129 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:27.403553 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:27.410261 21874 raft_consensus.cc:2393] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
W20260709 13:08:27.407788 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 66158.7us
I20260709 13:08:27.408489 22017 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:27.407931 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:27.415130 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.416213 21942 raft_consensus.cc:2393] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:27.418156 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:27.421296 21838 leader_election.cc:336] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 2.489s (SENT)
W20260709 13:08:27.424468 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 311850us
I20260709 13:08:27.424913 21871 raft_consensus.cc:2393] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:27.425518 21868 raft_consensus.cc:2376] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12. Re-sending same reply.
I20260709 13:08:27.400794 28077 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:27.429170 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.431855 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.432710 28077 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:27.433724 28077 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.377471 28049 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:27.429191 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.436712 21870 raft_consensus.cc:2368] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18.
I20260709 13:08:27.438504 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.439136 21868 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:08:27.393225 27891 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:27.440002 22609 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:27.367597 27849 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.447288 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.458695 21916 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:27.461386 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.452275 27743 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:27.463979 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.466053 28086 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:27.468199 27917 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:27.470759 27803 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:27.472788 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:27.473642 21943 raft_consensus.cc:2393] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 18: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:27.470103 27836 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.477246 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:27.477970 22609 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:27.479187 28086 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:27.479610 28086 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:27.480469 28086 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.482081 28086 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.485016 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:27.488068 21838 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.530s (SENT)
I20260709 13:08:27.489801 21871 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:08:27.493520 21871 pending_rounds.cc:85] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 9
I20260709 13:08:27.493423 21875 raft_consensus.cc:1240] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:27.493875 21871 pending_rounds.cc:107] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:08:27.498168 21871 raft_consensus.cc:2889] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:27.499624 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.503201 21946 raft_consensus.cc:2368] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19.
I20260709 13:08:27.503954 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.501434 21872 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:27.460621 28048 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:27.522357 21869 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:27.530212 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.532100 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:27.492903 27917 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:27.547362 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 108939us
I20260709 13:08:27.506623 27925 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.532254 27743 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:27.533427 28048 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:27.599537 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:27.600615 21869 raft_consensus.cc:2393] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:27.550377 27899 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:27.603089 28088 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:08:27.616720 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 86560us
I20260709 13:08:27.618026 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.624107 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:27.624832 21867 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:27.629472 21949 raft_consensus.cc:2368] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:27.669910 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:27.681954 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 64025.5us
I20260709 13:08:27.682947 21838 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.685739 21867 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:27.693481 21838 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.657411 27849 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.668680 28072 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.672351 28050 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:27.697324 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.706260 21869 raft_consensus.cc:3060] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.688833 28077 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:27.716306 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.627746 27917 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:27.724057 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.719201 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:27.725838 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 197674us
I20260709 13:08:27.726064 27925 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:27.726837 21870 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:27.727032 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:27.727988 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:27.729143 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:27.729970 27934 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:27.730856 27934 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.731246 27934 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:27.731657 27934 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:27.733459 28089 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:27.736969 28065 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.737509 28065 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:27.737895 28065 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.740422 21867 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
W20260709 13:08:27.741498 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.744037 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.746785 27925 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:27.658586 22019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:27.749025 22019 raft_consensus.cc:606] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:27.751157 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:27.756544 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:27.761843 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75793.5us
I20260709 13:08:27.758469 21872 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:27.758917 27800 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.765054 27800 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.767477 27800 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.708882 28050 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.770736 28050 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:27.771653 28039 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:27.771818 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 52746.5us
I20260709 13:08:27.772688 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.774340 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.774947 28039 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.775692 28039 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.776049 28039 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:27.776384 28039 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.776368 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.777494 28075 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:27.780910 28040 raft_consensus.cc:993] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:27.781364 28040 raft_consensus.cc:1081] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:27.782821 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:27.790454 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 262117us
I20260709 13:08:27.759233 28036 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:27.798362 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.801497 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.802130 22019 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.803382 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:27.804641 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:27.806810 21988 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.810257 21873 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.789988 27849 raft_consensus.cc:2764] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:08:27.808662 28079 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.814297 28070 raft_consensus.cc:2804] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:27.814579 28079 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:27.698246 28048 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.815014 28079 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.816311 22024 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:27.816895 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 66646.8us
I20260709 13:08:27.817694 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.814872 28070 raft_consensus.cc:697] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:27.818953 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.819216 28070 consensus_queue.cc:237] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.821429 27925 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:27.821561 28024 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:27.787290 27934 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.845646 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.831554 27899 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:27.847731 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.848680 22023 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:27.849155 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.844461 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.850080 22016 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:27.850749 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.851819 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.852262 28077 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:27.807482 27933 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:27.854537 22019 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:27.858493 21838 leader_election.cc:400] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:27.852516 27743 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.864612 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.865168 22019 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 21. Current term is 22. Ops: [17.15-21.17]
I20260709 13:08:27.867460 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.867655 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.865231 22020 raft_consensus.cc:2376] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15. Re-sending same reply.
I20260709 13:08:27.868238 22019 raft_consensus.cc:3060] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.868822 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.869544 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.874555 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:27.872390 21870 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:27.876839 28077 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:27.877143 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.877774 22018 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:27.879326 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.879918 22016 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:27.882050 22576 leader_election.cc:336] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.617s (SENT)
I20260709 13:08:27.882565 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.883723 28066 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:27.884385 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.884799 28072 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.885043 22020 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.889624 27699 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:27.894707 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:27.895531 22609 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:27.897759 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:27.898368 22607 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.903281 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.889531 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.906348 21869 raft_consensus.cc:2468] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:27.919135 22019 raft_consensus.cc:2468] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:27.920634 22020 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:27.921476 22018 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:27.922997 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:27.924181 22016 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:27.863809 28090 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:27.928231 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58754.9us
I20260709 13:08:27.945629 21943 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:27.945796 27800 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:27.946749 28052 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.947304 28052 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.947647 28079 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.949549 28052 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:27.950330 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 75867.2us
I20260709 13:08:27.951417 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:27.952845 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:27.954828 21838 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.932626 28000 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:27.958209 21945 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:27.960009 22576 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:27.960747 27714 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.960845 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:27.961695 22608 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 19: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:27.962544 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:27.963294 22606 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 20: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:27.957887 28065 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.965476 28065 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:27.961300 27714 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:27.966701 22607 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:27.971863 21873 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:27.979279 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.979630 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.979969 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.980386 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.983604 22019 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:08:27.984344 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.984800 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:27.986023 22021 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 20: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:27.988641 22023 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:27.866993 27933 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:27.993340 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.993773 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.994642 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:27.973546 28090 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:28.008414 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.003023 21838 leader_election.cc:400] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:28.018159 22017 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:27.997134 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:27.993130 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:27.966182 28105 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:08:27.998392 28054 consensus_meta.cc:287] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.000s
I20260709 13:08:28.023202 22576 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:27.991919 28015 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.022413 28060 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:08:28.022603 28052 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:28.046360 27933 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:28.046633 27920 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:28.047119 27920 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:28.048623 22608 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:28.048956 28060 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:28.049415 28060 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:28.050231 27714 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.050379 28060 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.051451 27934 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.051606 28060 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.052692 28053 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.053265 28053 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:28.053952 28039 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.054263 28053 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.057030 28039 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:28.063781 28079 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:28.066746 28107 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:08:27.993619 28026 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
W20260709 13:08:28.069587 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 46502.7us
I20260709 13:08:28.070115 21949 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:28.070580 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:28.071848 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.072353 21866 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
W20260709 13:08:28.079368 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 273574us
I20260709 13:08:28.087713 21950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:28.088066 21873 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:28.088627 21950 raft_consensus.cc:606] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:28.089175 21950 raft_consensus.cc:614] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:28.073585 28105 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:28.075129 28000 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:28.023954 27803 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:28.073325 28054 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.116698 21870 raft_consensus.cc:1240] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:28.088696 27933 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:28.115389 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.119264 21875 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.095685 28024 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:28.122740 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48036.1us
I20260709 13:08:28.123113 22022 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:28.126766 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.127599 21869 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.129647 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.130501 21873 raft_consensus.cc:3060] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:28.111480 28000 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:28.146015 21868 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:28.108886 27714 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
W20260709 13:08:28.168943 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45513.4us
I20260709 13:08:28.168576 28105 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.144085 28066 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.169755 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:28.124358 27933 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.171087 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:28.171912 27933 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:28.140014 28070 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.173341 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.174348 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:28.175036 21867 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:28.172492 27933 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.110244 27803 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.178761 21869 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:28.181620 21873 raft_consensus.cc:2468] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:28.196094 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.196746 21868 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:28.197194 21870 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:28.175097 21871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:08:28.204178 21871 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.204697 21871 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.181344 27917 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.209278 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:28.173395 28070 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.208495 28013 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:28.219087 28013 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:28.220001 28013 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.225677 21875 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
W20260709 13:08:28.233795 21841 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.654s (SENT)
I20260709 13:08:28.234278 21841 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.236827 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:28.233382 21871 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.239530 22021 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:08:28.249257 28114 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:08:28.253821 27803 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:28.254772 28091 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.259264 21873 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.261708 21950 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:28.258812 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.266688 21872 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.235468 27917 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.213948 28000 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.267858 21875 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:28.270287 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.269559 21871 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.272146 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:28.270973 28040 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.273506 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.273842 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:28.274402 28036 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.275519 21841 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.277370 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.278242 28077 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.278961 28077 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.280476 21841 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.281260 28036 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.282735 21872 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
W20260709 13:08:28.283414 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 46666.8us
W20260709 13:08:28.284264 21841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.286825 22608 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:28.288467 28036 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:28.290014 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.291347 28040 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.293195 28040 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.255441 28086 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.295315 28040 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:28.293447 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 90725.4us
I20260709 13:08:28.296900 21914 leader_election.cc:400] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18.
I20260709 13:08:28.297308 21914 leader_election.cc:403] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.265194 28037 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:28.299950 27803 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18.
I20260709 13:08:28.302181 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:28.303342 28024 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.305092 28024 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:28.268356 27714 consensus_queue.cc:1059] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:28.310026 27714 raft_consensus.cc:3055] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:28.310495 27714 raft_consensus.cc:740] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:28.310810 28024 consensus_queue.cc:1059] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:28.311501 27714 consensus_queue.cc:260] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:28.292673 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.277242 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.323490 21870 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:28.312305 27886 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:28.319254 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:28.327301 28015 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.327880 21872 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:28.325855 27886 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:28.324494 21988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.331015 28086 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:28.331576 28086 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.333680 28086 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.333977 22021 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:28.341079 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:28.344780 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.346874 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:28.348382 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 58445.8us
I20260709 13:08:28.351229 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.352330 22019 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:28.352451 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:28.362639 22019 raft_consensus.cc:1240] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:28.363703 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.365358 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:28.365626 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.366132 22606 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:28.367491 22019 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.374261 21916 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:28.377017 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.378119 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:28.378772 22016 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.379112 22016 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:28.383023 21839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.386659 22019 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:28.313243 28054 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:28.396615 27899 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:28.402729 27714 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.382740 28077 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:28.397063 22016 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.405144 22016 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.407976 27934 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:28.411294 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.411554 21871 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:28.412078 21869 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:28.412952 21873 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:28.398913 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.418929 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.420142 21841 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:28.433640 28122 log.cc:927] Time spent T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:08:28.366410 28090 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.434762 28090 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:28.361205 28086 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.382450 28062 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:28.435739 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.436399 28062 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:28.436928 28062 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.437086 22022 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 20: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:28.439200 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.378981 28036 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.441448 21870 raft_consensus.cc:2468] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
I20260709 13:08:28.443113 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.449426 27943 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:28.451125 28101 log.cc:927] Time spent T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.494s	user 0.002s	sys 0.000s
I20260709 13:08:28.453866 27886 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.454934 27886 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:28.456017 28110 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
I20260709 13:08:28.456691 28026 consensus_queue.cc:1059] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:28.457561 28026 raft_consensus.cc:3055] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:28.457810 21870 raft_consensus.cc:1275] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:28.457887 28026 raft_consensus.cc:740] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:28.458977 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:28.459144 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:28.396788 21914 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:28.464124 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:28.469934 22019 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:28.467873 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:28.472977 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:28.467592 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 70869.2us
I20260709 13:08:28.490653 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:28.479511 27743 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:28.495824 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.495288 22021 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:28.498798 22016 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:28.472509 28106 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:28.463502 27899 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:28.510675 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:28.507550 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 87467.8us
W20260709 13:08:28.508257 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.483508 28077 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.489791 28049 raft_consensus.cc:2764] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:08:28.495900 28121 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:28.519711 28040 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.499032 28033 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:08:28.526935 28079 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:08:28.539098 28079 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.539485 28079 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:28.541461 27899 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.504289 27743 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.551472 27743 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.553781 28062 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.556030 28062 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.560382 27920 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.562074 27920 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:28.568544 27699 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:28.573232 27699 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:28.577044 27699 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:28.579641 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:28.581144 21941 raft_consensus.cc:1275] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:08:28.581691 21941 pending_rounds.cc:85] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 9
I20260709 13:08:28.581977 21941 pending_rounds.cc:107] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:08:28.582283 21941 raft_consensus.cc:2889] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:28.583194 28123 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.365s	user 0.004s	sys 0.000s
I20260709 13:08:28.588542 21841 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:28.593816 22604 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:28.595283 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 98262.2us
I20260709 13:08:28.525064 27917 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:08:28.596426 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:28.595450 27743 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.597551 27743 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.599850 27743 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.604043 27917 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:28.604763 27917 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:28.606109 21914 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:28.609118 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:28.540345 28079 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.663091 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:28.611727 28050 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:28.660446 28060 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.670226 28005 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.670722 28062 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:28.672120 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:28.613722 27743 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.696010 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:28.697321 21945 raft_consensus.cc:2410] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:08:28.682160 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:28.683825 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:28.685555 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:28.699258 21942 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.626713 27934 raft_consensus.cc:2804] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:28.710774 27934 raft_consensus.cc:697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:28.712054 21942 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:28.696015 28005 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.750288 28070 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:28.751260 28005 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.698096 28062 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.753670 28062 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.711844 27934 consensus_queue.cc:237] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.743292 27699 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.712934 22015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:28.744028 27917 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.757526 28086 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:28.758104 28086 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.694386 28060 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.714915 21838 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.760095 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:28.760872 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.761097 28060 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:28.761344 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:28.761510 22022 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
I20260709 13:08:28.682020 21943 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:28.718262 28040 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:28.772709 28125 log.cc:927] Time spent T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.545s	user 0.002s	sys 0.004s
I20260709 13:08:28.773744 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.695966 28033 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:28.741321 21871 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:28.775580 28033 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.747035 28000 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.766830 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:28.776482 28000 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.778788 28000 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:28.760274 28086 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:28.724864 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:28.760087 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45277.8us
I20260709 13:08:28.780800 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:28.781814 28077 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:28.782855 28077 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:28.783429 28077 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:28.786417 28129 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:08:28.789207 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53626.2us
I20260709 13:08:28.734790 28036 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:28.776031 28033 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:28.789856 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.738620 28106 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:28.796137 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:28.801513 22022 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:28.802680 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:28.803676 22604 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:28.805379 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:28.795380 28077 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:28.808305 28060 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:28.801313 28036 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:28.848930 27943 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:28.852905 28015 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:28.853214 27943 consensus_queue.cc:1048] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:28.853538 28015 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.855304 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:28.855638 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:28.855976 22601 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.892309 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:28.893347 21868 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:28.907045 21771 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 13 to 15, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 15 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.918889 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:28.923521 28086 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.924185 28086 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:28.926375 28086 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:28.928011 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:28.932971 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:28.940449 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:28.941787 21941 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:28.943404 21947 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:28.945173 21771 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 14 to 16, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 16 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.948067 21771 catalog_manager.cc:5697] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:28.950399 21771 catalog_manager.cc:5697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 6 to 14, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 14 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.834383 27714 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.796415 28090 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:08:28.800374 27803 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:08:28.959808 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:28.960506 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 61666.2us
I20260709 13:08:28.833817 28062 consensus_queue.cc:1059] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.149s
I20260709 13:08:28.969887 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:28.808835 28005 consensus_queue.cc:1059] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 13:08:28.844774 28060 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.964794 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:28.984620 28036 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:28.957087 28136 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.992187 28060 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:28.957355 28040 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.841377 28139 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.156s
W20260709 13:08:29.003526 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 250443us
I20260709 13:08:29.010227 21950 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:08:29.002426 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:29.020947 21941 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 22.
I20260709 13:08:29.024523 21950 raft_consensus.cc:1275] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:08:29.025295 21950 pending_rounds.cc:85] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 8
I20260709 13:08:29.025655 21950 pending_rounds.cc:107] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:08:29.025995 21950 raft_consensus.cc:2889] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:29.007289 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 398229us
I20260709 13:08:29.029403 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:29.039870 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:29.042083 21943 raft_consensus.cc:1240] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:29.057116 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:29.008069 28028 raft_consensus.cc:3055] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:29.074779 21950 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:29.059010 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:29.004648 28077 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:29.085892 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
W20260709 13:08:29.090368 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.000669 27940 consensus_queue.cc:1059] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:08:28.999356 28040 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.003209 28105 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:08:29.076908 28028 raft_consensus.cc:740] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:29.131844 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:29.090689 28143 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:29.150683 21871 raft_consensus.cc:1275] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:29.001551 28106 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.179231 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:29.100044 28077 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.186332 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:29.188905 28028 consensus_queue.cc:260] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.191128 28026 consensus_queue.cc:260] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.192169 27940 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.192777 27940 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.194018 27925 raft_consensus.cc:3055] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:29.194420 27925 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:29.195101 27940 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:29.195355 27925 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:29.215390 28053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.020s	sys 0.016s
W20260709 13:08:29.238051 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 264388us
I20260709 13:08:29.183929 28086 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:29.242012 21771 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 10 to 11, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 11 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:08:29.243690 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.283211 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.241030 28053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.024s	sys 0.016s
I20260709 13:08:29.243778 28086 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.236889 28141 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:29.176203 28143 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.335427 21987 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:29.346392 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 371949us
I20260709 13:08:29.347148 21987 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:29.330405 28086 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:29.322393 28144 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:29.326761 28015 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:29.351526 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 343360us
I20260709 13:08:29.384336 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:08:29.373088 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 372633us
I20260709 13:08:29.375905 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:29.390434 22023 raft_consensus.cc:1240] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:29.327944 28037 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:08:29.346100 28069 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:29.397593 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:29.400538 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.420025 22601 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:29.375301 27699 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:29.433531 22023 raft_consensus.cc:1240] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:29.434216 22020 raft_consensus.cc:3055] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:29.434721 22020 raft_consensus.cc:740] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:29.373070 27940 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:29.435698 22020 consensus_queue.cc:260] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.442456 22020 raft_consensus.cc:3060] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:29.478665 21870 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:29.430022 28015 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.429451 27743 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.393159 28135 consensus_queue.cc:1048] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:08:29.437173 28139 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:29.445587 28040 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:29.389113 28144 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.579985 28143 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:29.497320 28069 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:29.581192 28069 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.581606 28069 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:29.585182 28145 log.cc:927] Time spent T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260709 13:08:29.587211 28150 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:08:29.588891 28144 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:29.598021 22020 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:29.602977 21873 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:08:29.609138 28155 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:08:29.610795 28151 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
W20260709 13:08:29.612430 28153 log.cc:927] Time spent T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
W20260709 13:08:29.616315 28146 log.cc:927] Time spent T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.483s	user 0.000s	sys 0.006s
I20260709 13:08:29.598583 28139 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.617843 28026 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.624127 28079 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:29.625458 28157 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:08:29.466539 27940 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:29.599576 28148 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.510s	user 0.004s	sys 0.002s
I20260709 13:08:29.690410 21873 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:29.590703 28147 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:29.595775 28077 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:29.503974 28015 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:29.734695 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 341839us
W20260709 13:08:29.748112 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.728848 28036 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:29.762112 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 314218us
I20260709 13:08:29.777364 28036 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:29.756237 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:29.779842 28036 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:29.728046 28142 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:29.773970 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 377694us
I20260709 13:08:29.675590 28091 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:29.680953 28141 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:29.805780 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.809386 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:29.809742 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:29.796368 21987 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:29.815222 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:29.816330 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:29.814638 22023 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:29.822072 21841 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:29.823513 22020 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:29.825309 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:29.830631 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:29.833051 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:29.773936 28000 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:29.822759 28142 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:29.851787 28000 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:29.853719 28142 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:29.781905 28077 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:29.775836 27743 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.773619 28106 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:29.697283 28147 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:29.791848 28143 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:29.790611 28158 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:29.826874 28148 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:29.728281 28105 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:08:29.858240 22020 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 22.
I20260709 13:08:29.791074 27849 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:29.856554 27940 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:29.891187 28162 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.857637 28173 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:08:29.891785 28165 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:08:29.892230 28161 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:08:29.897400 28139 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:29.878051 27899 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:29.894517 21869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2541) took 1289 ms. Trace:
I20260709 13:08:29.895121 28147 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:29.895936 28168 log.cc:927] Time spent T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:29.864555 28142 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:29.817914 28091 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:29.848646 28036 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:29.869180 28144 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.878448 27743 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:29.892583 28154 log.cc:927] Time spent T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
W20260709 13:08:29.892524 28050 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:08:29.893970 21866 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2542) took 1286 ms. Trace:
I20260709 13:08:29.879704 28106 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:29.903914 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.926779 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:29.976688 21874 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:29.977823 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:29.919795 21869 rpcz_store.cc:276] 0709 13:08:28.605254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.605403 (+   149us) service_pool.cc:224] Handling call
0709 13:08:28.628392 (+ 22989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.017980 (+389588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.018012 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.097230 (+ 79218us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.425098 (+327868us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:29.425154 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.425246 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.894307 (+469061us) raft_consensus.cc:1685] finished
0709 13:08:29.894329 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.894456 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114229,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12191,"thread_start_us":684403,"threads_started":2,"wal-append.queue_time_us":615073}
I20260709 13:08:29.945253 28142 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:29.945427 28182 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:29.944916 21771 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:08:29.945815 22575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.031s
W20260709 13:08:29.980204 22575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.003s	sys 0.031s
I20260709 13:08:29.966975 21866 rpcz_store.cc:276] 0709 13:08:28.607769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.607916 (+   147us) service_pool.cc:224] Handling call
0709 13:08:28.610745 (+  2829us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:28.781536 (+170791us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b48000801d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:08:28.848526 (+ 66990us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:28.975401 (+126875us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.325897 (+350496us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:29.353109 (+ 27212us) log.cc:844] Serialized 52 byte log entry
0709 13:08:29.353994 (+   885us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:29.355062 (+  1068us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.355898 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.356015 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.893743 (+537728us) raft_consensus.cc:1685] finished
0709 13:08:29.893762 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.893896 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2626,"prepare.queue_time_us":134725,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":86,"raft.queue_time_us":121505,"raft.run_cpu_time_us":2099,"raft.run_wall_time_us":91136,"spinlock_wait_cycles":72673024,"thread_start_us":522851,"threads_started":2,"wal-append.queue_time_us":774958}
W20260709 13:08:29.949292 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.981094 21916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:29.951531 28160 log.cc:927] Time spent T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.441s	user 0.001s	sys 0.000s
I20260709 13:08:29.985610 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:29.883649 28143 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:29.953634 21945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 2908) took 1018 ms. Trace:
I20260709 13:08:29.822503 28141 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:29.908221 21875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2536) took 1316 ms. Trace:
W20260709 13:08:29.907532 22576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.011s
W20260709 13:08:29.988361 22576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.014s	sys 0.011s
I20260709 13:08:29.988267 21875 rpcz_store.cc:276] 0709 13:08:28.591702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.591856 (+   154us) service_pool.cc:224] Handling call
0709 13:08:28.592188 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:28.609859 (+ 17671us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:28.627062 (+ 17203us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.779975 (+152913us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b18002a0700. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f853f3 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:08:28.835858 (+ 55883us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:28.846138 (+ 10280us) log.cc:844] Serialized 52 byte log entry
0709 13:08:28.846298 (+   160us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:28.846331 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.846505 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.897719 (+1051214us) raft_consensus.cc:1685] finished
0709 13:08:29.907980 (+ 10261us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.908160 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18146,"prepare.queue_time_us":17595,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":26687,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":24489,"spinlock_wait_cycles":35006336,"thread_start_us":116135,"threads_started":1,"wal-append.queue_time_us":310239}
I20260709 13:08:29.953842 28147 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.992717 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:29.995121 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:29.988049 21945 rpcz_store.cc:276] 0709 13:08:28.934903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.935044 (+   141us) service_pool.cc:224] Handling call
0709 13:08:28.935450 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.996364 (+ 60914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.996396 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.996446 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:28.996477 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.943432 (+946955us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b540012fa54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:29.943719 (+   287us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.953547 (+  9828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139613568}
W20260709 13:08:29.896554 28060 consensus_meta.cc:287] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.001s
I20260709 13:08:29.876017 28077 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:29.899533 28105 consensus_queue.cc:1243] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:29.911691 28173 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.903000 22016 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:08:29.943678 28033 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.142s	user 0.012s	sys 0.000s
I20260709 13:08:29.921877 28090 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.998551 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:29.999238 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 182397us
I20260709 13:08:29.919005 28162 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.014101 28077 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.015998 27743 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:29.943209 27899 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.002317 28183 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.020920 28090 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:29.897560 28158 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.023759 28090 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:29.908628 27849 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.024868 28158 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.003676 28060 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.033521 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44780 (request call id 1114) took 1061 ms. Trace:
I20260709 13:08:29.981288 28144 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.034006 21867 rpcz_store.cc:276] 0709 13:08:28.971614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.972703 (+  1089us) service_pool.cc:224] Handling call
0709 13:08:28.973025 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.973337 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.973364 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.974995 (+  1631us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.238474 (+263479us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:29.238535 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.238628 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.033230 (+794602us) raft_consensus.cc:1685] finished
0709 13:08:30.033265 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.033457 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":422,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":21248,"thread_start_us":259792,"threads_started":1,"wal-append.queue_time_us":415824}
I20260709 13:08:30.034992 28060 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.035547 28144 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.035897 28033 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.036896 28015 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.038048 28033 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:29.967777 27714 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:30.038520 28091 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.038790 27714 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.040939 28143 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.041550 22603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57074 (request call id 842) took 1185 ms. Trace:
I20260709 13:08:30.042033 22608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57070 (request call id 1188) took 1751 ms. Trace:
I20260709 13:08:30.043180 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.041944 22603 rpcz_store.cc:276] 0709 13:08:28.856753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.857048 (+   295us) service_pool.cc:224] Handling call
0709 13:08:28.959644 (+102596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.971770 (+ 12126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.971798 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.001879 (+ 30081us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.342839 (+340960us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:29.791733 (+448894us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.792047 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.792140 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.041310 (+249170us) raft_consensus.cc:1685] finished
0709 13:08:30.041328 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.041471 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19651,"prepare.queue_time_us":618885,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":2967,"raft.queue_time_us":117668,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":26246,"thread_start_us":674290,"threads_started":2,"wal-append.queue_time_us":994737}
I20260709 13:08:30.044253 22023 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:29.934262 28149 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:08:30.044713 22017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3405) took 1050 ms. Trace:
I20260709 13:08:29.980041 28142 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.045132 22017 rpcz_store.cc:276] 0709 13:08:28.994591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.994799 (+   208us) service_pool.cc:224] Handling call
0709 13:08:29.007595 (+ 12796us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:29.019594 (+ 11999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.019643 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:29.020371 (+   728us) log.cc:844] Serialized 52 byte log entry
0709 13:08:29.348674 (+328303us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:29.348721 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.348800 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.044451 (+695651us) raft_consensus.cc:1685] finished
0709 13:08:30.044472 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.044632 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12441,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":58413,"thread_start_us":250566,"threads_started":1,"wal-append.queue_time_us":956763}
I20260709 13:08:30.049374 28147 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.051097 28173 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:30.051327 22021 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:30.042611 22608 rpcz_store.cc:276] 0709 13:08:28.290891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.291046 (+   155us) service_pool.cc:224] Handling call
0709 13:08:28.291385 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.291741 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.291768 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:28.860837 (+569069us) spinlock_profiling.cc:243] Waited 8.95 ms on lock 0x7b2c00047568. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:08:28.861388 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.238740 (+377352us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:29.238784 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.238863 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.041721 (+802858us) raft_consensus.cc:1685] finished
0709 13:08:30.041746 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.041970 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1050,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":20591360,"thread_start_us":374563,"threads_started":1,"wal-append.queue_time_us":581858}
I20260709 13:08:30.061592 28147 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.063124 28040 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:30.063620 28040 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:30.070552 27925 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:30.071941 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.073051 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.073367 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.073625 28139 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.074224 28139 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.074764 28028 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:30.081897 28086 consensus_meta.cc:287] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.000s
W20260709 13:08:30.083320 28069 consensus_meta.cc:287] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.005s
I20260709 13:08:30.083886 28069 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.021168 28183 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.086087 28069 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:30.087584 28105 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.088160 28105 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.091070 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.091284 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.091739 22608 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 10.
I20260709 13:08:30.090749 28105 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.092281 28141 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.092729 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.093693 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:30.099488 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 271489us
I20260709 13:08:30.082384 28086 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.102979 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.106838 21841 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:30.109810 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.111490 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:30.112005 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.112897 22023 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:30.113730 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.114432 21866 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 11.
I20260709 13:08:30.115338 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.115934 22021 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 11.
I20260709 13:08:30.116119 22020 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:30.117525 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.119969 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.121630 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.123208 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:30.124910 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.125903 22021 raft_consensus.cc:2393] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 11: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:30.112108 21874 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:30.131371 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 303516us
W20260709 13:08:30.142176 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44113.6us
I20260709 13:08:30.146241 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.150708 22016 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:30.154062 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.086107 28183 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.154711 22017 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
I20260709 13:08:30.040940 27714 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.142724 21839 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:30.173069 21868 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:08:30.127628 28062 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.187101 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:30.187692 21942 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.175081 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:30.189312 22606 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:30.176525 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:30.190236 22608 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.190261 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:30.127313 28050 consensus_queue.cc:1048] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:08:30.182935 28187 consensus_queue.cc:1059] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:30.184425 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.185178 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.185735 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:30.150347 28143 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:08:30.064468 28040 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.142192 28147 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:30.188172 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.200654 21874 raft_consensus.cc:2468] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:30.175091 27743 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.101977 28033 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:08:30.221351 22603 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 10.
I20260709 13:08:30.175581 28090 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:30.235342 28079 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.000s
I20260709 13:08:30.240710 28180 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.241336 28180 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.243482 28142 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.243906 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.245925 28173 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.249593 22015 raft_consensus.cc:606] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:30.250051 22015 raft_consensus.cc:614] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:30.200984 28062 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.251371 28139 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.252812 28062 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.254518 28086 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.255750 22019 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 13.
W20260709 13:08:30.257054 28152 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.913s	user 0.003s	sys 0.004s
I20260709 13:08:30.259613 21866 raft_consensus.cc:1240] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:30.265724 21942 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:30.175838 28185 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:30.268795 28121 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:30.269183 28187 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.203912 28105 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.171409 28135 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:08:30.259332 28090 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.191295 27714 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:30.260592 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.278030 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:30.263589 28173 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.288694 22604 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:30.289515 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.281888 28037 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:30.291771 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.287760 21872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50258 (request call id 2539) took 1687 ms. Trace:
I20260709 13:08:30.277175 28069 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.276850 28062 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:30.301745 28142 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.305235 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51360 (request call id 34) took 1595 ms. Trace:
I20260709 13:08:30.305773 27917 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.305404 27899 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.260176 27743 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.311942 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:30.306360 28040 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:30.365087 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 177463us
I20260709 13:08:30.320132 22608 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:30.338613 22606 raft_consensus.cc:2468] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
W20260709 13:08:30.347860 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 69897.2us
I20260709 13:08:30.368957 22603 raft_consensus.cc:1240] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:30.369135 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:30.318905 28185 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:30.348073 21872 rpcz_store.cc:276] 0709 13:08:28.600675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.601147 (+   472us) service_pool.cc:224] Handling call
0709 13:08:28.601543 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:28.754683 (+153140us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b48000801d8. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635af9baa1 00007f635af92b37 00007f635af929ca 00007f635b08a26f 00007f635b089f37 00007f635b09e55c 00007f635b09e508 00007f635b09e488 00007f635b09e443 00007f635b09d6ec 00007f6359fc7a96
0709 13:08:29.019746 (+265063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.019781 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.030690 (+ 10909us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.415786 (+385096us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:29.874590 (+458804us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.278616 (+404026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.279630 (+  1014us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.279697 (+    67us) raft_consensus.cc:1685] finished
0709 13:08:30.287574 (+  7877us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.287707 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9836,"prepare.queue_time_us":631514,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":21981,"raft.run_cpu_time_us":5961,"raft.run_wall_time_us":154550,"spinlock_wait_cycles":23740288,"thread_start_us":1538494,"threads_started":4,"wal-append.queue_time_us":584401}
I20260709 13:08:30.356274 22015 rpcz_store.cc:276] 0709 13:08:28.709752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.712796 (+  3044us) service_pool.cc:224] Handling call
0709 13:08:30.305039 (+1592243us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400365e54. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635606c853 00007f635b03a60a 00007f63545c07d4 00007f63545c0762 00007f63545c0691 00007f63545c060c 00007f63545bf8c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:30.305152 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3432487808}
I20260709 13:08:30.347321 28037 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:30.343546 28090 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.380355 27899 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:30.331209 28187 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.337702 28105 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.320966 28121 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.386221 28187 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.386446 28121 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:30.386688 28105 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.347118 27714 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.388870 27714 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.362303 27917 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.358661 28062 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.391810 27917 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.392078 28062 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.357210 28069 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.393818 27743 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.394475 28069 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:30.374078 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:30.353417 28139 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:30.376731 28185 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:30.425557 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 48976.3us
I20260709 13:08:30.433844 22024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:30.434803 22024 raft_consensus.cc:606] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:30.435240 22024 raft_consensus.cc:614] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:30.437963 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 63972.2us
I20260709 13:08:30.438869 21914 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:30.440855 28139 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.441776 28139 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:30.442406 28139 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.444810 28105 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:30.446496 28062 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:30.447029 28062 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.449735 28037 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.440400 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:30.463652 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 97099.2us
I20260709 13:08:30.464360 21914 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:30.471279 22022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43308 (request call id 3406) took 1084 ms. Trace:
I20260709 13:08:30.472450 27943 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:30.471753 22022 rpcz_store.cc:276] 0709 13:08:29.387032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.387226 (+   194us) service_pool.cc:224] Handling call
0709 13:08:29.387579 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.824803 (+437224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.824833 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.040087 (+215254us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b2c00103538. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635496ba11 00007f635497b372 00007f63560ada01 00007f635607243a 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2
0709 13:08:30.040580 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.326068 (+285488us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:30.326133 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.326239 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.470979 (+144740us) raft_consensus.cc:1685] finished
0709 13:08:30.471000 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.471215 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25455,"raft.queue_time_us":114738,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":9867,"spinlock_wait_cycles":3300608,"thread_start_us":713516,"threads_started":2,"wal-append.queue_time_us":410162}
I20260709 13:08:30.473068 27943 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.475448 28162 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.477658 28000 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.479018 28180 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:30.481519 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49213.8us
W20260709 13:08:30.482251 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.482231 21771 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.483222 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:30.485152 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.484496 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:30.493101 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.494773 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.496357 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:30.497346 22022 raft_consensus.cc:606] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:30.502279 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:30.505052 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.512153 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.513857 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.514668 21872 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:30.516484 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.520371 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:30.520525 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.521368 21948 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:30.475860 28062 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.524919 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.525841 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.527796 21867 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 13: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:30.529145 21871 raft_consensus.cc:1275] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:08:30.524220 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 59447.1us
I20260709 13:08:30.530717 21873 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:30.475471 27943 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.544502 28049 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:30.486653 28163 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:30.498179 28199 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:30.502027 27743 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:30.549371 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.550179 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:30.627077 21948 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 23.
W20260709 13:08:30.637091 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 86965.4us
I20260709 13:08:30.637456 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.638732 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:30.634423 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 81672.3us
W20260709 13:08:30.638727 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73290.2us
I20260709 13:08:30.636379 21949 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:08:30.646536 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.545778 28183 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:30.649559 21988 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:30.647212 21949 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:30.655961 28141 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.656059 27849 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.656723 28141 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.655439 28143 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:30.661661 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.669268 21948 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 23: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:30.661892 28143 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.671020 21868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 3031) took 1610 ms. Trace:
I20260709 13:08:30.671458 21868 rpcz_store.cc:276] 0709 13:08:29.060247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.231316 (+171069us) service_pool.cc:224] Handling call
0709 13:08:29.231817 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.173759 (+941942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.670574 (+496815us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54000e10d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:30.670754 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136599424}
I20260709 13:08:30.672200 28143 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.675312 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:30.547631 28086 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:30.662251 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.676558 28163 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.646662 28028 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:30.646428 28212 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:30.679248 27714 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:30.551520 28049 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.692453 22022 raft_consensus.cc:606] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:30.678371 28141 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.695990 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.688398 28163 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.686035 28159 consensus_queue.cc:1059] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:08:30.696324 28183 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:30.701512 28183 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:30.702106 28214 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:30.704588 28163 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:30.711171 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 61724.2us
I20260709 13:08:30.712929 28197 raft_consensus.cc:2804] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:30.713748 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:30.718024 21988 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:30.716812 28180 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:30.723757 28049 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.643152 28199 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.692380 27714 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.690842 28212 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.725975 28212 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.726742 27714 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.647953 27743 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.713513 28197 raft_consensus.cc:697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:30.729661 27743 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.730082 28197 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.674789 28090 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.732362 28106 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.733268 28199 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.732931 28090 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.733270 21874 raft_consensus.cc:2368] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12.
I20260709 13:08:30.734071 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:30.685554 28086 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.734688 22606 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:30.735565 28139 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.736415 28086 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:30.743444 22606 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:30.745085 21839 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:30.745414 28091 raft_consensus.cc:3055] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:30.745868 28091 raft_consensus.cc:740] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:30.747428 28086 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:30.747728 28091 consensus_queue.cc:260] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.748286 28086 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:30.748998 28091 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.749673 28086 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.743511 28185 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:30.755752 28185 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:30.756973 28180 raft_consensus.cc:2804] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:30.757628 28180 raft_consensus.cc:697] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:30.758569 28180 consensus_queue.cc:237] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.763932 28120 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.764631 28120 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:30.764998 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47049.3us
I20260709 13:08:30.766981 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:30.767699 28120 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:30.769747 22020 pending_rounds.cc:85] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 9
I20260709 13:08:30.770104 22020 pending_rounds.cc:107] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:08:30.770380 22020 raft_consensus.cc:2889] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.776718 28198 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:30.780972 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.760820 28212 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.787899 28198 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:30.791671 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:30.799630 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.800419 22608 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:30.801265 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.802134 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.802524 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.802785 21871 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:30.804484 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.805260 22609 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 23: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:30.806804 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:30.807161 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:30.803107 21867 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:30.807725 21871 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.813997 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:30.815004 22606 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:30.787868 28212 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:30.796988 28036 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:30.829931 28036 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:30.830456 28036 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.840821 28166 consensus_queue.cc:1048] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:30.843346 28037 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:30.846792 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 382463us
I20260709 13:08:30.816653 28090 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:30.861481 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:30.859019 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:30.864749 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 166831us
I20260709 13:08:30.869552 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.872591 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:30.847651 27917 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:30.870832 21987 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:30.870738 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:30.885481 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.888581 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:30.889355 21950 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
I20260709 13:08:30.905252 21871 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:30.869207 27849 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:30.916848 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:30.889019 28212 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:30.920202 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.919171 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:30.920974 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.921950 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.927922 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:30.945608 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 48607.2us
I20260709 13:08:30.932484 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:30.946156 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.934726 21841 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:30.939616 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:30.949800 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:30.950016 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.950724 22019 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:30.951793 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.952585 22016 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:30.955406 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:30.981881 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:30.958033 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:30.985556 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.986202 22018 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:30.960180 22015 raft_consensus.cc:2393] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:30.988662 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.890677 28166 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:08:30.915264 28120 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:30.959066 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:30.891181 27925 consensus_queue.cc:1059] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:08:30.957722 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.000350 22017 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:30.957507 28086 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:30.914395 28060 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:30.942965 28212 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.003391 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 54733.4us
I20260709 13:08:30.998584 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:31.004871 22024 raft_consensus.cc:2393] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:30.983374 28180 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:30.917523 27849 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:30.988224 28069 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:30.997287 28120 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.006465 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 130638us
I20260709 13:08:31.005263 28086 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.027882 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:31.065567 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:31.028831 28227 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:08:31.038131 28226 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:08:31.027685 28222 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:08:31.045351 28139 raft_consensus.cc:3055] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:31.114251 28139 raft_consensus.cc:740] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:31.115234 28139 consensus_queue.cc:260] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.063000 28120 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.029299 28196 raft_consensus.cc:993] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:31.105600 28070 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.063742 28086 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.079090 28049 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.012490 28212 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.010846 28180 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.118417 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:31.151315 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.151919 28211 raft_consensus.cc:1081] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:31.154059 28069 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:31.141301 21771 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 10, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 10 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.161271 22574 leader_election.cc:400] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12.
I20260709 13:08:31.161679 22574 leader_election.cc:403] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:31.166342 28090 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:31.166894 28090 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:31.174304 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:31.175256 22607 raft_consensus.cc:2393] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 12: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:31.012290 28060 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.174207 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.142693 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:31.116436 28139 raft_consensus.cc:3060] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:31.175740 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 287999us
I20260709 13:08:31.184778 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:31.186944 28166 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:31.187983 22023 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:31.189760 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:31.190456 28199 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.191072 28199 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.191500 27925 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.191962 27925 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:31.192368 27925 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.188416 28060 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:31.143940 28049 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.197570 28049 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.141619 28062 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.203277 28062 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.194675 28036 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.206653 28178 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) with higher term. Message: Invalid argument: T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 11. Current term is 12.
I20260709 13:08:31.175153 28180 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:31.211220 21771 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 14, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 14 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.222990 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:31.206323 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 45203.9us
I20260709 13:08:31.226882 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.227787 21948 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:31.232038 21916 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:31.214222 21771 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.247378 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:31.215246 22573 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:31.257494 22016 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 23.
I20260709 13:08:31.246356 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:31.270780 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 128200us
I20260709 13:08:31.257040 22573 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:31.248210 27925 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.276902 21947 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:31.277896 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.278537 22015 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:31.240257 27917 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.288245 21943 raft_consensus.cc:3055] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:08:31.289870 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.289958 21943 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:31.293176 21943 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.298207 21943 raft_consensus.cc:3060] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.266448 28135 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:31.297180 22015 raft_consensus.cc:1240] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:31.276470 28178 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:31.302556 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:31.303429 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:31.312054 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:31.299768 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.291270 28070 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:31.318081 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.301687 21987 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:31.356088 28205 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:31.316512 28176 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:31.297267 27917 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.350350 28135 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:31.350471 28178 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 23 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:31.357613 28182 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:31.362900 28199 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.366890 28070 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:31.495965 21838 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.2:44983 timed out after 1.822s (SENT) [suppressed 20 similar messages]
I20260709 13:08:31.356356 28069 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:31.381034 28176 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:31.520200 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:31.523967 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.493099 27943 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:31.516969 28193 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:31.509864 28182 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:31.527223 28176 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.537902 28231 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:31.558892 28247 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:31.560241 28036 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:31.525104 28106 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:31.578035 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.593314 21943 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:08:31.595474 22016 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:31.596366 21943 pending_rounds.cc:85] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 9
I20260709 13:08:31.526238 28069 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.600209 21943 pending_rounds.cc:107] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:08:31.557513 27925 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.601326 21943 raft_consensus.cc:2889] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.612035 28247 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:31.612773 28247 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.615473 28247 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.593058 28028 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.616158 28028 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.616629 28178 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.618294 28028 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.620899 21869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:08:31.621454 21869 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.621804 21869 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:31.562520 28182 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.566015 27849 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:31.573308 28062 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.563128 27917 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.553215 27943 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.651201 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.655355 21868 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:31.641775 21869 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.656438 21873 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:31.571902 28120 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.667143 28176 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:31.672297 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 424992us
I20260709 13:08:31.673475 21947 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:31.624075 28212 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.616323 28180 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.687885 21869 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:31.695586 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 393111us
I20260709 13:08:31.695976 22019 raft_consensus.cc:2393] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 15: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:31.696143 21872 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:31.697160 21841 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:08:31.700139 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 388162us
I20260709 13:08:31.702368 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:31.704496 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.705353 21948 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:31.706549 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.707361 21944 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:31.709154 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.711045 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.600001 28070 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.720067 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.720764 22024 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:31.721729 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.723608 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.726681 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.728272 21944 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 12.
I20260709 13:08:31.643970 28090 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.715067 21949 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:31.713889 22020 raft_consensus.cc:2368] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14.
W20260709 13:08:31.699455 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 402814us
I20260709 13:08:31.671306 28040 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:31.719384 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.719652 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.731052 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.732096 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.742777 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.743597 21948 raft_consensus.cc:2410] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:31.744745 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.745118 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:31.747167 22603 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:31.716827 28036 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:31.717732 28196 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:31.716650 28247 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:31.749723 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.757872 21869 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:31.758687 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.759994 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:31.760989 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.716671 27849 consensus_queue.cc:1059] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:31.764561 21875 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:31.764968 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.699713 28062 consensus_queue.cc:1048] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:08:31.716928 27699 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:31.699432 28233 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:31.732034 28185 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:31.714471 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 218504us
I20260709 13:08:31.774655 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.780468 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.780658 21944 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:31.754763 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.784047 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:31.789304 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:31.751971 28248 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.790580 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.799310 22016 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:31.758904 28036 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:31.791855 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.765573 28247 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:31.809463 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.800725 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.791641 21867 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 18. Current term is 19. Ops: [16.10-18.12]
I20260709 13:08:31.815482 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.816366 22022 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:31.815758 21916 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:31.825793 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:31.751709 28040 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.830112 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.814653 28247 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:31.834177 27943 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.835177 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.836165 21942 raft_consensus.cc:2393] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:31.827261 28086 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
I20260709 13:08:31.837459 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.838994 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.839717 28040 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:31.811877 28248 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.837302 28086 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.847247 28248 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.847301 28086 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:31.869514 28244 log.cc:927] Time spent T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:31.794265 28185 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.875717 28185 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:31.793157 28037 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.876703 28037 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.879351 28037 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:31.880177 28233 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:31.880888 28233 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.883517 28233 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:31.884939 28251 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:31.887718 28069 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:31.889209 28176 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:31.890146 28212 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:31.787537 27699 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.894761 28120 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:31.810393 27743 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:31.896682 28180 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:31.897357 28049 consensus_meta.cc:287] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.000s
W20260709 13:08:31.898434 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 82725.9us
I20260709 13:08:31.899948 27899 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:31.902853 28105 raft_consensus.cc:3055] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:31.903890 21771 catalog_manager.cc:5697] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 13, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 13 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:31.909351 21770 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 254) took 31048 ms (client timeout 15000 ms). Trace:
I20260709 13:08:31.886154 28247 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:31.894207 28090 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:31.922761 28254 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:08:31.935722 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:31.940976 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:31.944130 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.840330 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:31.814054 28036 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:31.924417 28236 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
W20260709 13:08:31.971526 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.770107 28196 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:31.983001 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:32.019919 21872 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:31.920240 28193 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:32.020167 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:31.970691 27899 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.993795 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:31.980187 28105 raft_consensus.cc:740] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:31.991886 21771 catalog_manager.cc:5697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 10, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 10 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.887413 28251 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:32.008155 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 72506.3us
I20260709 13:08:32.022598 28193 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.025848 28062 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:32.026672 28247 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.029004 28196 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:32.024356 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:31.970744 27743 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.021600 28180 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:31.981992 28049 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.031602 27899 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:32.047346 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 250008us
I20260709 13:08:32.046700 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.048728 22018 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:32.051662 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:32.057660 21916 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:32.045044 28062 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.041699 28251 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:08:32.055233 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 271272us
I20260709 13:08:32.062685 22017 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:32.050735 28180 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:32.059456 28196 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:32.067490 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:32.056142 28247 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:32.071173 21838 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:32.054083 28259 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:32.072289 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.061964 21771 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 12 to 13, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 13 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.061921 28234 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:32.064803 28062 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.063522 28263 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.078930 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.081799 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.081921 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.087759 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.074849 28251 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.090790 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.072909 28180 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.092303 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.137634 21870 raft_consensus.cc:1240] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:32.092856 28235 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.528s	user 0.003s	sys 0.000s
I20260709 13:08:32.098269 28196 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:32.098429 28069 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:32.098966 28060 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:32.105937 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.106204 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.106666 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.107551 22609 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:32.154631 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 845244us
I20260709 13:08:32.154906 28256 consensus_queue.cc:1059] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:32.109720 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:32.157241 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 47612.9us
I20260709 13:08:32.158186 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.111363 27743 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.160782 27743 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.161531 27743 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.114614 28270 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:32.166289 28260 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:32.167475 28260 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:32.167882 28260 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:32.169322 28233 raft_consensus.cc:493] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:32.169950 28233 raft_consensus.cc:515] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.173118 21838 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.058144 28105 consensus_queue.cc:260] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.178257 28105 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:32.178638 28026 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:32.179349 28026 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.120766 28049 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:32.131878 21871 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:32.083989 28247 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.138839 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.181666 21868 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 14: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
W20260709 13:08:31.981244 21770 rpcz_store.cc:269] 0709 13:08:00.860900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.861194 (+   294us) service_pool.cc:224] Handling call
0709 13:08:31.909141 (+31047947us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:23.862039 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:23.862746 (+   707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:23.862804 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:08:23.862823 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:23.878761 (+ 15938us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:23.878930 (+   169us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:23.878976 (+    46us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:08:24.351243 (+472267us) tablet.cc:701] Row locks acquired
0709 13:08:24.376119 (+ 24876us) write_op.cc:260] PREPARE: finished
0709 13:08:24.389513 (+ 13394us) write_op.cc:270] Start()
0709 13:08:24.395623 (+  6110us) write_op.cc:276] Timestamp: P: 1783602504384070 usec, L: 0
0709 13:08:24.395656 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:08:24.396480 (+   824us) log.cc:844] Serialized 8971 byte log entry
0709 13:08:25.374396 (+977916us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.737130 (+362734us) write_op.cc:301] APPLY: starting
0709 13:08:25.737333 (+   203us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:26.029439 (+292106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:26.029697 (+   258us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:26.442395 (+412698us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:26.585137 (+142742us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:08:26.585208 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:26.585803 (+   595us) log.cc:844] Serialized 204 byte log entry
0709 13:08:26.870407 (+284604us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6352f680ac 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b
0709 13:08:27.211043 (+340636us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.211481 (+   438us) write_op.cc:454] Released schema lock
0709 13:08:27.211568 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:27.212095 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.212131 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":985455,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":362275,"apply.run_cpu_time_us":76545,"apply.run_wall_time_us":1474980,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100405,"num_ops":23,"prepare.queue_time_us":46079,"prepare.run_cpu_time_us":52231,"prepare.run_wall_time_us":782029,"raft.queue_time_us":692917,"raft.run_cpu_time_us":23512,"raft.run_wall_time_us":240478,"replication_time_us":978511,"spinlock_wait_cycles":9735552,"thread_start_us":1339429,"threads_started":5,"wal-append.queue_time_us":862785,"wal-append.run_cpu_time_us":32365,"wal-append.run_wall_time_us":2290666}]]}
I20260709 13:08:32.182698 28247 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.079892 28259 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.183624 28259 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.181690 28026 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:32.186033 28026 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:32.186857 28241 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.526s	user 0.001s	sys 0.001s
I20260709 13:08:32.086150 28234 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.188885 27714 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.188920 28234 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.189713 27714 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:32.117528 27699 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:32.178512 28106 consensus_queue.cc:1175] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "51e52b544fab4275aab4f7fbe81942d2" responder_term: 19 status { last_received { term: 19 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 19 index: 10 } }
I20260709 13:08:32.186614 28026 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.193619 28252 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.194218 28252 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.195075 28026 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:32.196933 28182 consensus_meta.cc:287] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 13:08:32.172286 28233 leader_election.cc:290] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:32.197067 28252 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.140322 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.201675 21771 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.200356 28013 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:32.208977 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.215881 21868 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:32.198347 28069 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:32.176002 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.087373 28267 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:32.220329 21867 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.216958 22574 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:32.220867 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.219298 21771 catalog_manager.cc:5697] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:32.222144 21771 catalog_manager.cc:5697] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 8 to 13, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 13 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.221498 21946 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:32.222975 21916 leader_election.cc:400] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14.
I20260709 13:08:32.223165 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:32.223430 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 47553us
I20260709 13:08:32.225981 21771 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:32.231011 21916 leader_election.cc:403] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:32.228964 22021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60038 (request call id 848) took 1305 ms. Trace:
I20260709 13:08:32.230800 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.230754 21771 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.233197 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.233904 21947 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.231523 22021 rpcz_store.cc:276] 0709 13:08:30.923160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.961377 (+ 38217us) service_pool.cc:224] Handling call
0709 13:08:30.961815 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.962284 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.962323 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.983407 (+ 21084us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.273594 (+290187us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:31.273643 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.273713 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.092218 (+818505us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:32.215259 (+123041us) raft_consensus.cc:1685] finished
0709 13:08:32.215292 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.228861 (+ 13569us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":784,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12174,"spinlock_wait_cycles":48387456,"thread_start_us":289760,"threads_started":1,"wal-append.queue_time_us":558070}
I20260709 13:08:32.172129 28119 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:08:32.238076 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.253024 21914 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.219298 28069 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:32.203763 28196 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.253357 21867 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:32.233693 28233 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:32.275882 27925 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.275802 28267 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.276796 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:32.298336 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.299100 21987 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:32.202720 28260 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.234969 28013 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:32.234788 27899 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.292857 21947 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 14.
I20260709 13:08:32.295485 21771 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 14 to 15, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:32.290305 21943 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:08:32.309612 21943 pending_rounds.cc:85] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 13
I20260709 13:08:32.309880 21943 pending_rounds.cc:107] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:08:32.310158 21943 raft_consensus.cc:2889] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:32.214179 28182 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.254288 28246 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:32.318673 21771 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 17, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 17 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.239392 27917 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:08:32.242002 28231 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:08:32.280299 28036 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.317041 28178 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:32.322180 28247 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:32.327217 28247 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.318863 28199 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:32.328121 28069 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.328423 28199 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.329524 28069 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.311594 28106 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 13. Current term is 14.
I20260709 13:08:32.329672 28247 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.331651 28263 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.314522 28253 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:32.332370 28253 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.305346 28013 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.332732 28253 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.332909 28013 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.304957 28267 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:32.316154 27849 consensus_queue.cc:1175] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" responder_term: 17 status { last_received { term: 15 index: 15 } last_committed_idx: 15 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:32.289780 28193 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.340016 28193 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:32.340782 28248 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:32.341527 28248 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.343776 27917 consensus_queue.cc:1243] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:32.344099 28248 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.344374 27917 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:32.349784 27917 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:32.350594 27917 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.351770 27917 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.327204 28178 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.348138 28062 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.354298 21868 raft_consensus.cc:1240] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:32.360886 21771 catalog_manager.cc:5697] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 14 to 16, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 16 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.362749 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.362601 21771 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 11 to 14, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 14 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.363340 21941 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:32.370424 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:32.372112 28178 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.344151 28259 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.376247 28185 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:32.376771 28049 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:32.381328 28199 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.382042 28105 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:32.386328 21944 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:32.321817 28260 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.392428 21771 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.394531 21941 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
I20260709 13:08:32.406462 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:32.313930 28251 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.410403 21987 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:32.410393 21771 catalog_manager.cc:5697] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 16, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 16 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:32.411353 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.411585 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.411752 21771 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 9 to 12, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 12 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:32.413558 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.413969 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.414726 22018 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:32.415091 22018 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:32.417297 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:32.418942 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 263140us
I20260709 13:08:32.419037 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.421509 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.434523 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.437785 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.439538 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.440505 22020 raft_consensus.cc:2393] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 13: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:32.442183 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.444976 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.446638 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.448743 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.404843 28176 raft_consensus.cc:3055] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:32.415975 22018 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.471071 22018 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.451423 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.457409 28259 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.457264 28040 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:32.483975 22015 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:32.457293 22017 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:08:32.458400 28269 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:08:32.461788 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.489615 22019 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.466952 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.406101 28105 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:32.475050 22023 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:32.405361 28185 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:32.395788 27943 consensus_queue.cc:1059] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:08:32.487844 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.499675 21867 raft_consensus.cc:2393] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 15: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:32.443135 28037 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:32.451804 28197 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.491838 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.511029 21868 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.500190 21873 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:32.469802 28176 raft_consensus.cc:740] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:32.502974 21841 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:32.507071 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.514334 21841 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.529695 22018 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
I20260709 13:08:32.531114 22019 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
W20260709 13:08:32.532379 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 279406us
I20260709 13:08:32.532824 21916 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:32.534281 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.534555 22019 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:08:32.479123 27940 consensus_queue.cc:1175] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95296a4420ed41b69191d3d4353cf2b0" responder_term: 19 status { last_received { term: 18 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:32.548545 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.550726 28267 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.554260 28252 raft_consensus.cc:3055] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:32.556792 28197 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:32.545818 28166 consensus_queue.cc:1059] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:08:32.560616 21841 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:32.560479 28247 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:32.593092 21914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.525980 28249 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:32.570130 28251 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.570663 28176 consensus_queue.cc:260] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.525811 28199 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:32.493568 28013 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.680197 28013 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.572870 28276 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:32.574478 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:32.576202 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.682538 22018 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:32.579329 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.683585 21867 raft_consensus.cc:2393] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:32.541237 28180 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.685727 28180 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:32.595316 28197 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.685900 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.686597 22018 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.592629 28252 raft_consensus.cc:740] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:32.689369 28252 consensus_queue.cc:260] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.689898 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.690744 28252 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:32.692915 22022 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:32.596566 28185 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.701560 21950 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for term 18 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 15.
I20260709 13:08:32.598608 28234 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.546706 28037 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:32.547344 28259 raft_consensus.cc:2804] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:32.704416 22603 raft_consensus.cc:1275] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:32.704535 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.705106 28259 raft_consensus.cc:697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:32.705281 21875 raft_consensus.cc:3060] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.705945 28259 consensus_queue.cc:237] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.706487 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.596563 28166 raft_consensus.cc:3055] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:32.708354 28166 raft_consensus.cc:740] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:32.708763 28176 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.709170 28166 consensus_queue.cc:260] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.710168 28166 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.711748 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.593519 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:08:32.713018 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 119582us
I20260709 13:08:32.713660 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:32.600955 28182 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:32.717260 21871 raft_consensus.cc:1240] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:32.717250 28199 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:32.718690 28199 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:32.719080 28199 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.719223 28249 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:32.719810 28249 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 19 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:32.602747 27899 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.603585 28062 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.604864 28196 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:32.720731 28249 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.500677 28105 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.722666 28105 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:32.724434 21872 raft_consensus.cc:1240] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:08:32.725153 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.726105 22024 raft_consensus.cc:2393] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:32.727069 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:32.728180 28246 consensus_queue.cc:1175] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "51e52b544fab4275aab4f7fbe81942d2" responder_term: 15 status { last_received { term: 13 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [14.8-14.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:32.731091 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.607407 28253 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.622712 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.731134 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.733098 22609 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:32.623067 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.734299 22023 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.734411 28253 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:32.622761 28267 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.647957 28263 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:32.735534 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.736049 22016 raft_consensus.cc:2368] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:32.735915 28263 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.650597 28233 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:32.737968 28233 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.740409 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.740996 22016 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.665259 21944 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:32.578279 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:32.742300 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 164105us
I20260709 13:08:32.742811 28267 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:32.598495 28248 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:32.744901 28248 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:32.745761 28248 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.747028 28037 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.602116 28036 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.604897 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.744385 21838 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:32.751380 28036 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.735363 22015 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.753461 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af20d42858245eb986768009de88379" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.754038 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.755731 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.756573 28060 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:32.756947 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:32.757345 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.736178 21945 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.757921 21872 raft_consensus.cc:3060] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.758328 28267 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:32.758826 28267 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:32.756422 21870 raft_consensus.cc:3060] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.761374 28267 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:32.740430 28233 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:32.751411 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:32.765421 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:32.766022 21871 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.766189 21838 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:32.766911 28036 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.767555 28036 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:32.752228 28234 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:32.774592 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.775100 21871 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:32.778048 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:32.780634 28263 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:32.784238 21948 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:32.848825 21987 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:32.593796 21868 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:32.790474 21945 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:32.850942 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.791563 21875 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:32.796030 21841 leader_election.cc:400] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:32.804173 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.853091 21841 leader_election.cc:403] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:32.804467 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.805805 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.854954 21874 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
I20260709 13:08:32.808948 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:32.857270 22608 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:32.810456 22607 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:32.811105 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.812268 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.862592 22610 raft_consensus.cc:2368] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16.
I20260709 13:08:32.816455 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.864195 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.865381 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.866199 21942 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:32.867195 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.818460 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.818604 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.818032 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.818919 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.819307 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.819981 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.820958 22016 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:32.821390 22015 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:32.822240 22018 raft_consensus.cc:2468] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:32.822160 22023 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:32.823603 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.825248 21870 raft_consensus.cc:2468] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:32.826400 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:32.868552 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.920063 21916 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:32.923735 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75046us
I20260709 13:08:32.829540 21872 raft_consensus.cc:2468] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:32.929234 21949 raft_consensus.cc:2368] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:32.928591 21947 raft_consensus.cc:2368] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:32.936950 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.937402 22608 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:32.921135 21944 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:32.943053 21916 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:32.935717 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:32.929791 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 103493us
I20260709 13:08:32.931236 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.938748 21947 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:32.932626 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.939678 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.933393 21942 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
W20260709 13:08:32.943840 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 153016us
I20260709 13:08:32.961748 22576 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:32.961899 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.962683 21949 raft_consensus.cc:2368] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:32.963891 21946 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:08:32.944825 21941 raft_consensus.cc:2393] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 14: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:32.945830 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.965826 21943 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:32.966295 21916 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:32.966058 21944 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
W20260709 13:08:32.967722 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.968549 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:32.970194 22021 raft_consensus.cc:1240] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:32.948280 28060 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:32.942384 28253 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:32.972237 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.972651 21988 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:32.973067 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.973351 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:32.974334 28185 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:32.985046 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:32.975788 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:32.985409 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:32.964423 28234 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:32.945550 28249 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:32.987483 21945 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 23 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:08:32.991508 21949 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:32.992008 28259 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:32.994261 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:32.998327 22603 raft_consensus.cc:2393] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:32.998821 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.000852 28267 consensus_queue.cc:1059] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:33.002003 28267 consensus_queue.cc:1243] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:33.002593 28267 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:33.003038 28267 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:33.004209 28180 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:32.970993 28233 raft_consensus.cc:2804] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:32.947450 28199 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:32.982026 28105 raft_consensus.cc:2804] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:33.008083 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:32.985054 28256 raft_consensus.cc:2804] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:33.019819 28199 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:33.005831 28234 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:33.024616 28234 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.069044 28105 raft_consensus.cc:697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:33.070158 28256 raft_consensus.cc:697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:33.069538 28263 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:32.997895 28259 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.068681 28267 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:33.074395 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 66502.3us
W20260709 13:08:33.074692 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 63884.4us
I20260709 13:08:33.089196 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:33.074224 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 64838.8us
I20260709 13:08:33.091871 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.091892 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:33.078624 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44215.8us
I20260709 13:08:33.015632 27899 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.008136 28060 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:33.095458 28060 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.015619 28246 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.097903 22573 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.030987 28180 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:33.030671 28233 raft_consensus.cc:697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:32.995680 28185 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.108230 22573 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.111241 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.077111 28253 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:33.087705 28259 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.121380 27943 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.121731 28040 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.114320 28284 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.124974 28233 consensus_queue.cc:237] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:33.129473 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.107867 28278 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:33.132367 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 163228us
I20260709 13:08:33.101819 28166 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.086149 28119 consensus_queue.cc:1048] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:08:33.149217 28295 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:08:33.160954 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 64843.8us
I20260709 13:08:33.151463 28256 consensus_queue.cc:237] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:33.154825 28296 log.cc:927] Time spent T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:08:33.150092 28253 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.170010 21949 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:33.117111 28267 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.167725 28280 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.201990 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:33.203276 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:33.203915 21872 raft_consensus.cc:3060] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.204017 22603 raft_consensus.cc:1240] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:33.214011 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 122258us
I20260709 13:08:33.215202 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.216777 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:33.218384 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:33.219985 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:33.220448 21872 raft_consensus.cc:2468] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:33.221608 28178 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:33.222285 28178 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:33.224965 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.225200 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:33.226487 28178 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:33.247210 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.193446 28062 consensus_queue.cc:1059] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:08:33.166857 28105 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.257268 28259 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.157363 28180 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.266347 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.244072 28049 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.266966 21914 leader_election.cc:304] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.269330 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:33.271344 21988 leader_election.cc:400] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16.
I20260709 13:08:33.271863 21988 leader_election.cc:403] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:33.274410 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.272666 28197 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:33.275207 28280 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.275394 28197 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.275668 28280 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:33.276053 28280 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.276580 28181 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:33.277258 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.278102 28234 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.278913 28234 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:33.280587 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55713.1us
I20260709 13:08:33.281433 21838 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.282723 21988 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.268006 27849 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.284190 22022 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:33.285055 28247 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:33.287362 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:33.288125 21949 raft_consensus.cc:2393] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 15: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:33.288250 21838 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.288305 21914 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.290058 28199 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.290761 28199 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.289754 27849 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:33.296299 21914 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.294049 21838 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.312668 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.316108 27940 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:33.327983 27940 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:33.297521 28276 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16.
I20260709 13:08:33.328963 27940 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:33.329963 27849 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:33.331692 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:33.332368 22022 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 23.
I20260709 13:08:33.332806 27849 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:33.333458 28199 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.332845 28185 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:33.334692 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 44942.7us
I20260709 13:08:33.335497 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.339362 28259 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:33.312167 28062 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.340564 28199 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.342082 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.344419 28062 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:33.344625 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48399.7us
I20260709 13:08:33.346896 28199 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.348389 21838 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.349627 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:33.350783 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:33.351661 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:33.353341 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:33.354660 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:33.355219 21867 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.355374 22023 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:33.350109 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:33.365419 21838 leader_election.cc:400] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:33.369885 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.376780 22016 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:33.280794 28233 raft_consensus.cc:2749] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.405017 21867 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:33.408202 21914 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:33.412684 21838 leader_election.cc:400] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17.
I20260709 13:08:33.413910 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.420938 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.363042 28197 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:33.428999 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 313673us
I20260709 13:08:33.433183 21867 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:33.434633 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:33.380816 28062 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:33.436343 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:33.436329 22015 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:08:33.393932 28267 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.436533 21949 raft_consensus.cc:1240] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:33.440932 21841 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.444172 21869 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:33.422508 28248 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:33.452466 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:33.493861 21941 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:33.435433 28105 raft_consensus.cc:2804] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:33.457927 21946 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:33.487133 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 206314us
I20260709 13:08:33.494359 21872 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 20: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:33.494279 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:33.455036 28280 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:33.487192 28062 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.525408 28062 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:33.537535 28322 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:08:33.524473 28105 raft_consensus.cc:697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:33.499159 28285 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 13:08:33.596777 28320 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:33.605602 21945 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:33.610541 28105 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.611814 28320 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:33.609429 28062 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:33.614725 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 100992us
W20260709 13:08:33.616573 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 103065us
I20260709 13:08:33.618835 28040 consensus_queue.cc:1059] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.619709 28040 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:33.608349 28267 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:33.609700 28280 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:33.622291 28319 raft_consensus.cc:3055] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:33.622736 28319 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:33.623481 28319 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.626372 28062 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 24 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:33.639709 28308 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.507s	user 0.003s	sys 0.002s
I20260709 13:08:33.643955 28319 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.644409 28246 raft_consensus.cc:3055] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:33.645051 28246 raft_consensus.cc:740] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:33.645963 28246 consensus_queue.cc:260] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.647497 28246 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:33.655879 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 235021us
I20260709 13:08:33.656821 21838 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.658213 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.659389 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.662091 28248 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.745270 28248 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:33.745750 28248 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.662595 28249 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.699373 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:33.749367 22016 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:33.699108 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:33.692516 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 184672us
I20260709 13:08:33.704962 21945 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 24 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 23. Current term is 24. Ops: [23.18-23.18]
W20260709 13:08:33.709692 28318 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.107s	user 0.007s	sys 0.000s
I20260709 13:08:33.705129 22021 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:33.705416 22015 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:33.706866 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.711679 28106 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.768020 28106 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:33.770533 28106 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:33.729598 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 65740us
I20260709 13:08:33.775719 28252 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:33.776773 27943 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:33.777196 27943 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 23 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:33.778134 27943 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:33.779613 28106 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:33.780666 28105 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:33.784291 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:33.784528 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:33.785818 27943 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:33.786365 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:33.787038 22606 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:33.789719 22016 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 24.
I20260709 13:08:33.790833 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:33.800923 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:33.801785 28105 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:33.802448 28105 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 24 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:33.802870 28249 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:33.803440 28105 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:33.809574 28248 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:33.813319 22601 raft_consensus.cc:2410] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
W20260709 13:08:33.864502 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 423625us
W20260709 13:08:33.803938 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 144608us
W20260709 13:08:33.866392 22573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.867177 21838 leader_election.cc:400] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:33.867547 21838 leader_election.cc:403] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:33.869113 22023 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:08:33.831779 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46432.7us
W20260709 13:08:33.874115 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 258054us
I20260709 13:08:33.875048 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.875396 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.876312 21874 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:33.857905 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 240619us
I20260709 13:08:33.878396 21838 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:33.882207 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:33.857250 28106 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.890493 21874 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:33.961643 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:33.873415 28249 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16.
I20260709 13:08:33.880672 28267 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.872578 28105 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:08:33.896009 28199 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:33.977576 28199 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:33.978664 28199 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.896147 28252 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.972877 28327 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.896643 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:33.973213 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 91055.5us
W20260709 13:08:33.973639 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76513us
I20260709 13:08:33.992213 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.994663 21941 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:33.999418 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
W20260709 13:08:34.003551 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 107003us
I20260709 13:08:34.007081 21945 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:08:33.983933 28326 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:33.972389 28247 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:34.012001 21867 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:33.983582 28000 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:34.017412 28000 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:34.022819 28330 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:34.023525 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:33.989746 28327 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:34.024312 28000 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:34.024973 28327 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:34.025950 28327 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:33.983510 28283 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.029206 28283 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:34.043551 21869 raft_consensus.cc:1275] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:34.047379 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:34.047420 22021 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:34.047377 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:33.974471 28106 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:34.054939 21869 raft_consensus.cc:1275] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:34.014195 28062 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:34.000638 28246 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.066313 28233 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:34.069275 21867 raft_consensus.cc:1275] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:08:34.071625 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 75372.8us
I20260709 13:08:34.069458 28062 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.088163 28062 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:34.098868 21987 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:34.099895 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:34.100540 21869 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:34.101914 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:34.107904 21943 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:08:34.114956 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 67674.7us
I20260709 13:08:34.125458 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:34.093952 28106 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:34.138492 21948 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:34.150400 21948 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:34.162057 28337 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:34.176841 28313 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:34.177524 28313 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:34.178947 21869 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:34.180629 28106 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.181744 28119 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:34.184463 28248 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:34.187505 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:34.136404 28246 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:34.094609 28280 consensus_queue.cc:1048] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:08:34.142699 28049 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:34.191372 21942 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:08:34.193609 21942 pending_rounds.cc:85] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 7
I20260709 13:08:34.193892 21942 pending_rounds.cc:107] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:34.194133 21942 raft_consensus.cc:2889] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.147217 28334 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.098595 28013 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:08:34.197445 28283 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:34.145780 28249 consensus_queue.cc:1059] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:08:34.194170 21839 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:34.179785 28313 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:34.153301 28260 consensus_queue.cc:1048] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 13:08:34.216840 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 95408.7us
I20260709 13:08:34.189922 28310 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:08:34.217433 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 71966.9us
I20260709 13:08:34.209049 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:34.225713 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:34.226451 21873 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:34.143728 28332 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:08:34.193548 28049 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:34.195663 28246 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.241940 22574 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:34.264075 22015 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:08:34.272368 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:34.273124 22603 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:34.273226 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:34.274057 21868 raft_consensus.cc:2393] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 20: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:34.261689 21867 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:34.278888 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:34.279673 22022 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:34.242581 22608 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:34.225708 28347 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:34.230161 28249 consensus_queue.cc:1243] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:34.264298 28049 raft_consensus.cc:3060] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:34.225044 28310 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:34.276518 28337 log.cc:927] Time spent T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:34.293196 22016 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:34.269922 28246 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.241170 28333 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:08:34.271093 28313 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:34.262301 28181 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:08:34.306725 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:34.291014 28307 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:34.273048 28256 consensus_queue.cc:1048] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:08:34.360458 28185 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:34.338201 28307 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.305431 27849 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:08:34.344507 28060 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:34.366740 28307 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:34.345535 28334 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
W20260709 13:08:34.391719 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 128816us
I20260709 13:08:34.358136 28320 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:08:34.380921 28347 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.381588 28060 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:34.396291 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:34.395596 27849 consensus_queue.cc:1243] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer 51e52b544fab4275aab4f7fbe81942d2 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:08:34.404862 28178 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.416250 21872 raft_consensus.cc:1240] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:34.358325 28310 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:34.416627 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 174737us
I20260709 13:08:34.399886 28347 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:34.422796 21869 raft_consensus.cc:1240] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:34.424971 28347 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:34.400103 28060 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:34.435827 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 161504us
I20260709 13:08:34.449945 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:34.450609 22601 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 20.
I20260709 13:08:34.454129 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:34.455116 28249 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:34.455523 28249 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.455855 28249 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:34.447795 28233 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.461189 28233 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:34.463351 28233 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:34.464128 28362 consensus_queue.cc:1059] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:34.447175 28310 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.466897 21874 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.501012 21874 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:34.490653 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 219656us
I20260709 13:08:34.449074 28234 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.504562 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 64843.9us
W20260709 13:08:34.498121 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 49887.9us
I20260709 13:08:34.464581 28049 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:34.510321 22019 raft_consensus.cc:3055] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:34.510802 22019 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:34.502105 21874 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:34.515522 21874 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.520172 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:34.520892 22601 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:34.511781 22019 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:34.524750 22019 raft_consensus.cc:3060] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.522439 21914 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:34.543519 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 184992us
I20260709 13:08:34.549588 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:34.552999 21874 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:08:34.553534 21874 pending_rounds.cc:85] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Aborting all ops after (but not including) 8
I20260709 13:08:34.553866 21874 pending_rounds.cc:107] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:08:34.554241 21874 raft_consensus.cc:2889] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.561942 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:34.562668 22016 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:34.573474 22019 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:08:34.581693 22019 pending_rounds.cc:85] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 11
I20260709 13:08:34.582442 22019 pending_rounds.cc:107] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:08:34.583081 22019 raft_consensus.cc:2889] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:34.591639 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51862.8us
W20260709 13:08:34.592939 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 49929.4us
I20260709 13:08:34.504051 28062 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:34.537026 28249 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:34.558370 28321 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.540823 28037 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:34.521095 28234 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:34.701534 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 107733us
W20260709 13:08:34.650954 28349 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:08:34.704672 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 146612us
I20260709 13:08:34.609308 28280 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:34.705945 21944 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:34.791461 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 117363us
W20260709 13:08:34.710911 28322 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:08:34.810453 28330 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:08:34.811025 28386 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.711642 28280 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.669509 28181 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
W20260709 13:08:34.866423 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 67419.1us
W20260709 13:08:34.851754 28351 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.414s	user 0.000s	sys 0.001s
I20260709 13:08:34.703480 28321 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:34.706976 28037 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:34.887791 28344 log.cc:927] Time spent T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:34.869421 28280 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:34.894711 28354 log.cc:927] Time spent T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.447s	user 0.000s	sys 0.001s
W20260709 13:08:34.932025 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 339207us
W20260709 13:08:34.912549 28360 log.cc:927] Time spent T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
W20260709 13:08:34.977098 28355 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:08:34.904467 28372 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:08:34.918757 28263 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:08:34.868986 28386 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:34.970378 28049 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:35.006083 28307 consensus_meta.cc:287] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.004s
I20260709 13:08:35.000020 28376 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.042344 28249 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.039827 28376 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:35.105856 28378 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:08:35.108439 28376 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.116668 28386 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:35.164048 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 310689us
I20260709 13:08:35.175688 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.177278 21866 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:35.182559 21942 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:35.187346 21990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.014s	sys 0.020s
W20260709 13:08:35.187999 21990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.015s	sys 0.020s
I20260709 13:08:35.032307 28062 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.201529 27943 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.202764 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:35.202905 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:35.204164 22601 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:35.209499 28105 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.210667 28105 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:35.201529 28106 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.007s	sys 0.011s
W20260709 13:08:35.213685 28106 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.008s	sys 0.011s
I20260709 13:08:35.215456 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.216524 21866 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:35.219174 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.203015 27943 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:35.229802 22574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.006s	sys 0.006s
W20260709 13:08:35.230409 22574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.006s	sys 0.006s
I20260709 13:08:35.071724 28234 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.236289 28386 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.237283 28386 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:35.261498 21987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.269840 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.272707 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 70267.1us
I20260709 13:08:35.286286 28395 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:35.287500 28395 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:35.289058 21913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.007s	sys 0.012s
W20260709 13:08:35.289731 21913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.007s	sys 0.012s
I20260709 13:08:35.292546 22601 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 21.
W20260709 13:08:35.275949 21988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.009s	sys 0.009s
I20260709 13:08:35.299674 28398 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.257761 28390 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:08:35.300393 28398 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.300902 28398 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.304764 28037 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.309324 28105 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.033756 28307 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.310556 28321 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:35.312789 21839 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:35.314857 28386 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:35.315541 21915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.006s	sys 0.009s
I20260709 13:08:35.319157 21944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54900 (request call id 3033) took 1189 ms. Trace:
W20260709 13:08:35.321046 21988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.010s	sys 0.009s
I20260709 13:08:35.298125 27943 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.328678 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:08:35.334223 21915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.006s	sys 0.009s
I20260709 13:08:35.341140 28390 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:35.341846 28390 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 21 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:35.348827 28390 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.355837 28372 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:35.357051 28372 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.358525 28305 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.359318 28305 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.367796 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.359747 28372 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.369426 28398 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:35.372465 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 44073.3us
I20260709 13:08:35.374239 28356 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:35.374899 28062 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.375577 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:35.375756 28105 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.396452 28356 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.401947 28356 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.375619 28106 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.405009 28106 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.376984 28387 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:35.377746 28359 log.cc:927] Time spent T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.572s	user 0.003s	sys 0.002s
I20260709 13:08:35.379594 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:35.381556 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:35.381950 28358 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.383690 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:35.385813 28263 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.417227 28263 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.385700 28329 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.418646 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.419201 28329 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.387048 28328 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.423820 28328 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.425092 28327 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.426105 28327 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.426883 28328 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.428072 21867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 3097) took 1141 ms. Trace:
I20260709 13:08:35.428614 21867 rpcz_store.cc:276] 0709 13:08:34.286583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.287438 (+   855us) service_pool.cc:224] Handling call
0709 13:08:34.287725 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:34.288057 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.288084 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:34.288525 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:08:34.505176 (+216651us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:34.559651 (+ 54475us) log.cc:844] Serialized 14 byte log entry
0709 13:08:34.589175 (+ 29524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.589296 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:34.978730 (+389434us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b18004092a0. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f532a6 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db
0709 13:08:35.376753 (+398023us) spinlock_profiling.cc:243] Waited 9.45 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:35.427539 (+ 50786us) raft_consensus.cc:1685] finished
0709 13:08:35.427571 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:35.427829 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6459,"prepare.queue_time_us":14672,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":298864,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":16390,"spinlock_wait_cycles":83000960,"thread_start_us":299558,"threads_started":3,"wal-append.queue_time_us":376530}
I20260709 13:08:35.387645 28285 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.431551 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:35.432436 28285 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.397814 28062 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.401024 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:35.332556 28307 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:35.393440 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 832333us
I20260709 13:08:35.407606 28106 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.411038 28387 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.411305 28358 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.409828 22019 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:35.401850 28105 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.448437 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:35.327004 21944 rpcz_store.cc:276] 0709 13:08:34.129438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.129970 (+   532us) service_pool.cc:224] Handling call
0709 13:08:34.130330 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.711748 (+581418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.318375 (+606627us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400247554. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:35.318872 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323367808}
I20260709 13:08:35.420639 28263 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.440745 28329 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.459456 28062 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.460041 28398 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.460283 21943 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:35.479725 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.460985 28285 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.490622 28247 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.491879 28364 raft_consensus.cc:3055] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:35.491568 28247 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.492376 28364 raft_consensus.cc:740] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:35.493837 28364 consensus_queue.cc:260] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.494730 28247 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.495879 28364 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.462733 28395 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:35.499109 28060 consensus_meta.cc:287] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 1.024s	user 0.007s	sys 0.018s
I20260709 13:08:35.499740 28060 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.465972 28305 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:35.467424 28310 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.961s	user 0.010s	sys 0.010s
I20260709 13:08:35.451378 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:35.495621 28396 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:35.502912 28105 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.503506 28383 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:35.464488 28246 consensus_meta.cc:287] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 1.135s	user 0.005s	sys 0.016s
I20260709 13:08:35.461931 28387 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.508015 28358 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.531689 21944 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:35.540112 28328 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.565399 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.533255 21947 raft_consensus.cc:2468] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
W20260709 13:08:35.537379 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 61531.5us
I20260709 13:08:35.545253 21916 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:35.545789 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.548358 28383 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.551687 28327 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.550851 28246 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.565917 22018 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:35.664880 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.629494 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.751453 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.752117 21866 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
I20260709 13:08:35.674649 28060 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.735932 28247 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:35.756186 28247 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.758941 28247 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.672264 28197 raft_consensus.cc:493] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:35.772614 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:35.773176 28197 raft_consensus.cc:515] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.774123 28320 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:35.774773 28320 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.775391 28197 leader_election.cc:290] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:35.668884 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 59970.5us
I20260709 13:08:35.761778 21946 raft_consensus.cc:1240] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:08:35.763406 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.765645 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.767225 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:35.777674 21866 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.777697 21869 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:35.783289 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:35.786135 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:35.787091 21873 raft_consensus.cc:2393] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 20: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:35.567588 28305 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.788555 28305 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.790824 28334 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:35.791026 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:35.791742 28305 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.770733 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:35.734814 28280 consensus_meta.cc:287] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.799s	user 0.016s	sys 0.005s
I20260709 13:08:35.719754 28393 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:08:35.773608 28386 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:35.733392 27849 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.661057 28356 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.784042 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.777385 28320 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.791492 28334 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.612176 22015 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 20.
W20260709 13:08:35.653506 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 56076.7us
I20260709 13:08:35.769315 28383 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.609805 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.641059 28312 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:35.570555 28379 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:35.689201 28259 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.673108 28199 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.630316 28049 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:35.689451 28396 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.797700 28386 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.827505 21950 raft_consensus.cc:2368] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17.
I20260709 13:08:35.630115 28363 consensus_queue.cc:1059] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.192s
I20260709 13:08:35.831290 28363 consensus_queue.cc:1243] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 17.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:08:35.831588 28247 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.833521 28247 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.834071 22606 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 24 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:08:35.834508 22606 pending_rounds.cc:85] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Aborting all ops after (but not including) 17
I20260709 13:08:35.834761 22606 pending_rounds.cc:107] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 13:08:35.835043 22606 raft_consensus.cc:2889] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:35.827751 28320 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.835968 28247 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.832376 28347 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.829262 28386 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:35.832695 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:35.835732 28320 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.832276 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:35.613982 28328 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.843881 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:35.844172 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:35.857637 28334 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.858369 28347 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.859936 28106 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:35.848151 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:35.848376 22015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43292 (request call id 2111) took 1299 ms. Trace:
I20260709 13:08:35.628223 28196 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.202s
I20260709 13:08:35.862586 22015 rpcz_store.cc:276] 0709 13:08:34.549220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.549343 (+   123us) service_pool.cc:224] Handling call
0709 13:08:35.848154 (+1298811us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001f09d4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:35.848304 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307494144}
I20260709 13:08:35.861311 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.850514 22608 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:35.851568 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:35.853310 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.855799 28256 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:35.841250 22603 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:35.849767 28248 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.866901 28356 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.829273 27849 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.867204 28256 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.868762 28320 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.869378 21868 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:35.804921 28280 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.879832 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:35.885437 28393 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.897670 21866 raft_consensus.cc:2468] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:35.899044 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.900533 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:35.901449 21949 raft_consensus.cc:2410] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:08:35.902382 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:35.904376 28376 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:35.878511 28347 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.842690 28049 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:35.918174 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:35.919734 21872 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.846235 28396 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.873621 28379 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.923038 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:35.876358 28387 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.039s
I20260709 13:08:35.910722 28376 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:35.958220 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:35.912386 28062 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:35.953122 21914 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:35.979346 22608 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:35.890053 28259 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.895511 28199 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.987082 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:35.995754 22607 raft_consensus.cc:2368] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 20. Current term is 21.
I20260709 13:08:35.987183 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.997306 28199 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:35.997534 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:35.918381 28248 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.999838 21875 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:36.001935 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:35.988008 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.008836 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:36.009979 22574 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.991230 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.014606 28196 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.015864 28196 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.911917 28312 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.019743 28334 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:36.020444 28334 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.977481 28376 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.010182 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:36.022902 28334 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:36.028193 28334 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:36.028805 28334 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.030887 28049 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.957988 28398 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.031960 28334 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:36.026467 28196 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:36.033396 28049 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:36.033989 28049 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:35.981443 28062 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.035135 28062 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:36.007182 28423 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:35.954344 28393 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.005839 28182 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.020282 28312 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:35.982414 28246 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.062520 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.065631 21866 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 11.
I20260709 13:08:36.063122 21839 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:35.986402 28106 raft_consensus.cc:2804] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:36.036535 28049 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:36.068068 27849 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.068779 28347 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.070672 28267 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.071244 28363 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:36.071830 28395 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:36.072583 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:36.072867 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.033396 28396 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.073001 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.073809 28199 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.074617 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.075214 28312 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:36.075364 28060 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:36.077720 22015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:36.106662 22015 raft_consensus.cc:606] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.079811 28327 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.080873 28320 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.060175 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.118525 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:36.066692 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 527214us
I20260709 13:08:36.052773 28310 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.111150 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.091367 22607 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:36.089751 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.114645 21868 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 20.
I20260709 13:08:36.093042 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.082059 21987 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:36.108711 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.111955 22021 raft_consensus.cc:3060] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:08:36.112668 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.110757 22024 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 24.
I20260709 13:08:36.131328 28327 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.127599 28310 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.133378 28377 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:36.134161 28310 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.121452 28060 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:36.136051 28415 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:08:36.136533 28060 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:36.137228 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.137319 28395 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.139897 28395 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:36.095309 28106 raft_consensus.cc:697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:36.133662 28259 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.131142 28320 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.145753 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.142354 22019 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:36.096797 28256 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:36.147189 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 81488.3us
I20260709 13:08:36.153215 28106 consensus_queue.cc:237] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.153918 28380 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.154724 28380 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.128189 28312 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.156713 28395 raft_consensus.cc:2804] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:36.153916 22603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23093b4e74d34b3d87ab577135fa1517" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.115449 28347 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.165237 21916 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.098099 28182 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.144901 28383 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.173719 21916 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.140908 28267 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.163064 28395 raft_consensus.cc:697] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:36.176775 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:36.177423 22017 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:36.177493 28395 consensus_queue.cc:237] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.183509 21987 leader_election.cc:400] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17.
I20260709 13:08:36.184005 21987 leader_election.cc:403] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.188627 28383 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.189900 22016 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:08:36.190328 22016 pending_rounds.cc:85] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 10
I20260709 13:08:36.190531 22016 pending_rounds.cc:107] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:08:36.190752 22016 raft_consensus.cc:2889] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.148919 28363 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.190888 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.191862 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.192173 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.192780 28363 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.193017 22024 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 15.
I20260709 13:08:36.193804 22015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:36.194406 22015 raft_consensus.cc:606] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.194792 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.195621 28049 raft_consensus.cc:3060] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.193050 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.193470 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.200927 28253 consensus_queue.cc:1059] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:36.203248 28253 raft_consensus.cc:3055] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:36.203670 28253 raft_consensus.cc:740] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:36.204759 28420 log.cc:927] Time spent T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:08:36.173599 28259 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.221974 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.223559 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.226464 22017 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 21.
I20260709 13:08:36.251185 28347 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.256450 28267 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.257263 22015 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:36.185567 28280 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.281874 22023 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:36.297963 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.299548 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.302045 21872 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:36.306707 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.190919 28383 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.309415 22021 raft_consensus.cc:2468] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 20.
I20260709 13:08:36.310981 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.320896 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.328454 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.328986 28182 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:36.329741 22017 raft_consensus.cc:2410] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:08:36.333482 28320 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.334438 28327 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.335673 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.336582 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.337226 21950 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:36.340457 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.340641 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.352381 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.346936 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.364013 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.366379 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:36.394721 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 266695us
I20260709 13:08:36.397455 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.404554 22608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.410111 21941 raft_consensus.cc:1240] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:08:36.413003 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.414004 22601 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 15.
I20260709 13:08:36.413029 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.420975 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.426029 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.429636 28389 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.430244 28389 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.433185 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.395402 28253 consensus_queue.cc:260] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.439519 28248 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.439761 28253 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.368350 28062 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.428194 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:36.413633 27849 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:36.444684 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 49286.6us
I20260709 13:08:36.450882 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.451551 22604 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:36.415402 28280 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
W20260709 13:08:36.453307 28386 consensus_meta.cc:287] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.005s
I20260709 13:08:36.448735 22023 pending_rounds.cc:85] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 14
I20260709 13:08:36.457358 22023 pending_rounds.cc:107] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:08:36.456197 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.458971 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.449710 22576 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.457676 22023 raft_consensus.cc:2889] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.440809 28259 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:36.457978 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.462330 21945 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:36.463578 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 51052.2us
I20260709 13:08:36.461148 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.467770 28307 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.469740 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.449311 28389 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.472330 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.481572 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.476329 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.493574 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.497769 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.503252 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.483946 28256 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:36.484159 28307 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.471150 28280 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.514040 28062 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.514479 28320 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:36.515599 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.463311 28386 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.488530 28248 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.506405 21948 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:36.480252 28259 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.498694 22574 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:36.543606 21841 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.553108 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:36.554802 21841 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.557077 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.527364 28182 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:36.563714 21943 raft_consensus.cc:1240] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:36.567780 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.569851 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:36.549618 28327 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:36.565977 28376 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 13:08:36.559512 28383 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:36.580037 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.567107 28248 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.580058 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.589767 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.590395 28332 consensus_queue.cc:1059] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:36.593935 28049 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17.
I20260709 13:08:36.562876 28267 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.596721 21987 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:36.612949 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 58268.8us
I20260709 13:08:36.614044 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.620502 28247 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.620913 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:36.648284 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:36.646129 21914 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:36.649085 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.620215 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:36.616533 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 121623us
I20260709 13:08:36.651293 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.652745 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.653208 21946 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:36.653875 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.656589 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.657760 21988 leader_election.cc:400] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 20. Current term is 21.
I20260709 13:08:36.658082 21988 leader_election.cc:403] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.659974 21914 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:36.659583 28062 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:36.660888 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 64273.3us
I20260709 13:08:36.666060 21988 leader_election.cc:304] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:36.676427 21946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:36.610531 28376 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.656173 28377 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.660534 28247 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:36.660444 28307 raft_consensus.cc:2804] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:36.678108 21946 raft_consensus.cc:606] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.682514 22609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:36.679661 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:36.691991 22604 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.651402 28267 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:36.666620 28332 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:36.668668 28363 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.668372 28310 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.675312 28049 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 20. Current term is 21.
I20260709 13:08:36.669376 28062 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:36.674315 28327 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:36.699100 21949 raft_consensus.cc:1240] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:36.677421 28196 raft_consensus.cc:2749] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.673795 28396 raft_consensus.cc:2804] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:36.707252 28426 log.cc:927] Time spent T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:36.687237 28305 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:36.709465 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:36.719393 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51250.6us
I20260709 13:08:36.722561 22015 raft_consensus.cc:2468] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 17.
I20260709 13:08:36.721762 28310 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.699815 28428 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:36.725489 28376 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.729624 28386 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.718981 28267 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.733268 22604 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:36.722892 28062 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:36.755442 28428 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.756845 28280 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.751677 28310 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.756909 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.757947 28428 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.759191 21870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50242 (request call id 3109) took 1105 ms. Trace:
I20260709 13:08:36.759968 28259 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.700057 28332 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:36.750453 28396 raft_consensus.cc:697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:36.761170 28435 log.cc:927] Time spent T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.003s
I20260709 13:08:36.761831 28396 consensus_queue.cc:237] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.762897 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.763255 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:36.763891 22024 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:36.761077 28332 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:36.759573 21870 rpcz_store.cc:276] 0709 13:08:35.657405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.662240 (+  4835us) service_pool.cc:224] Handling call
0709 13:08:35.669428 (+  7188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.998303 (+328875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.998333 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.998856 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.208279 (+209423us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:36.222203 (+ 13924us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.222411 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.758721 (+536310us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54001b8854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f6356072e01 00007f635607183e 00007f635b036419 00007f63545adbd4 00007f63545adb62 00007f63545ada91 00007f63545ada0c 00007f63545accc2 00007f63543ad48c 00007f63543ac8c6
0709 13:08:36.758769 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.758811 (+    42us) raft_consensus.cc:1685] finished
0709 13:08:36.758892 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.759030 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7044,"prepare.queue_time_us":13395,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":43636,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":14750,"spinlock_wait_cycles":755302144,"thread_start_us":208911,"threads_started":1,"wal-append.queue_time_us":405711}
I20260709 13:08:36.772260 21916 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:36.772814 28379 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.773185 28248 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.774116 27899 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:36.774837 21916 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.774996 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:36.775969 27899 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.777966 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.779196 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:36.780205 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:36.752182 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 75875.2us
I20260709 13:08:36.764039 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.791067 28312 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.791880 28197 raft_consensus.cc:3055] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:36.792309 28197 raft_consensus.cc:740] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:36.793231 28197 consensus_queue.cc:260] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.794492 28197 raft_consensus.cc:3060] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.794544 21916 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:36.797394 27849 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:36.798066 27849 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.799916 28393 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.802628 28380 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.817022 28404 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:36.818638 28432 log.cc:927] Time spent T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:08:36.817118 22020 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:36.827612 28372 raft_consensus.cc:3055] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:36.776244 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:36.828022 28372 raft_consensus.cc:740] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:36.828997 28372 consensus_queue.cc:260] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.830040 28372 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:36.831573 28305 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 24 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:36.832087 28305 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:36.844645 28328 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:36.849676 22576 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.69.3:35687 timed out after 1.515s (SENT) [suppressed 9 similar messages]
W20260709 13:08:36.851866 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57381.8us
W20260709 13:08:36.852932 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 70838.9us
I20260709 13:08:36.854005 21988 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:36.855353 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 178671us
I20260709 13:08:36.862411 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.862406 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.864892 21841 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.866255 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:36.867625 28182 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.856707 28332 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.847656 28062 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:36.849532 28310 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:36.871275 21872 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:36.872483 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.873067 22605 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:36.874004 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.874917 28062 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:36.872231 28332 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:36.875777 28310 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:36.850535 28438 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.177s	user 0.003s	sys 0.001s
I20260709 13:08:36.883674 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.890818 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.892243 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.887283 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.898662 22024 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:36.903373 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.905984 21916 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.907936 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.911885 21916 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:36.913878 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.914333 21839 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:36.916818 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:36.899581 28380 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.935815 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.899763 28429 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.918614 21988 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:36.933557 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.935708 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.937924 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.938788 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.943588 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.939558 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:36.939359 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.946759 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:36.947996 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:36.953261 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.962103 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:36.917984 28386 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.963917 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:36.965149 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:36.964372 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 294607us
I20260709 13:08:36.959899 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:36.935508 28347 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:36.997156 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:37.000088 21914 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:36.910722 28305 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:37.007148 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 157488us
I20260709 13:08:37.007805 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.960238 28253 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.938020 27899 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:36.923918 28327 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:08:36.936298 28404 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:36.940202 28307 raft_consensus.cc:697] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:37.010375 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:36.953148 28377 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
W20260709 13:08:37.006455 28439 log.cc:927] Time spent T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:08:37.027176 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 94941.3us
I20260709 13:08:37.003106 28106 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.030047 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.007263 28347 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.011911 28386 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.064841 22576 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.026153 28196 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:37.080273 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 69953.7us
I20260709 13:08:37.046589 28372 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.039670 28106 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.046677 28347 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:37.095184 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45778.6us
I20260709 13:08:37.047885 28376 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.110368 21947 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:37.040014 28404 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.119657 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.091804 28106 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:37.115880 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51180.8us
I20260709 13:08:37.092270 27899 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:37.119654 21943 raft_consensus.cc:1240] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:08:37.121779 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:37.123229 28196 consensus_queue.cc:1059] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:08:37.126173 28436 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:37.118937 28395 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:08:37.127403 28395 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:37.127784 28395 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:37.128224 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:37.129504 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 69530.8us
I20260709 13:08:37.130908 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:37.132103 21988 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.133278 28395 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:37.133857 27899 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:37.134720 28424 log.cc:927] Time spent T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.837s	user 0.004s	sys 0.000s
I20260709 13:08:37.134690 28395 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.137725 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.139092 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.139324 28182 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.140818 28445 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.141599 28445 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.142795 28445 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.143481 28445 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.145604 28372 raft_consensus.cc:3055] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:37.146027 28372 raft_consensus.cc:740] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:37.114797 28307 consensus_queue.cc:237] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:37.146878 28372 consensus_queue.cc:260] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.152515 22576 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.090852 28060 consensus_queue.cc:1059] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:37.157564 28334 raft_consensus.cc:993] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:37.162075 28305 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 25 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:37.163242 28442 log.cc:927] Time spent T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.410s	user 0.000s	sys 0.003s
I20260709 13:08:37.115274 28447 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:37.172696 21988 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.178815 28376 raft_consensus.cc:993] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:37.179390 28376 raft_consensus.cc:1081] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:37.181245 28060 raft_consensus.cc:3055] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:37.181732 28060 raft_consensus.cc:740] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:37.182627 28060 consensus_queue.cc:260] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.183974 28060 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.184820 28452 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.185453 28452 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:37.185593 28334 raft_consensus.cc:1081] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:37.185940 28452 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:37.184713 28312 consensus_queue.cc:1175] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95296a4420ed41b69191d3d4353cf2b0" responder_term: 17 status { last_received { term: 17 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 17 index: 10 } }
I20260709 13:08:37.190969 28312 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:37.198840 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 46802.1us
I20260709 13:08:37.199054 21914 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.205431 21914 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:37.230042 21990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.237473 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:37.120196 28267 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:37.241274 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:37.240319 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 201890us
I20260709 13:08:37.244093 21944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:37.244756 21944 raft_consensus.cc:606] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:37.245443 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 105229us
I20260709 13:08:37.245350 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:37.291455 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 46180.6us
I20260709 13:08:37.288851 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.233659 28280 raft_consensus.cc:2749] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.318789 21872 raft_consensus.cc:1275] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:37.326956 21870 raft_consensus.cc:1240] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:37.306874 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:37.308146 21841 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.339198 22024 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:37.341466 21841 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.289664 28386 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.344830 21841 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:37.296262 21875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:08:37.352316 21875 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.351066 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:37.352914 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:37.352305 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:37.352934 21875 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.318614 21873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:08:37.357997 21873 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.358482 21873 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.298002 28363 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.361162 21841 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.355934 22016 raft_consensus.cc:2376] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 20. Re-sending same reply.
I20260709 13:08:37.373775 28454 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.375550 28453 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.376649 28444 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.202s
W20260709 13:08:37.380792 28449 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
W20260709 13:08:37.383173 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 43797.7us
I20260709 13:08:37.383975 21838 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.385330 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.387624 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.351528 28199 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.351729 28383 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.394026 21841 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.362447 28280 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:37.367256 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 74819.5us
W20260709 13:08:37.388521 28197 consensus_meta.cc:287] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.593s	user 0.012s	sys 0.000s
I20260709 13:08:37.394757 21875 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.368158 28327 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.418972 21914 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.392014 28248 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:37.396369 27849 consensus_meta.cc:287] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.598s	user 0.013s	sys 0.003s
I20260709 13:08:37.394232 28380 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.393699 28379 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.443732 22018 raft_consensus.cc:1275] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:08:37.444239 22018 pending_rounds.cc:85] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Aborting all ops after (but not including) 7
I20260709 13:08:37.446578 22018 pending_rounds.cc:107] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:08:37.446892 22018 raft_consensus.cc:2889] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:37.434969 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 92446.5us
I20260709 13:08:37.441807 21875 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:37.433045 28377 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:37.452253 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:37.440433 28062 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.432415 28393 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:37.468871 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:37.470197 28372 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:37.491411 21944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:37.492144 21944 raft_consensus.cc:606] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.492515 21944 raft_consensus.cc:614] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:37.437877 28347 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:37.518532 21873 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.442682 27849 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:37.526115 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 67645.6us
I20260709 13:08:37.528753 21873 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:37.531342 28463 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:37.533315 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:37.539119 21950 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:37.540439 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 217380us
W20260709 13:08:37.546938 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 153015us
I20260709 13:08:37.547871 21841 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.550570 28379 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:37.553045 28280 raft_consensus.cc:993] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:37.554497 21873 raft_consensus.cc:1275] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:37.554353 21988 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:37.544317 28267 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:37.541400 28404 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:37.560725 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:37.578542 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:37.579815 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:37.580576 22022 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:37.624642 22017 raft_consensus.cc:1240] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:37.625734 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:37.568806 28454 raft_consensus.cc:1081] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:37.558881 28466 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:37.637465 28465 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:08:37.648339 22023 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:37.678761 28452 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:37.681033 22605 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.685405 27849 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:37.687467 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
W20260709 13:08:37.689970 28106 consensus_meta.cc:287] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.002s
I20260709 13:08:37.690196 28384 consensus_queue.cc:1059] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:37.690493 28106 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:37.691251 28384 raft_consensus.cc:3055] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:37.691617 28384 raft_consensus.cc:740] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:37.691736 21949 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 17: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:37.694556 28384 consensus_queue.cc:260] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:37.698968 28478 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:37.699854 28395 consensus_meta.cc:287] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.000s
I20260709 13:08:37.702188 28452 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:37.727140 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:37.727856 22018 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.713646 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:37.739053 21950 raft_consensus.cc:2368] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 16. Current term is 17.
I20260709 13:08:37.728338 22605 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:37.744731 22573 leader_election.cc:400] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 16. Current term is 17.
I20260709 13:08:37.734001 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:37.745374 22573 leader_election.cc:403] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.696413 28384 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:37.749583 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 362012us
I20260709 13:08:37.756664 21867 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:37.738456 28246 consensus_queue.cc:1048] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:08:37.753310 28431 log.cc:927] Time spent T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.107s	user 0.001s	sys 0.004s
I20260709 13:08:37.764699 28452 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 16. Current term is 17.
I20260709 13:08:37.799577 28106 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:37.821759 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:37.824900 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:37.825577 22016 raft_consensus.cc:3055] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:37.825901 22016 raft_consensus.cc:740] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:37.826740 22016 consensus_queue.cc:260] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.827864 22016 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.834306 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:37.834933 22024 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.875906 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.883819 27943 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:08:37.889053 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 337830us
I20260709 13:08:37.895920 21866 raft_consensus.cc:1240] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:37.896729 21869 raft_consensus.cc:1240] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:37.901610 21867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:08:37.902209 28247 consensus_queue.cc:1059] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:37.902762 21867 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.901577 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:37.903149 28482 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:37.903555 28482 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:37.903146 21867 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:37.906047 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:37.906659 22605 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.910135 28458 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:37.910836 28482 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:37.918640 21771 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 278) took 23811 ms (client timeout 15000 ms). Trace:
I20260709 13:08:37.920531 28347 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:37.924914 22605 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
I20260709 13:08:37.926335 21839 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:37.928292 22016 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:37.935797 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:37.936635 21950 raft_consensus.cc:3055] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:37.937052 21950 raft_consensus.cc:740] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:37.939781 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:37.940485 22016 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:37.941977 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.949931 21841 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:37.928892 21867 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.962657 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:37.963299 21949 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:37.961957 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:37.964164 21945 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.973481 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:37.975201 22024 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:37.930179 28347 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:37.982599 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:37.968000 21950 consensus_queue.cc:260] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.962527 28473 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.972240 27899 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.994655 21950 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.000402 21867 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:37.982851 28429 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.988272 28267 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.988440 28396 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.017776 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:38.018424 21946 raft_consensus.cc:3055] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:38.018726 21946 raft_consensus.cc:740] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:38.007478 27899 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.019542 21946 consensus_queue.cc:260] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:37.993853 28473 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:38.008466 22605 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:38.022323 28473 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.013505 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:38.023325 22601 raft_consensus.cc:2393] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 17: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:38.021481 27899 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:37.984966 28280 consensus_queue.cc:1048] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:08:38.024420 21946 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:37.919169 21771 rpcz_store.cc:269] 0709 13:08:14.107409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.108209 (+   800us) service_pool.cc:224] Handling call
0709 13:08:14.407183 (+298974us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdc090 00007f635607af3a 00007f635be311cc 00007f635bf2f37e 00007f635a3f02a4 00007f635a3f0232 00007f635a3f0161 00007f635a3f00dc 00007f635a3ef392 00007f63543ad48c 00007f63543ac8c6
0709 13:08:37.918369 (+23511186us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:32.799590 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:32.800247 (+   657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:32.800299 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:08:32.800316 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:32.802136 (+  1820us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:32.802251 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:32.802276 (+    25us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:08:32.804350 (+  2074us) tablet.cc:701] Row locks acquired
0709 13:08:32.804401 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:08:32.804576 (+   175us) write_op.cc:270] Start()
0709 13:08:32.950883 (+146307us) write_op.cc:276] Timestamp: P: 1783602512804499 usec, L: 0
0709 13:08:32.957663 (+  6780us) op_driver.cc:348] REPLICATION: starting
0709 13:08:32.992110 (+ 34447us) log.cc:844] Serialized 9690 byte log entry
0709 13:08:33.637885 (+645775us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:33.858473 (+220588us) op_driver.cc:464] REPLICATION: finished
0709 13:08:33.861191 (+  2718us) write_op.cc:301] APPLY: starting
0709 13:08:33.861281 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:34.417192 (+555911us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:34.421427 (+  4235us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:35.672428 (+1251001us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:35.711194 (+ 38766us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:08:35.711263 (+    69us) write_op.cc:312] APPLY: finished
0709 13:08:35.712043 (+   780us) log.cc:844] Serialized 220 byte log entry
0709 13:08:35.975249 (+263206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.161551 (+186302us) write_op.cc:454] Released schema lock
0709 13:08:36.183555 (+ 22004us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.252866 (+ 69311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.252911 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3306529,"reported_tablets":50,"spinlock_wait_cycles":398549888,"child_traces":[["op",{"apply.queue_time_us":2435,"apply.run_cpu_time_us":112470,"apply.run_wall_time_us":2391546,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108777,"num_ops":25,"prepare.queue_time_us":249171,"prepare.run_cpu_time_us":26623,"prepare.run_wall_time_us":336908,"raft.queue_time_us":216195,"raft.run_cpu_time_us":1154,"raft.run_wall_time_us":18583,"replication_time_us":900612,"spinlock_wait_cycles":3843328,"thread_start_us":817055,"threads_started":5,"wal-append.queue_time_us":525943,"wal-append.run_cpu_time_us":17257,"wal-append.run_wall_time_us":2760259}]]}
I20260709 13:08:37.991128 28347 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 19 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:38.034035 28347 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:37.987455 28328 consensus_queue.cc:1059] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:08:38.036516 21945 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
I20260709 13:08:38.037289 28429 raft_consensus.cc:3055] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:38.039601 21946 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 20.
I20260709 13:08:38.043068 21949 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:38.047446 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:38.058415 22024 raft_consensus.cc:1275] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:38.050700 21941 raft_consensus.cc:1240] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:38.049847 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:38.056128 22601 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:38.056469 22018 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:38.065989 22022 raft_consensus.cc:1240] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:08:38.108223 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:38.114467 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 52055.6us
I20260709 13:08:38.046656 27943 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:38.057484 28429 raft_consensus.cc:740] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
W20260709 13:08:38.129237 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 79470.4us
I20260709 13:08:38.133795 21838 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:38.138154 21838 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:38.139178 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:38.143682 21989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.056910 28386 consensus_queue.cc:1059] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.069s
I20260709 13:08:38.119704 28466 consensus_queue.cc:1048] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:08:38.170189 22020 raft_consensus.cc:2368] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 16. Current term is 17.
I20260709 13:08:38.136771 28476 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:38.136462 28376 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.145018 28328 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:38.144745 28267 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:38.181253 21916 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:38.124727 27943 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.204154 22605 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 16.
I20260709 13:08:38.153136 28473 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.181617 28482 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:38.206746 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 79606.2us
I20260709 13:08:38.170982 28457 consensus_queue.cc:1059] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:38.195796 28328 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 20 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:38.201814 28062 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:38.232945 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 105480us
I20260709 13:08:38.216019 28347 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:38.233834 28062 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:38.183115 28429 consensus_queue.cc:260] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.266050 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:38.267482 22021 raft_consensus.cc:2410] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 16.
W20260709 13:08:38.272302 28489 log.cc:927] Time spent T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:08:38.274164 28473 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:38.276782 28328 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.241449 28347 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.288858 28062 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.259109 28267 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:38.304322 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:38.312942 21944 raft_consensus.cc:2393] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 16: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:38.313540 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 49909.8us
W20260709 13:08:38.323107 21840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.299743 27943 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:38.314291 21988 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:38.347052 28347 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:38.361033 21950 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 18.
I20260709 13:08:38.362567 21838 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:38.367700 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:38.369411 21942 raft_consensus.cc:2393] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 12: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
W20260709 13:08:38.373754 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 59546.7us
I20260709 13:08:38.376089 27943 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:38.389882 27943 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.376467 28182 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:38.392771 28182 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.394311 27943 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:38.394701 28459 consensus_queue.cc:1048] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:38.369455 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 60075.3us
I20260709 13:08:38.365900 28347 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:38.395324 22576 leader_election.cc:400] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda for earlier term 16. Current term is 17.
I20260709 13:08:38.404939 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:38.413045 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:38.415756 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:38.415866 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:38.416174 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:38.416357 21841 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:38.416657 22024 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:38.416759 21950 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 19: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:38.417227 28379 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.409370 28372 raft_consensus.cc:3055] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:38.421627 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:38.430470 22023 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 16.
I20260709 13:08:38.430824 22022 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:38.429738 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:38.376685 28395 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:38.430382 28498 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.437098 28498 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.443163 28498 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:38.447041 21841 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:38.448958 22576 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:38.449357 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:38.449534 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:38.450049 21950 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:38.450145 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:38.453336 28473 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:38.453920 28473 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:38.455350 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:38.430313 28372 raft_consensus.cc:740] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:38.439396 28347 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:38.452419 28458 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:38.455277 28256 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:38.421062 28267 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.484539 28466 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:38.495070 22601 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:38.480054 28395 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:38.502648 28395 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.487926 28310 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.504980 28310 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.507723 28310 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:38.508211 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:38.508951 21870 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:38.509548 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:38.510339 21942 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:38.481191 28256 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:38.512214 28256 raft_consensus.cc:3060] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:38.511636 21988 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:38.516710 28372 consensus_queue.cc:260] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.517817 28457 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:38.518249 28372 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:38.493340 28473 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.491654 28466 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.519107 28466 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.518298 28457 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.525301 28457 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:38.534706 22022 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 20.
W20260709 13:08:38.577008 28502 log.cc:927] Time spent T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:08:38.582700 28379 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:38.586526 28457 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.587566 28347 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.595767 28457 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:38.595533 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:38.596511 21870 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:08:38.596915 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:38.601749 21950 raft_consensus.cc:3060] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:38.605423 21942 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:38.607810 28379 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:38.608496 28466 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.611778 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:38.612376 21941 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.620674 21941 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:38.633807 21950 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
I20260709 13:08:38.632846 21987 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:38.638505 21870 raft_consensus.cc:2468] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
I20260709 13:08:38.638451 21987 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:38.657394 28457 raft_consensus.cc:2804] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:38.658011 28457 raft_consensus.cc:697] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:38.677495 28429 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:38.694116 28376 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:38.695554 28457 consensus_queue.cc:237] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.681469 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:38.713186 22605 raft_consensus.cc:1240] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Rejecting Update request from peer 61893f17f34b4cc9b898114d3c0a7023 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:38.659421 28480 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:38.660408 28247 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:38.645377 28372 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:38.714600 28379 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:08:38.661171 28466 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:38.661466 28256 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.727337 28454 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:38.725261 28480 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:38.735724 28497 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:38.744735 28496 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.777424 28496 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.783601 28256 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:38.794350 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 146872us
I20260709 13:08:38.804230 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:38.805027 21941 raft_consensus.cc:2393] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 19: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:38.750629 28372 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:38.809811 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:38.840459 22605 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:38.812203 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:38.741556 28247 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:38.848516 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 127158us
I20260709 13:08:38.865788 22605 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:38.818136 28503 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:38.808524 28182 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:38.873097 21941 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:38.880164 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:38.781397 28497 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:38.912557 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 57069.6us
I20260709 13:08:38.880301 28503 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.921541 22016 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:38.917232 28106 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.926040 28106 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:38.929140 28496 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:38.954964 28503 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:38.966547 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:38.904218 28372 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:38.977981 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:39.000907 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:38.979784 22601 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:39.006083 21870 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
W20260709 13:08:38.968384 28511 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:08:38.971527 28517 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:39.018544 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:38.961549 28106 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:38.910133 28480 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:39.038987 22019 raft_consensus.cc:2468] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:39.042155 22576 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:39.054762 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:39.037629 28466 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:39.066315 28523 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.084323 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:39.085351 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:39.101150 21950 raft_consensus.cc:2393] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 in current term 18: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:38.960498 28497 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:39.095968 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:39.104321 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:39.104980 21950 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:39.099217 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:39.115434 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:39.056195 28247 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:39.099680 28466 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.109750 28458 raft_consensus.cc:2804] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:39.123411 28496 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:39.122710 28480 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:39.058284 28453 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:08:39.159649 21866 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:39.140810 28466 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:39.132784 28498 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:39.182855 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.183430 22018 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:39.192858 22023 raft_consensus.cc:2410] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:08:39.193085 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.185041 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.187474 21941 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:39.200996 22017 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:39.211139 22023 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:08:39.211428 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 82407.6us
I20260709 13:08:39.214547 21942 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:39.215214 21950 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:39.214514 21841 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:39.217768 22022 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:39.118579 28523 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:39.173149 28458 raft_consensus.cc:697] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:39.225031 21916 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:39.176805 28496 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:39.219303 28518 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:39.211714 28429 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:08:39.282626 28347 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:39.224319 28247 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.245772 28376 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:39.219878 28454 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:08:39.224056 28522 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:08:39.326424 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:39.351738 21866 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:39.353437 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.401687 21872 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:08:39.408387 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 54129.2us
I20260709 13:08:39.408315 22022 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
W20260709 13:08:39.407235 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 71123us
I20260709 13:08:39.412932 22574 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:08:39.322564 28530 log.cc:927] Time spent T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:39.309610 28496 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:39.310173 28523 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:39.407778 28327 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.441148 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 191587us
I20260709 13:08:39.419008 28328 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.419220 28526 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.354023 28413 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:08:39.465000 28328 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:39.432296 28482 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:08:39.467689 28328 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:39.295711 28518 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:39.470094 28518 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:39.406414 28347 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:08:39.445264 28327 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:39.472780 28526 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:39.473688 28327 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:39.310038 28458 consensus_queue.cc:237] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:39.475559 28526 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:39.501052 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 59678.8us
W20260709 13:08:39.511225 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 68191.3us
I20260709 13:08:39.406664 28429 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 13:08:39.580037 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 168804us
I20260709 13:08:39.629679 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.630550 22023 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 21: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:39.567072 28247 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:39.574165 28523 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:39.633474 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 107858us
I20260709 13:08:39.635313 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.625970 28479 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:39.645539 28479 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:39.647864 28479 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:39.609663 28504 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:08:39.627569 28413 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.654453 28413 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:39.657086 28413 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:39.491503 28473 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.141s
W20260709 13:08:39.698279 22605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.087s	sys 0.162s
W20260709 13:08:39.698810 22605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.087s	sys 0.162s
I20260709 13:08:39.698143 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:39.699425 21946 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
W20260709 13:08:39.702176 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 274036us
I20260709 13:08:39.710144 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:39.683041 28523 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.722568 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:39.718652 28523 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.750984 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:39.698467 28247 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:39.751688 22610 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 20.
I20260709 13:08:39.753541 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:39.758253 21875 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 21.
W20260709 13:08:39.765488 28466 consensus_meta.cc:287] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 13:08:39.766216 28466 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:39.768265 28247 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:39.768949 22018 raft_consensus.cc:2368] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19.
I20260709 13:08:39.806165 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.807024 22021 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
I20260709 13:08:39.811060 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:39.815032 22574 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:39.821756 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:39.823468 28413 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:39.823877 28413 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.824209 28413 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:39.826279 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.836807 28454 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:39.837615 28454 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:39.816421 28518 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:39.839061 28518 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:39.839524 28518 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:39.840353 28454 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:39.853048 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:39.867224 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:39.871372 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "080e5fa3988746d88e6350506ed3b136" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:39.881685 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:39.930842 21875 raft_consensus.cc:2393] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 16: Already voted for candidate 95296a4420ed41b69191d3d4353cf2b0 in this term.
I20260709 13:08:39.930049 28443 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.929693 28459 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:39.668416 21766 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 15, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 15 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.964336 28246 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.001626 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.002621 22018 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 21.
I20260709 13:08:39.879616 28507 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.008834 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:40.011415 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.021922 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:40.022792 28503 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:40.023221 28503 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.023571 28503 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:40.033123 21914 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:40.034018 28471 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:40.037372 28480 consensus_meta.cc:287] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: Time spent flushing consensus metadata: real 0.825s	user 0.011s	sys 0.000s
I20260709 13:08:40.042428 28471 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.042802 28466 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:40.043009 28471 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.045342 28471 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.001343 28459 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.049852 28459 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.051975 28246 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.054159 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.054541 28246 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:39.973416 28546 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.063272 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:40.065310 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.068992 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:40.069558 21870 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.081849 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:40.088377 22574 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:40.108757 22606 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:39.972154 28443 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.078701 28537 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.081931 28536 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:40.124397 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:40.126686 21870 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:40.125443 21875 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 12.
W20260709 13:08:40.128996 21987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.019s	sys 0.032s
W20260709 13:08:40.129400 21987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.019s	sys 0.032s
W20260709 13:08:40.129832 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 915004us
I20260709 13:08:40.102672 28541 raft_consensus.cc:2749] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:40.112329 27899 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.064481 28507 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.075760 28546 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.168406 27943 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:40.131927 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:40.177702 28454 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.165719 28542 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:08:40.129443 28536 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.350497 21766 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 20, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 20 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.129184 28537 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.455799 28454 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.471800 28537 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:40.426955 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 262016us
I20260709 13:08:40.474041 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:40.438136 27899 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.208483 28413 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.328786 28457 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:40.464963 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 333125us
I20260709 13:08:40.473750 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:40.485504 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 289512us
I20260709 13:08:40.486219 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.426203 28480 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.526651 21948 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:40.464323 28386 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.473675 28535 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:40.540932 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:40.549587 21944 raft_consensus.cc:3060] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:40.490588 28454 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:40.561909 21949 raft_consensus.cc:1275] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:40.543941 21948 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:08:40.589248 28557 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:08:40.591099 28551 log.cc:927] Time spent T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:40.592798 28413 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:40.596204 28523 consensus_meta.cc:287] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.811s	user 0.009s	sys 0.000s
I20260709 13:08:40.598090 27899 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:40.599720 28507 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.605731 28546 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.609926 21944 raft_consensus.cc:2468] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:40.496773 28457 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.529621 28480 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:40.567190 28518 consensus_meta.cc:287] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.005s
I20260709 13:08:40.551424 28372 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:40.566586 28386 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.649317 28443 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:40.648126 28372 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.638653 28523 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.643755 28518 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.724478 28246 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.729831 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:40.733673 22601 raft_consensus.cc:2368] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17.
I20260709 13:08:40.725131 28507 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.725457 28443 raft_consensus.cc:493] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:40.734355 28471 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.730098 28246 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:40.746541 28503 consensus_meta.cc:287] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: Time spent flushing consensus metadata: real 0.722s	user 0.017s	sys 0.000s
I20260709 13:08:40.744321 28454 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:08:40.759238 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 240927us
I20260709 13:08:40.763075 21988 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:40.766681 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.767661 22019 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 24.
I20260709 13:08:40.774422 22019 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:08:40.751543 28507 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.667313 21766 catalog_manager.cc:5697] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:40.783747 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.786163 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
W20260709 13:08:40.770406 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 297991us
I20260709 13:08:40.756011 28443 raft_consensus.cc:515] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.763244 28575 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:40.769726 28498 raft_consensus.cc:2804] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:40.759550 28471 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.761745 28503 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.826520 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:40.786149 28413 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.830468 28413 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.773608 28573 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:40.830814 28521 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.832814 28413 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.832716 28521 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.831962 28573 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.838198 28498 raft_consensus.cc:697] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:40.839326 28498 consensus_queue.cc:237] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.839953 28443 leader_election.cc:290] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:40.842089 28471 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.770604 28454 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:40.852169 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.815263 21841 leader_election.cc:400] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19.
I20260709 13:08:40.854612 21841 leader_election.cc:403] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:40.853719 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:40.856428 22016 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.831071 27943 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.859897 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.869632 22020 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 24.
W20260709 13:08:40.871104 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 56023.4us
I20260709 13:08:40.861109 28573 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:40.863320 28536 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:40.864547 28523 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.866031 28507 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.866768 21766 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 14, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.886547 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.873245 22016 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:40.835223 28521 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.884076 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:40.816252 27899 raft_consensus.cc:493] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:40.875188 27943 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:40.895880 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:40.904542 28457 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:40.907459 21942 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 25.
I20260709 13:08:40.897117 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.879843 28328 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687) with higher term. Message: Invalid argument: T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19.
I20260709 13:08:40.908499 28536 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:40.902927 28458 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:40.910120 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:40.915014 28458 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.915280 28246 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:40.915493 28458 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:40.906348 28372 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:40.885082 28386 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.911113 28518 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.912799 28454 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.914443 28503 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 22 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:40.828035 28575 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:40.875202 28542 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:40.922463 21766 catalog_manager.cc:5697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.926600 28546 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:40.927538 21942 raft_consensus.cc:1275] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:08:40.929144 28575 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:40.938161 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:40.938424 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:40.938830 21875 raft_consensus.cc:3060] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:40.939664 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:40.988628 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:40.989634 22604 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:40.993500 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:40.994524 21941 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
W20260709 13:08:40.998194 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 103112us
W20260709 13:08:40.998081 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 58265.9us
I20260709 13:08:41.029438 21875 raft_consensus.cc:2468] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 13.
I20260709 13:08:40.988438 28310 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:41.043416 28310 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.003809 28182 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:08:41.049389 28480 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.056077 27943 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.009138 28466 consensus_queue.cc:1048] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:08:41.066821 27943 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:41.070325 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 68866.5us
I20260709 13:08:41.071714 28476 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:41.071182 21766 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 17 to 18, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 18 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.074235 21766 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 14 to 16, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 16 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.076678 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.076175 21766 catalog_manager.cc:5697] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 14 to 22, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 22 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:41.078161 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.077811 21766 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:41.079299 21766 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 16, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 16 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.082020 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:40.909988 27899 raft_consensus.cc:515] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.084040 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.084369 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.085160 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:41.085394 27899 leader_election.cc:290] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:40.936261 28542 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.085897 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:41.085891 22015 raft_consensus.cc:2393] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bcc802f7bc374bed98e2ee0596a8ebda in current term 21: Already voted for candidate 51e52b544fab4275aab4f7fbe81942d2 in this term.
I20260709 13:08:41.086925 28310 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:41.086973 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:41.087687 28542 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:41.090499 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 81625.4us
I20260709 13:08:41.085490 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:41.091804 22604 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 22.
I20260709 13:08:41.092185 22016 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.028419 21916 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:41.075991 28458 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:41.097210 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 68873.8us
I20260709 13:08:41.108290 21841 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:41.111232 22601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57086 (request call id 983) took 1386 ms. Trace:
I20260709 13:08:41.098004 27943 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:08:41.123380 22605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57086 (request call id 982) took 1417 ms. Trace:
I20260709 13:08:41.110916 28507 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:41.123796 22605 rpcz_store.cc:276] 0709 13:08:39.706381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.706565 (+   184us) service_pool.cc:224] Handling call
0709 13:08:39.706873 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.724297 (+ 17424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.724327 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.742820 (+ 18493us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.147534 (+404714us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:40.147594 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.147740 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.123119 (+975379us) raft_consensus.cc:1685] finished
0709 13:08:41.123142 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.123290 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17033,"raft.queue_time_us":17765,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":8948,"thread_start_us":382441,"threads_started":1,"wal-append.queue_time_us":1339830}
I20260709 13:08:41.125152 28507 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.125679 28507 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:41.105664 21916 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:41.111747 22601 rpcz_store.cc:276] 0709 13:08:39.709660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.709850 (+   190us) service_pool.cc:224] Handling call
0709 13:08:41.096076 (+1386226us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400663854. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f63560762fa 00007f635b037b17 00007f63545b26d4 00007f63545b2662 00007f63545b2591 00007f63545b250c 00007f63545b17c2 00007f63543ad48c 00007f63543ac8c6 00007f63543ac26f
0709 13:08:41.096255 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351860992}
I20260709 13:08:41.133318 21841 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:41.130548 21839 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:41.139160 22016 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:41.142705 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.143905 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.148687 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.146185 22576 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:41.152221 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:41.153098 21948 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.156749 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.158617 22606 raft_consensus.cc:2368] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 25. Current term is 26.
I20260709 13:08:41.165510 21988 leader_election.cc:400] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17.
I20260709 13:08:41.166002 21988 leader_election.cc:403] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.170464 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.173185 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.142226 27899 raft_consensus.cc:2804] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:41.145627 28504 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:41.184473 22573 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:41.191561 27899 raft_consensus.cc:697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:41.180970 28182 raft_consensus.cc:493] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:41.199806 28182 raft_consensus.cc:515] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.201311 21950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2054) took 1459 ms. Trace:
I20260709 13:08:41.170485 28537 raft_consensus.cc:2804] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:41.201725 21950 rpcz_store.cc:276] 0709 13:08:39.741443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.748282 (+  6839us) service_pool.cc:224] Handling call
0709 13:08:39.748559 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.748888 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.748913 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.749427 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.074814 (+325387us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:40.074855 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.074924 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.201074 (+1126150us) raft_consensus.cc:1685] finished
0709 13:08:41.201096 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.201250 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":248,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":13427,"thread_start_us":234577,"threads_started":1,"wal-append.queue_time_us":1175698}
I20260709 13:08:41.185771 28443 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 16. Current term is 17.
W20260709 13:08:41.209690 28566 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:08:41.220566 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.222971 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d092f1c41e747e194d93526c0fad944" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.228102 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:41.230250 21867 raft_consensus.cc:3060] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:41.231086 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.232218 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.232309 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.226791 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:41.237255 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.244554 21867 raft_consensus.cc:2468] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:41.216234 21766 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 17, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 17 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:41.248378 21766 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.249436 28549 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:41.250226 28570 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:41.250368 21766 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.250797 28570 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.262699 28182 leader_election.cc:290] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:41.265859 21766 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.269155 28443 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.271168 27899 consensus_queue.cc:237] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.272029 21944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:41.218497 28556 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:41.238301 28537 raft_consensus.cc:697] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:08:41.273527 28592 log.cc:927] Time spent T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:41.273608 28537 consensus_queue.cc:237] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.268163 21766 catalog_manager.cc:5697] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 16 to 18, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 18 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.275589 28429 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:41.276345 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.277467 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.278045 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5375c76fdd4d4624b9b6cbaa44ae40c0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.279165 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "761d07666b514c36bcf7826ed77f8d8b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.279266 21870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.280126 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.280385 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:41.281312 28480 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:41.281888 28480 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.282526 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:41.284035 28480 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.275290 21766 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 16 to 21, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 21 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:41.218232 28582 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:41.284875 28582 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.217767 28576 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:41.285794 21766 catalog_manager.cc:5697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 12, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 12 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.229285 28256 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:41.274353 21947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54888 (request call id 2052) took 1545 ms. Trace:
I20260709 13:08:41.287024 28576 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 22 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:41.288038 28576 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.288980 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.289609 22022 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
I20260709 13:08:41.217783 28572 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:41.291615 28572 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.287683 21766 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 14 to 16, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 16 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:41.287418 21947 rpcz_store.cc:276] 0709 13:08:39.729386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.729568 (+   182us) service_pool.cc:224] Handling call
0709 13:08:39.742502 (+ 12934us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:39.742853 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.742882 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:39.748187 (+  5305us) log.cc:844] Serialized 52 byte log entry
0709 13:08:40.069435 (+321248us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:40.211658 (+142223us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.414572 (+202914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.414671 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.043712 (+629041us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b1800190c60. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6352f85522 00007f6352f877c1 00007f6352f87779 00007f6352f87709 00007f6352f876d1 00007f6352f869cd 000000000038f354 000000000038f199 00007f6352f6883a
0709 13:08:41.069471 (+ 25759us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4400022b4c. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352eabc85 00007f6352eac6a2 00007f6355c1e1db 00007f6355c19aaf 00007f6355c0d86e 00007f6355c0cbb6 00007f6355c0c7d8 00007f6355c16221 00007f6355c161d9 00007f6355c16169
0709 13:08:41.274114 (+204643us) raft_consensus.cc:1685] finished
0709 13:08:41.274135 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.274275 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3715,"prepare.queue_time_us":127387,"prepare.run_cpu_time_us":8204,"prepare.run_wall_time_us":217736,"raft.queue_time_us":316,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":27253,"spinlock_wait_cycles":43246720,"thread_start_us":342568,"threads_started":2,"wal-append.queue_time_us":1000655}
W20260709 13:08:41.293282 28561 log.cc:927] Time spent T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:41.294541 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.296727 21916 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:41.306367 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:41.205000 28384 consensus_queue.cc:1048] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:08:41.319743 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.322522 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.322974 22601 raft_consensus.cc:2393] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 26: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:41.319029 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fae287aad247d99c33e1a07c6e82a3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.276147 28429 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:41.324960 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 88168.3us
I20260709 13:08:41.320016 21948 raft_consensus.cc:2468] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
W20260709 13:08:41.336125 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 94685.2us
I20260709 13:08:41.336800 21943 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:08:41.327926 28574 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:41.328190 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:41.328553 28570 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.329344 28583 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:41.323807 28444 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.324332 28384 consensus_queue.cc:1243] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer 61893f17f34b4cc9b898114d3c0a7023 log is divergent from this leader: its last log entry 17.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:08:41.330971 28572 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.330844 21766 catalog_manager.cc:5697] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.331902 28582 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.344043 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.344807 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:41.347368 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.350309 22573 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:41.351886 28458 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 26 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.351532 28444 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.352373 28256 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:41.352526 22601 raft_consensus.cc:1240] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:41.322258 28480 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:41.360801 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.382437 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.361617 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a8fcd2517b44a4895a7b0ec8966a41" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.379817 21988 leader_election.cc:400] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 25 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 25. Current term is 26.
I20260709 13:08:41.409348 21988 leader_election.cc:403] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.382941 21875 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 15.
I20260709 13:08:41.404664 28504 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:41.358069 28471 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:41.356408 28507 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.427460 28578 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:41.453116 28578 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.453727 21944 raft_consensus.cc:2368] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 25. Current term is 26.
I20260709 13:08:41.361052 28574 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.456036 28578 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:41.408078 28256 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:41.423249 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 73177.5us
W20260709 13:08:41.470743 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 122639us
W20260709 13:08:41.473841 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 94172us
I20260709 13:08:41.404631 28386 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:41.475726 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:41.408552 28480 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:41.411985 28572 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:41.367952 28583 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:41.481642 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 61136.9us
I20260709 13:08:41.420178 28328 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:41.482645 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:41.485327 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:41.486317 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.476367 22022 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 24 FOLLOWER]: Advancing to term 26
W20260709 13:08:41.478109 28557 log.cc:927] Time spent T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:41.486672 28480 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:41.523442 21987 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.489441 28571 raft_consensus.cc:2804] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:41.468662 28504 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.501830 28507 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 26 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:41.475162 28471 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.558048 28471 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.566851 28583 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.567482 28504 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.567948 28429 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:41.569347 28571 raft_consensus.cc:697] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:41.569685 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.570338 28571 consensus_queue.cc:237] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.534440 28585 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:41.530182 21766 catalog_manager.cc:5697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.485986 28386 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.525753 28581 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:41.583783 28581 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.584667 28386 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:41.586320 28581 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.500531 28328 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.589239 28328 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.589440 28444 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:41.491128 28518 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:41.553550 28596 log.cc:927] Time spent T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:08:41.570815 28574 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:41.490995 28572 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.594642 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:41.595260 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 201135us
I20260709 13:08:41.546075 28578 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.594491 28518 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:41.598891 28595 log.cc:927] Time spent T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:08:41.533100 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.605507 22574 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:41.613413 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 80417.3us
I20260709 13:08:41.542656 22022 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 26.
I20260709 13:08:41.600567 28574 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:41.600801 28581 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:41.640898 28310 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 25. Current term is 26.
I20260709 13:08:41.646185 28572 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.648569 28518 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:41.649235 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.649451 28581 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.652025 28581 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:41.653263 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.653508 28574 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.579981 21766 catalog_manager.cc:5697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 11, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 11 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.656414 28574 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.660706 28548 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.656958 28603 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:41.666591 21766 catalog_manager.cc:5697] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.668118 21766 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.669732 21766 catalog_manager.cc:5697] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 16, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 16 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:41.673151 21766 catalog_manager.cc:5697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
W20260709 13:08:41.675340 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 156169us
I20260709 13:08:41.676108 21988 leader_election.cc:304] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:41.680451 28256 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.682717 28256 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.685781 21943 pending_rounds.cc:85] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Aborting all ops after (but not including) 15
I20260709 13:08:41.686182 21943 pending_rounds.cc:107] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 13:08:41.686452 21943 raft_consensus.cc:2889] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.687558 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:41.688258 21948 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:41.688323 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:41.690307 28480 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:41.695051 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
W20260709 13:08:41.675354 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 189084us
I20260709 13:08:41.700220 21988 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.702627 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.704824 21914 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.706548 28182 raft_consensus.cc:2749] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:41.707335 28182 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.709430 28444 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:41.712538 21914 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.712551 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.724125 21949 raft_consensus.cc:2393] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 in current term 20: Already voted for candidate 61893f17f34b4cc9b898114d3c0a7023 in this term.
I20260709 13:08:41.726866 22573 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.731034 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:41.736868 21987 leader_election.cc:400] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983) with higher term. Message: Invalid argument: T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51e52b544fab4275aab4f7fbe81942d2 for earlier term 25. Current term is 26.
I20260709 13:08:41.745090 22610 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:41.754933 21945 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:41.756776 28457 consensus_queue.cc:1059] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:41.760222 28457 raft_consensus.cc:3055] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:41.760708 28457 raft_consensus.cc:740] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:41.761652 28457 consensus_queue.cc:260] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.763139 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.753494 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:41.775759 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:41.763854 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.764849 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.764792 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.778893 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.780941 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.784694 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.785530 21987 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.787587 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.788192 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.791643 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.793447 28568 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:41.762868 28606 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.769390 28520 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:41.794862 28520 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:41.795264 28520 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:41.796626 28542 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:41.796828 28457 raft_consensus.cc:3060] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:41.796783 21988 leader_election.cc:304] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:41.805491 21875 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:41.806293 21914 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.789492 21766 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.808902 28259 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.815757 22605 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:41.817195 28585 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:41.821278 28480 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:41.814574 28443 raft_consensus.cc:2749] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:41.831151 28310 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.831894 28256 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:41.858381 21914 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.834033 28548 consensus_queue.cc:1059] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:41.802639 28568 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:41.838419 22023 raft_consensus.cc:1275] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:41.843451 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:41.853825 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:41.876504 21841 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:41.855435 21766 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.868024 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:08:41.869441 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 50352.3us
I20260709 13:08:41.871417 21868 raft_consensus.cc:1275] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:41.885069 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:41.892910 21914 leader_election.cc:304] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.897969 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:41.899199 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:41.900795 28384 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.885362 28443 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:41.908694 21914 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.852512 28542 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:41.901578 28585 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.895145 28546 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:41.891700 28473 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:08:41.925189 28607 consensus_queue.cc:1048] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.912194 28487 consensus_queue.cc:1048] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:08:41.912118 28540 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:41.891820 28568 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.927352 28310 raft_consensus.cc:3055] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:41.932935 21914 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.915452 28507 raft_consensus.cc:2749] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:41.933746 28606 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:41.936107 28310 raft_consensus.cc:740] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:41.943523 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.944247 27899 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:41.983417 21914 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:41.989962 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:41.998114 28585 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:41.998522 28585 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:41.998886 28585 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:42.006596 28267 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:42.007205 28267 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:42.007369 28585 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:42.009495 28267 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:42.010437 21941 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:42.014947 21766 catalog_manager.cc:5697] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 14, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.013633 28585 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:42.019001 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:42.039990 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 47991.5us
I20260709 13:08:41.981854 28572 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:41.985265 28606 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:42.060680 28608 log.cc:927] Time spent T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:42.063334 28310 consensus_queue.cc:260] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:41.992542 28386 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:42.053442 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:42.052244 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca34a4d332f1434f8089d28952415e70" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:42.054591 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 59151.9us
I20260709 13:08:42.084962 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.089273 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.109105 22023 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:42.084194 28572 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:42.116164 28572 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:42.119738 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:42.123525 28520 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:42.124771 22605 raft_consensus.cc:1240] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:42.125222 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.132762 22019 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:42.143365 28310 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:42.150667 28520 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:42.159945 28549 consensus_queue.cc:1059] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:42.161451 28572 raft_consensus.cc:3055] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:42.161860 28572 raft_consensus.cc:740] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:42.162714 28572 consensus_queue.cc:260] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:42.165868 28572 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:42.166422 22023 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:42.177991 28473 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:42.181933 22023 raft_consensus.cc:1240] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Rejecting Update request from peer 95296a4420ed41b69191d3d4353cf2b0 for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:42.184041 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 57317.1us
I20260709 13:08:42.188525 21875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:42.189647 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:42.192775 21868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "105015b2b463442ab34e0509af7105fb"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:38602
I20260709 13:08:42.193513 21868 raft_consensus.cc:606] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:42.193874 21868 raft_consensus.cc:614] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:42.192791 28473 consensus_queue.cc:1059] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:08:42.197113 28473 raft_consensus.cc:3055] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:42.197481 28473 raft_consensus.cc:740] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:42.197769 22604 raft_consensus.cc:1240] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:42.195950 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 52763.6us
I20260709 13:08:42.200318 21949 raft_consensus.cc:1275] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:42.201865 28384 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:42.198289 28473 consensus_queue.cc:260] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:42.203133 28473 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:42.207944 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:42.208665 22020 raft_consensus.cc:606] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Received request to transfer leadership to TS 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.212321 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.212819 21943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.213508 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ade18365d2864739b70e41ba62311466" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.214951 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "535d3d7bb32243b6b555376404412d8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.215548 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:42.214915 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.215936 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:42.215775 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.216431 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:42.217435 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:42.217727 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:42.217418 21868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ade18365d2864739b70e41ba62311466"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:38602
I20260709 13:08:42.218747 21868 raft_consensus.cc:606] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Received request to transfer leadership to TS 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.218890 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:42.219129 21868 raft_consensus.cc:614] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:42.219790 21875 raft_consensus.cc:2468] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:42.221114 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7685d376b61d438aa76f16fe47a7846d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:42.222088 21867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:42.233616 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:42.240583 21869 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:08:42.243621 22574 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.246714 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.247073 21869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:42.251734 21838 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.250209 21914 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.252997 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.254150 21838 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.257772 28504 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:42.258867 28620 consensus_queue.cc:1048] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:08:42.259660 28504 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.260376 28620 raft_consensus.cc:2804] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:42.260952 28620 raft_consensus.cc:697] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:42.261806 28620 consensus_queue.cc:237] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:42.264757 28507 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:42.262846 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.255903 28429 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:42.266641 28429 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:42.246328 28626 log.cc:927] Time spent T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:42.267970 21838 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.274205 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.276518 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.282377 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.285262 28386 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.281008 28259 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.289441 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.255682 28546 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.291955 21875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
mode: GRACEFUL
new_leader_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:38602
I20260709 13:08:42.295581 21875 raft_consensus.cc:606] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Received request to transfer leadership to TS 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.296005 21875 raft_consensus.cc:614] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:42.302270 27899 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:42.311710 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.281993 28429 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:42.313751 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:42.288828 28507 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:08:42.319682 21914 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.318094 21838 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.321765 21838 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.322959 21838 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.329218 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:42.331136 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:42.332501 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.333874 21838 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:42.329598 28504 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.350240 28429 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.346773 28503 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:42.330178 28480 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.329417 28328 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:42.404855 21874 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 20.
I20260709 13:08:42.384498 28581 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.408752 28535 raft_consensus.cc:993] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 61893f17f34b4cc9b898114d3c0a7023 to start an election
I20260709 13:08:42.408888 28259 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:42.409411 28535 raft_consensus.cc:1081] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Signalling peer 61893f17f34b4cc9b898114d3c0a7023 to start an election
W20260709 13:08:42.414244 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 94645.1us
I20260709 13:08:42.422627 21950 raft_consensus.cc:1240] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Rejecting Update request from peer bcc802f7bc374bed98e2ee0596a8ebda for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:42.437624 28540 consensus_queue.cc:1059] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:42.438808 28540 raft_consensus.cc:3055] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:42.439189 28540 raft_consensus.cc:740] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:42.348412 28574 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:42.446066 21950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:54900
I20260709 13:08:42.453873 21950 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:42.454386 21950 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.451382 21945 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 26 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:08:42.462534 22022 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 26 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:08:42.466852 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 133050us
I20260709 13:08:42.485877 21914 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:42.440075 28540 consensus_queue.cc:260] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:42.457415 28256 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.042s
I20260709 13:08:42.508132 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:42.513216 28259 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:42.512291 28606 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:42.520483 21950 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:42.500870 28480 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:42.525468 21950 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:42.536926 22024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:42.537671 22024 raft_consensus.cc:3055] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:42.538053 22024 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:42.567137 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:42.568022 21868 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.523283 28451 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.034s
I20260709 13:08:42.571306 22024 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:42.657230 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 79452.8us
W20260709 13:08:42.666479 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 86540.3us
I20260709 13:08:42.669989 21868 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:42.693794 21914 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
W20260709 13:08:42.723344 22575 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.730885 27899 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:42.731489 27899 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:42.719656 28627 log.cc:927] Time spent T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.368s	user 0.004s	sys 0.001s
I20260709 13:08:42.754722 22017 raft_consensus.cc:1275] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:08:42.756455 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 62753.4us
I20260709 13:08:42.732379 27899 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:42.777609 28639 consensus_queue.cc:1048] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:42.811206 28636 log.cc:927] Time spent T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
W20260709 13:08:42.889953 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 73178.5us
W20260709 13:08:42.922515 28631 log.cc:927] Time spent T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:08:42.938939 22024 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.981587 22024 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 14.
I20260709 13:08:43.025916 21868 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:08:43.051980 28540 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:43.053153 21949 raft_consensus.cc:3060] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:43.064188 28583 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:08:43.082669 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 139512us
I20260709 13:08:43.107939 21949 raft_consensus.cc:1275] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:08:43.181222 22018 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:43.184573 28413 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:43.217885 21866 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:43.128715 28651 consensus_queue.cc:1048] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.098s
I20260709 13:08:43.220057 28600 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:43.294957 28182 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.295567 28182 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.301792 28182 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:43.303210 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:43.303972 22604 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:43.305608 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:43.306310 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:43.308389 28498 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:43.308833 28498 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.309180 28498 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:43.332149 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:43.349323 28498 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.425247 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:43.428573 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:43.429237 22604 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:43.432638 28498 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:43.442701 22604 raft_consensus.cc:2468] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:43.444195 21988 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:43.446460 28498 raft_consensus.cc:2804] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:43.448230 28498 raft_consensus.cc:697] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:43.449122 28498 consensus_queue.cc:237] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.467211 28639 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:43.467767 28639 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.470893 28639 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:43.479626 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:43.482118 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866936931060464d858e0e11cefba859" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:43.482990 22604 raft_consensus.cc:2368] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 19. Current term is 20.
I20260709 13:08:43.485034 21914 leader_election.cc:400] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 19. Current term is 20.
I20260709 13:08:43.485375 21914 leader_election.cc:403] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.487422 28600 raft_consensus.cc:3060] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:08:43.515902 28498 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.521212 28498 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:43.543051 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:43.543853 21868 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:43.545234 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:43.548847 28542 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:43.553974 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:43.554708 21949 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:43.553977 28542 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.551941 28498 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:43.558607 28542 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:43.562187 28600 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571) with higher term. Message: Invalid argument: T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 for earlier term 19. Current term is 20.
I20260709 13:08:43.572187 28542 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:43.576850 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:43.576287 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:43.577507 21866 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:43.577546 21949 raft_consensus.cc:3060] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:43.578935 21767 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 8 to 9, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 9 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:43.588702 21866 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
I20260709 13:08:43.589848 21949 raft_consensus.cc:2468] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
I20260709 13:08:43.590103 21988 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:43.591040 28542 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:43.591403 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33566
I20260709 13:08:43.592067 22020 raft_consensus.cc:606] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:08:43.592195 28542 raft_consensus.cc:2804] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:43.592494 21767 catalog_manager.cc:5697] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.595208 28542 raft_consensus.cc:697] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:43.596108 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33566
I20260709 13:08:43.597209 22020 raft_consensus.cc:606] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:08:43.597520 28542 consensus_queue.cc:237] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:43.598470 21760 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for d8f404cd14ba4c2687ffe2b7637e1da7 already in progress
I20260709 13:08:43.619477 21767 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.622618 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33566
I20260709 13:08:43.623307 22020 raft_consensus.cc:606] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Received request to transfer leadership
W20260709 13:08:43.627035 21766 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49094 (request call id 255) took 14533 ms (client timeout 15000 ms). Trace:
I20260709 13:08:43.623471 21767 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 15 to 17, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 17 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:43.631196 21766 rpcz_store.cc:269] 0709 13:08:29.093234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.093577 (+   343us) service_pool.cc:224] Handling call
0709 13:08:29.621833 (+528256us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdc090 00007f635607af3a 00007f635be311cc 00007f635bf2f37e 00007f635a3f02a4 00007f635a3f0232 00007f635a3f0161 00007f635a3f00dc 00007f635a3ef392 00007f63543ad48c 00007f63543ac8c6
0709 13:08:43.626923 (+14005090us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.471889 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.472650 (+   761us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.472709 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:08:42.472731 (+    22us) tablet.cc:662] Decoding operations
0709 13:08:42.474884 (+  2153us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.475004 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.475044 (+    40us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:08:42.477701 (+  2657us) tablet.cc:701] Row locks acquired
0709 13:08:42.477755 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:08:42.478008 (+   253us) write_op.cc:270] Start()
0709 13:08:42.478221 (+   213us) write_op.cc:276] Timestamp: P: 1783602522477918 usec, L: 0
0709 13:08:42.478254 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.479395 (+  1141us) log.cc:844] Serialized 10866 byte log entry
0709 13:08:43.006280 (+526885us) op_driver.cc:464] REPLICATION: finished
0709 13:08:43.169368 (+163088us) write_op.cc:301] APPLY: starting
0709 13:08:43.169470 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:43.209210 (+ 39740us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:43.209348 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:43.425556 (+216208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:43.425890 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:08:43.425933 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:43.426399 (+   466us) log.cc:844] Serialized 244 byte log entry
0709 13:08:43.437674 (+ 11275us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.437893 (+   219us) write_op.cc:454] Released schema lock
0709 13:08:43.437974 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:43.475384 (+ 37410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.475413 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":307286,"reported_tablets":49,"spinlock_wait_cycles":51264896,"child_traces":[["op",{"apply.queue_time_us":162777,"apply.run_cpu_time_us":35739,"apply.run_wall_time_us":305984,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121335,"num_ops":28,"prepare.queue_time_us":183154,"prepare.run_cpu_time_us":26954,"prepare.run_wall_time_us":113173,"raft.queue_time_us":178335,"raft.run_cpu_time_us":45573,"raft.run_wall_time_us":127329,"replication_time_us":527832,"thread_start_us":478450,"threads_started":4,"wal-append.queue_time_us":222239}]]}
W20260709 13:08:43.682140 21821 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:08:43.682657 21821 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d8f404cd14ba4c2687ffe2b7637e1da7 already in progress
W20260709 13:08:43.682994 21821 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d8f404cd14ba4c2687ffe2b7637e1da7 already in progress
W20260709 13:08:43.755883 21767 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 166) took 41476 ms (client timeout 15000 ms). Trace:
I20260709 13:08:43.766568 28451 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.767237 28451 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.770512 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0" is_pre_election: true
I20260709 13:08:43.774070 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:43.774744 21949 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:43.776331 22573 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:43.777230 28651 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:43.777663 28651 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.778024 28651 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:43.756392 21767 rpcz_store.cc:269] 0709 13:08:02.286085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.328524 (+ 42439us) service_pool.cc:224] Handling call
0709 13:08:43.755782 (+41427258us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:43.649680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:43.650270 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:43.650305 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:43.650322 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:43.650910 (+   588us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:43.650997 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:43.651021 (+    24us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:43.651403 (+   382us) tablet.cc:701] Row locks acquired
0709 13:08:43.651420 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:43.651561 (+   141us) write_op.cc:270] Start()
0709 13:08:43.651666 (+   105us) write_op.cc:276] Timestamp: P: 1783602523651518 usec, L: 0
0709 13:08:43.651686 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:43.652323 (+   637us) log.cc:844] Serialized 1658 byte log entry
0709 13:08:43.669031 (+ 16708us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b1800042280. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f82455 00007f6359aa716c 00007f6359a67c18 00007f635bf682d1
0709 13:08:43.687596 (+ 18565us) op_driver.cc:464] REPLICATION: finished
0709 13:08:43.688220 (+   624us) write_op.cc:301] APPLY: starting
0709 13:08:43.688300 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:43.690566 (+  2266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:43.690587 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:43.692548 (+  1961us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:43.694014 (+  1466us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:43.694061 (+    47us) write_op.cc:312] APPLY: finished
0709 13:08:43.694282 (+   221us) log.cc:844] Serialized 49 byte log entry
0709 13:08:43.694477 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.694567 (+    90us) write_op.cc:454] Released schema lock
0709 13:08:43.694611 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":855115,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":5460,"apply.run_wall_time_us":6717,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16744,"num_ops":4,"prepare.queue_time_us":12645,"prepare.run_cpu_time_us":2930,"prepare.run_wall_time_us":2930,"replication_time_us":35709,"spinlock_wait_cycles":15807232,"thread_start_us":15672,"threads_started":1}]]}
I20260709 13:08:43.788295 28182 raft_consensus.cc:993] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:08:43.788904 28182 raft_consensus.cc:1081] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Signalling peer bcc802f7bc374bed98e2ee0596a8ebda to start an election
I20260709 13:08:43.790750 22604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
 from {username='slave'} at 127.0.0.1:57086
I20260709 13:08:43.791272 22604 raft_consensus.cc:493] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.791615 22604 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:43.799226 22604 raft_consensus.cc:515] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.790036 28651 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.804240 21868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:43.805079 21868 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:43.814440 21866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
I20260709 13:08:43.818085 28651 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:43.825560 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 44722.5us
I20260709 13:08:43.828919 21868 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:43.829674 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:43.830384 22020 raft_consensus.cc:3055] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:43.830710 22020 raft_consensus.cc:740] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:43.831540 22020 consensus_queue.cc:260] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.787271 28451 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:43.782320 21769 catalog_manager.cc:5697] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.838518 22020 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:43.822700 22604 leader_election.cc:290] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:43.840735 21769 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:43.842913 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:43.863082 21949 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:43.843531 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f404cd14ba4c2687ffe2b7637e1da7" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:43.865336 21950 raft_consensus.cc:3060] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:43.883730 21950 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:43.885433 22573 leader_election.cc:304] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:43.886927 21949 raft_consensus.cc:2468] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:43.851718 22020 raft_consensus.cc:2468] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:43.888242 28673 raft_consensus.cc:2804] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:43.888876 28673 raft_consensus.cc:697] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:43.891232 22573 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:43.889820 28673 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.895985 21769 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 15 to 18, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 18 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:43.905226 21769 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 10 to 15, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 15 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.917462 21769 catalog_manager.cc:5697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 14 to 15, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 15 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.903718 28676 raft_consensus.cc:2804] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:43.919664 28676 raft_consensus.cc:697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:43.920929 28676 consensus_queue.cc:237] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:43.926258 21769 catalog_manager.cc:5697] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.930042 21769 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 11 to 13, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 13 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:43.932186 21769 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.948750 21769 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 12 to 13, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 13 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.966491 22604 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:43.975446 28498 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:43.987771 21950 raft_consensus.cc:1275] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:43.993979 28457 consensus_queue.cc:1048] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:43.996148 21866 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:43.998701 28457 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:44.006455 21941 raft_consensus.cc:1275] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:44.008159 28457 consensus_queue.cc:1048] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:44.203998 21769 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 288) took 17003 ms (client timeout 15000 ms). Trace:
W20260709 13:08:44.204481 21769 rpcz_store.cc:269] 0709 13:08:27.200961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.204774 (+  3813us) service_pool.cc:224] Handling call
0709 13:08:27.357569 (+152795us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b5400002490. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6352e0ddb1 00007f6352f4e640 00007f635be25b76 00007f635bf2fc3e 00007f635a3f02a4 00007f635a3f0232 00007f635a3f0161 00007f635a3f00dc 00007f635a3ef392 00007f63543ad48c 00007f63543ac8c6
0709 13:08:44.203908 (+16846339us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:43.978658 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:43.979159 (+   501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:43.979201 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:08:43.979220 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:43.980202 (+   982us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:43.980257 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:43.980291 (+    34us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:08:43.981089 (+   798us) tablet.cc:701] Row locks acquired
0709 13:08:43.981106 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:43.981255 (+   149us) write_op.cc:270] Start()
0709 13:08:43.981364 (+   109us) write_op.cc:276] Timestamp: P: 1783602523981210 usec, L: 0
0709 13:08:43.981398 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:43.982113 (+   715us) log.cc:844] Serialized 3563 byte log entry
0709 13:08:43.987052 (+  4939us) op_driver.cc:464] REPLICATION: finished
0709 13:08:43.989597 (+  2545us) write_op.cc:301] APPLY: starting
0709 13:08:43.989694 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:43.997818 (+  8124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:43.997917 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:44.044284 (+ 46367us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:44.047350 (+  3066us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:08:44.068090 (+ 20740us) write_op.cc:312] APPLY: finished
0709 13:08:44.068405 (+   315us) log.cc:844] Serialized 89 byte log entry
0709 13:08:44.068568 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.070456 (+  1888us) write_op.cc:454] Released schema lock
0709 13:08:44.070507 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:44.070902 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.070931 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22857,"reported_tablets":50,"spinlock_wait_cycles":52496256,"child_traces":[["op",{"apply.queue_time_us":2291,"apply.run_cpu_time_us":13179,"apply.run_wall_time_us":81252,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37674,"num_ops":9,"prepare.queue_time_us":8060,"prepare.run_cpu_time_us":3752,"prepare.run_wall_time_us":18374,"replication_time_us":5504}]]}
I20260709 13:08:44.238448 21766 catalog_manager.cc:5697] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 20 to 21, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 21 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:44.239259 21772 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 286) took 58014 ms (client timeout 15000 ms). Trace:
W20260709 13:08:44.239750 21772 rpcz_store.cc:269] 0709 13:07:46.224484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.235116 (+ 10632us) service_pool.cc:224] Handling call
0709 13:08:44.239065 (+58003949us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605910,"reported_tablets":50}
I20260709 13:08:44.240060 21766 catalog_manager.cc:5697] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.241626 21766 catalog_manager.cc:5697] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.242981 21766 catalog_manager.cc:5697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 18, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 18 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.244225 21766 catalog_manager.cc:5697] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.245467 21766 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 19, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 19 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.246460 21766 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.247452 21766 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 17 to 19, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 19 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.248334 21766 catalog_manager.cc:5697] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 19, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 19 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.249677 21766 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 16, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 16 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.251828 21766 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.253228 21766 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 16, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 16 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.254437 21766 catalog_manager.cc:5697] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.255437 21766 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 21 to 26. New cstate: current_term: 26 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.256299 21766 catalog_manager.cc:5697] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 16 to 19, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 19 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.257807 21766 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.259060 21766 catalog_manager.cc:5697] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 6 to 19. New cstate: current_term: 19 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.260387 21766 catalog_manager.cc:5697] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 19 to 20, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 20 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.261770 21766 catalog_manager.cc:5697] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 16 to 19, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 19 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.263470 21766 catalog_manager.cc:5697] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.266161 21766 catalog_manager.cc:5697] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 16, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 16 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.269235 21766 catalog_manager.cc:5697] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.270499 21766 catalog_manager.cc:5697] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.272024 21766 catalog_manager.cc:5697] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 13, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 13 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.273605 21766 catalog_manager.cc:5697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 18, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 18 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.274914 21766 catalog_manager.cc:5697] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 14 to 15, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.276469 21766 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 14, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.278479 21766 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 19 to 20, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 20 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.279846 21766 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.294421 21766 catalog_manager.cc:5697] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 18, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 18 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.296476 21766 catalog_manager.cc:5697] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 12 to 15, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 15 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.304291 22018 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:44.306766 28676 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.329929 21866 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:44.332296 28673 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.341120 21941 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:44.356985 28675 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:44.399055 21949 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:44.403551 28672 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:44.441466 21866 raft_consensus.cc:3060] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:44.461714 21866 raft_consensus.cc:1275] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:44.466316 28451 consensus_queue.cc:1048] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:44.558396 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:44.602840 21768 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.644246 21768 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 14 to 15, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.649564 21768 catalog_manager.cc:5697] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 4 to 15. New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.720825 21766 catalog_manager.cc:5697] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 11 to 20, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 20 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.722494 21766 catalog_manager.cc:5697] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } }
I20260709 13:08:44.723850 21766 catalog_manager.cc:5697] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.730311 21766 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 17 to 18, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 18 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:44.780575 21768 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 167) took 21672 ms (client timeout 15000 ms). Trace:
W20260709 13:08:44.781003 21768 rpcz_store.cc:269] 0709 13:08:23.107904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.108171 (+   267us) service_pool.cc:224] Handling call
0709 13:08:44.780504 (+21672333us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:44.664800 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:44.665380 (+   580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:44.665423 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:08:44.665441 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:44.666065 (+   624us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:44.666125 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:44.666156 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:44.666494 (+   338us) tablet.cc:701] Row locks acquired
0709 13:08:44.666512 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:44.666670 (+   158us) write_op.cc:270] Start()
0709 13:08:44.666787 (+   117us) write_op.cc:276] Timestamp: P: 1783602524666622 usec, L: 0
0709 13:08:44.666809 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:44.667497 (+   688us) log.cc:844] Serialized 1284 byte log entry
0709 13:08:44.670774 (+  3277us) op_driver.cc:464] REPLICATION: finished
0709 13:08:44.671222 (+   448us) write_op.cc:301] APPLY: starting
0709 13:08:44.671306 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:44.673286 (+  1980us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:44.673387 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:44.675397 (+  2010us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:44.675585 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:44.675638 (+    53us) write_op.cc:312] APPLY: finished
0709 13:08:44.675876 (+   238us) log.cc:844] Serialized 41 byte log entry
0709 13:08:44.686452 (+ 10576us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.686658 (+   206us) write_op.cc:454] Released schema lock
0709 13:08:44.686711 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:44.687190 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:44.697549 (+ 10359us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":48418,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":255,"apply.run_cpu_time_us":5507,"apply.run_wall_time_us":15884,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":1479,"prepare.run_cpu_time_us":3039,"prepare.run_wall_time_us":3740,"replication_time_us":3841}]]}
W20260709 13:08:44.795820 21773 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 287) took 38786 ms (client timeout 15000 ms). Trace:
W20260709 13:08:44.800745 21773 rpcz_store.cc:269] 0709 13:08:06.033161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.039211 (+  6050us) service_pool.cc:224] Handling call
0709 13:08:44.795622 (+38756411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79543,"reported_tablets":50}
I20260709 13:08:44.928098 21770 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.946405 21770 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.960103 21770 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 14 to 15, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:44.966781 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "105015b2b463442ab34e0509af7105fb"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:44.967483 22020 raft_consensus.cc:606] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:44.971159 22604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
mode: GRACEFUL
new_leader_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:36026
I20260709 13:08:44.971863 22604 raft_consensus.cc:606] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 LEADER]: Received request to transfer leadership to TS 51e52b544fab4275aab4f7fbe81942d2
I20260709 13:08:44.972258 21770 catalog_manager.cc:5697] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:45.001945 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:45.002707 22020 raft_consensus.cc:606] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Received request to transfer leadership to TS 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:45.005560 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:45.007287 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:45.053925 21771 catalog_manager.cc:5697] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 9 to 16, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 16 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.059113 21771 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:45.078388 21771 catalog_manager.cc:5697] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 15 to 20, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 20 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.086535 22020 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:45.159363 21868 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:45.159972 21941 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:45.161520 28542 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:45.164019 28457 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:45.165351 21988 consensus_peers.cc:597] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5375c76fdd4d4624b9b6cbaa44ae40c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.194617 21771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52560 (request call id 168) took 6681 ms. Trace:
I20260709 13:08:45.197326 21770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49086 (request call id 279) took 11180 ms. Trace:
I20260709 13:08:45.199741 28676 raft_consensus.cc:993] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: : Instructing follower 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:08:45.200358 28674 raft_consensus.cc:1081] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 LEADER]: Signalling peer 51e52b544fab4275aab4f7fbe81942d2 to start an election
I20260709 13:08:45.195113 21771 rpcz_store.cc:276] 0709 13:08:38.513363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.513569 (+   206us) service_pool.cc:224] Handling call
0709 13:08:45.131776 (+6618207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.131809 (+    33us) write_op.cc:454] Released schema lock
0709 13:08:45.194520 (+ 62711us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.105727 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.106333 (+   606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.106376 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:08:45.106399 (+    23us) tablet.cc:662] Decoding operations
0709 13:08:45.106998 (+   599us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.107056 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.107088 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:45.107440 (+   352us) tablet.cc:701] Row locks acquired
0709 13:08:45.107462 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:45.107619 (+   157us) write_op.cc:270] Start()
0709 13:08:45.107734 (+   115us) write_op.cc:276] Timestamp: P: 1783602525107572 usec, L: 0
0709 13:08:45.107765 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.108459 (+   694us) log.cc:844] Serialized 1280 byte log entry
0709 13:08:45.116280 (+  7821us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.116783 (+   503us) write_op.cc:301] APPLY: starting
0709 13:08:45.116871 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.118755 (+  1884us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.118871 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.124878 (+  6007us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.125079 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:45.125133 (+    54us) write_op.cc:312] APPLY: finished
0709 13:08:45.125368 (+   235us) log.cc:844] Serialized 41 byte log entry
0709 13:08:45.126224 (+   856us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.126327 (+   103us) write_op.cc:454] Released schema lock
0709 13:08:45.126380 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":54362,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":301,"apply.run_cpu_time_us":5189,"apply.run_wall_time_us":9881,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":17320,"prepare.run_cpu_time_us":3067,"prepare.run_wall_time_us":10262,"replication_time_us":8362}]]}
I20260709 13:08:45.205513 22020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
 from {username='slave'} at 127.0.0.1:60038
I20260709 13:08:45.197755 21770 rpcz_store.cc:276] 0709 13:08:34.017378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.049917 (+ 32539us) service_pool.cc:224] Handling call
0709 13:08:45.019111 (+10969194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.019142 (+    31us) write_op.cc:454] Released schema lock
0709 13:08:45.197269 (+178127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.006204 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.006796 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.006838 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:08:45.006855 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:45.007508 (+   653us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.007574 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.007599 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:45.007988 (+   389us) tablet.cc:701] Row locks acquired
0709 13:08:45.008007 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:45.008158 (+   151us) write_op.cc:270] Start()
0709 13:08:45.008264 (+   106us) write_op.cc:276] Timestamp: P: 1783602525008111 usec, L: 0
0709 13:08:45.008279 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.008927 (+   648us) log.cc:844] Serialized 1662 byte log entry
0709 13:08:45.011105 (+  2178us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.011529 (+   424us) write_op.cc:301] APPLY: starting
0709 13:08:45.011608 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.014036 (+  2428us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.014136 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.016993 (+  2857us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.017196 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:45.017253 (+    57us) write_op.cc:312] APPLY: finished
0709 13:08:45.017537 (+   284us) log.cc:844] Serialized 49 byte log entry
0709 13:08:45.018508 (+   971us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.018637 (+   129us) write_op.cc:454] Released schema lock
0709 13:08:45.018687 (+    50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1420,"reported_tablets":50,"spinlock_wait_cycles":5376,"child_traces":[["op",{"apply.queue_time_us":239,"apply.run_cpu_time_us":6582,"apply.run_wall_time_us":7448,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16744,"num_ops":4,"prepare.queue_time_us":3551,"prepare.run_cpu_time_us":3012,"prepare.run_wall_time_us":4687,"replication_time_us":2713}]]}
I20260709 13:08:45.206071 22020 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.210307 22020 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:45.223443 22020 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:45.226931 22020 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 27 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:45.227507 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:45.227820 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:45.228001 21941 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:45.228272 22604 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:08:45.228487 22604 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:45.229305 22604 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:45.231251 22604 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:45.233902 21765 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:45.240868 21941 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 27.
I20260709 13:08:45.242259 21987 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:45.243140 22604 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 27.
I20260709 13:08:45.244555 28457 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:45.245154 28457 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 27 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:45.256521 28542 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:45.259253 21765 catalog_manager.cc:5697] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:45.265115 21950 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:45.271284 28457 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:45.285818 21868 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:45.287508 28498 raft_consensus.cc:993] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 61893f17f34b4cc9b898114d3c0a7023 to start an election
I20260709 13:08:45.288018 28498 raft_consensus.cc:1081] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Signalling peer 61893f17f34b4cc9b898114d3c0a7023 to start an election
I20260709 13:08:45.290215 21941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:54900
I20260709 13:08:45.290741 21941 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.291083 21941 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.325208 21941 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:45.337846 21941 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:45.366386 28542 raft_consensus.cc:993] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:45.366962 28542 raft_consensus.cc:1081] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:45.368739 21868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "105015b2b463442ab34e0509af7105fb"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50258
I20260709 13:08:45.369326 21868 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.369673 21868 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:45.370893 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:45.371542 22020 raft_consensus.cc:3055] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:45.371954 22020 raft_consensus.cc:740] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:45.379348 22020 consensus_queue.cc:260] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:45.381845 22020 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.387596 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:45.388387 22604 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.394873 22020 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:45.404209 22604 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 16.
I20260709 13:08:45.440810 21914 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:45.473397 28711 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:45.515323 28711 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:45.596112 21771 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 18 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:45.623646 28711 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:45.628269 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 107756us
W20260709 13:08:45.684773 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 61810.5us
W20260709 13:08:45.716544 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 66739.6us
I20260709 13:08:45.730887 21873 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:45.731667 21868 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:45.749074 22604 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 27 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:08:45.753324 21941 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 27 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:08:45.755259 28699 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:08:45.779031 21948 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:45.787473 28702 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:45.797405 22023 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:45.798185 28707 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:08:45.805819 21868 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:45.814857 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:45.815676 21948 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:45.825345 21873 raft_consensus.cc:1240] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Rejecting Update request from peer 51e52b544fab4275aab4f7fbe81942d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:45.828786 28702 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:45.832940 21839 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef15581ea60041b6a79f34c9e4dbe9c3. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:45.833685 21839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 51518.3us
I20260709 13:08:45.848858 21948 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
I20260709 13:08:45.882799 21770 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 15 to 16, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 16 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.885275 28714 consensus_queue.cc:1059] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:45.887063 28716 raft_consensus.cc:3055] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:45.887473 28716 raft_consensus.cc:740] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:45.888458 28716 consensus_queue.cc:260] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:45.890875 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:45.903328 28716 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:45.912472 28719 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:08:45.956578 21838 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:45.957984 28328 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:45.958532 28328 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:45.959533 28328 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:45.970135 28718 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:46.002707 22023 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:46.027482 22018 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:46.029547 28713 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:08:46.024430 22020 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 19.
I20260709 13:08:46.045078 28728 ts_tablet_manager.cc:933] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:46.101753 22018 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:46.109033 21941 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
W20260709 13:08:46.151868 28731 log.cc:927] Time spent T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:08:46.025226 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:46.178018 21765 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 289) took 2998 ms. Trace:
I20260709 13:08:46.183643 22604 raft_consensus.cc:1275] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:46.183790 28728 tablet_copy_client.cc:323] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:08:46.185196 28713 consensus_queue.cc:1048] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:08:46.180469 21770 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 26 to 27, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 27 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:46.189631 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:08:46.190323 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-5375c76fdd4d4624b9b6cbaa44ae40c0
I20260709 13:08:46.190922 21771 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 18 to 19, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 19 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.195772 22610 consensus_queue.cc:237] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:46.197456 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5f518749c784001a1f5106719d0b72f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.220892 22033 tablet_copy_source_session.cc:215] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:46.229676 21941 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:46.234933 21873 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:46.236738 28716 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:46.241609 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:46.251830 28705 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:08:46.256493 21941 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:46.257433 21866 raft_consensus.cc:1275] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:46.178653 21765 rpcz_store.cc:276] 0709 13:08:43.179153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.179410 (+   257us) service_pool.cc:224] Handling call
0709 13:08:46.177825 (+2998415us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.492896 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.493838 (+   942us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.493922 (+    84us) write_op.cc:435] Acquired schema lock
0709 13:08:45.493979 (+    57us) tablet.cc:662] Decoding operations
0709 13:08:45.494928 (+   949us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.495114 (+   186us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.495181 (+    67us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:45.495893 (+   712us) tablet.cc:701] Row locks acquired
0709 13:08:45.495959 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:08:45.513888 (+ 17929us) write_op.cc:270] Start()
0709 13:08:45.518165 (+  4277us) write_op.cc:276] Timestamp: P: 1783602525496171 usec, L: 0
0709 13:08:45.518212 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.521638 (+  3426us) log.cc:844] Serialized 907 byte log entry
0709 13:08:45.535702 (+ 14064us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.536578 (+   876us) write_op.cc:301] APPLY: starting
0709 13:08:45.536743 (+   165us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.539591 (+  2848us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.539746 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.569739 (+ 29993us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.570081 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:08:45.570175 (+    94us) write_op.cc:312] APPLY: finished
0709 13:08:45.570556 (+   381us) log.cc:844] Serialized 33 byte log entry
0709 13:08:45.571791 (+  1235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.571922 (+   131us) write_op.cc:454] Released schema lock
0709 13:08:45.572002 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.572518 (+   516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.572562 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39579,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":485,"apply.run_cpu_time_us":7084,"apply.run_wall_time_us":35883,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":7513,"prepare.run_cpu_time_us":5896,"prepare.run_wall_time_us":29283,"replication_time_us":17232}]]}
I20260709 13:08:46.265604 21766 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 16 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:46.258414 28676 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:08:46.283733 28704 consensus_queue.cc:1048] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:46.373471 28451 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index 6 to 11, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:46.387408 28737 ts_tablet_manager.cc:933] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039)
I20260709 13:08:46.413086 21941 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:46.417486 22023 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:46.419008 28328 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.396286 28699 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:46.426652 21947 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 6 to 11, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:46.433996 21868 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:46.444393 21873 raft_consensus.cc:2955] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 6 to 11, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:46.446273 28728 tablet_copy_client.cc:806] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:46.447315 28728 tablet_copy_client.cc:670] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:46.460742 21771 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 19 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:46.466281 21766 catalog_manager.cc:5697] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 6 to 11, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 18 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:46.476692 28728 tablet_copy_client.cc:538] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:46.482758 21941 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:46.484627 28328 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.515033 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8f404cd14ba4c2687ffe2b7637e1da7 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:46.524502 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet d8f404cd14ba4c2687ffe2b7637e1da7 with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:33566
I20260709 13:08:46.558008 28737 tablet_copy_client.cc:323] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.1:38039
I20260709 13:08:46.638708 21884 tablet_copy_service.cc:140] P 95296a4420ed41b69191d3d4353cf2b0: Received BeginTabletCopySession request for tablet ef15581ea60041b6a79f34c9e4dbe9c3 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:44780)
I20260709 13:08:46.639427 21884 tablet_copy_service.cc:161] P 95296a4420ed41b69191d3d4353cf2b0: Beginning new tablet copy session on tablet ef15581ea60041b6a79f34c9e4dbe9c3 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:44780: session id = bcc802f7bc374bed98e2ee0596a8ebda-ef15581ea60041b6a79f34c9e4dbe9c3
W20260709 13:08:46.655467 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 112815us
I20260709 13:08:46.681751 21884 tablet_copy_source_session.cc:215] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:46.705024 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 136693us
I20260709 13:08:46.714583 28755 tablet_replica.cc:333] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:08:46.716073 28755 raft_consensus.cc:2243] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:46.724262 28737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef15581ea60041b6a79f34c9e4dbe9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:46.734211 28755 raft_consensus.cc:2272] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:46.747329 28728 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:08:46.764559 28755 ts_tablet_manager.cc:1916] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:46.832273 21947 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:46.870167 22018 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:46.882696 28600 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:46.896553 21866 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:46.865691 28755 ts_tablet_manager.cc:1929] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.10
I20260709 13:08:46.924515 28755 log.cc:1199] T d8f404cd14ba4c2687ffe2b7637e1da7 P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/d8f404cd14ba4c2687ffe2b7637e1da7
W20260709 13:08:46.972054 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 75021.1us
W20260709 13:08:46.972879 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9fc717cf49c47969c86d6c23778f56c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:46.987584 28713 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:46.994027 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 412357us
I20260709 13:08:46.999495 28737 tablet_copy_client.cc:806] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:46.999526 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet d8f404cd14ba4c2687ffe2b7637e1da7 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:08:47.002957 28737 tablet_copy_client.cc:670] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:47.042656 28737 tablet_copy_client.cc:538] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:47.081363 22020 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:47.075309 28712 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:47.116245 28737 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:08:47.118763 28771 ts_tablet_manager.cc:933] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:47.124054 21866 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:47.181026 28771 tablet_copy_client.cc:323] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:08:47.182772 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet f5f518749c784001a1f5106719d0b72f from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:08:47.183398 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet f5f518749c784001a1f5106719d0b72f from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-f5f518749c784001a1f5106719d0b72f
I20260709 13:08:47.195546 22033 tablet_copy_source_session.cc:215] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:47.204581 28771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f518749c784001a1f5106719d0b72f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:47.204277 21765 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 12, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 18 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:47.246620 28771 tablet_copy_client.cc:806] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:47.247984 28771 tablet_copy_client.cc:670] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:47.267110 28771 tablet_copy_client.cc:538] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:47.278792 28737 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.279831 28737 tablet_bootstrap.cc:492] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:08:47.280939 28737 ts_tablet_manager.cc:1403] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.165s	user 0.032s	sys 0.020s
I20260709 13:08:47.288177 28737 raft_consensus.cc:359] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:47.289384 28737 raft_consensus.cc:740] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:08:47.290112 28737 consensus_queue.cc:260] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:47.317601 28737 ts_tablet_manager.cc:1434] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:08:47.320106 21884 tablet_copy_service.cc:342] P 95296a4420ed41b69191d3d4353cf2b0: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-ef15581ea60041b6a79f34c9e4dbe9c3 received from {username='slave'} at 127.0.0.1:44780
I20260709 13:08:47.320634 21884 tablet_copy_service.cc:434] P 95296a4420ed41b69191d3d4353cf2b0: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-ef15581ea60041b6a79f34c9e4dbe9c3 on tablet ef15581ea60041b6a79f34c9e4dbe9c3 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:47.310611 28728 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.345752 28728 tablet_bootstrap.cc:492] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:08:47.346570 28728 ts_tablet_manager.cc:1403] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.600s	user 0.050s	sys 0.045s
I20260709 13:08:47.368148 28728 raft_consensus.cc:359] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:47.376242 28728 raft_consensus.cc:740] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:08:47.377015 28728 consensus_queue.cc:260] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:47.383987 28728 ts_tablet_manager.cc:1434] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:08:47.386482 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-5375c76fdd4d4624b9b6cbaa44ae40c0 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:08:47.386977 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-5375c76fdd4d4624b9b6cbaa44ae40c0 on tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:47.409785 28771 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:08:47.488279 28728 ts_tablet_manager.cc:933] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:47.535584 28728 tablet_copy_client.cc:323] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:08:47.558524 21959 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet f9fc717cf49c47969c86d6c23778f56c from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:08:47.559209 21959 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet f9fc717cf49c47969c86d6c23778f56c from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-f9fc717cf49c47969c86d6c23778f56c
I20260709 13:08:47.590152 21959 tablet_copy_source_session.cc:215] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:47.598050 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:47.616321 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9fc717cf49c47969c86d6c23778f56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:47.697037 22610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "130319e952f14561b08ef212107e1666"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:36026
I20260709 13:08:47.697831 22610 raft_consensus.cc:606] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:47.701349 22020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad"
dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
mode: GRACEFUL
new_leader_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:08:47.701726 28728 tablet_copy_client.cc:806] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:47.701929 22020 raft_consensus.cc:606] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 27 LEADER]: Received request to transfer leadership to TS 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:47.702327 28728 tablet_copy_client.cc:670] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:47.709120 22610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b83eb73076f949419556cb7ef3746784"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:36026
I20260709 13:08:47.709765 28771 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.709789 22610 raft_consensus.cc:606] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:47.712854 22610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103"
dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:36026
I20260709 13:08:47.713510 22610 raft_consensus.cc:606] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:47.715309 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:47.717103 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:47.720024 28771 tablet_bootstrap.cc:492] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:08:47.720937 28771 ts_tablet_manager.cc:1403] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.311s	user 0.044s	sys 0.015s
I20260709 13:08:47.725584 22610 raft_consensus.cc:1217] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:08:47.726677 28771 raft_consensus.cc:359] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:47.727593 28771 raft_consensus.cc:740] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:08:47.732422 28728 tablet_copy_client.cc:538] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:47.742455 28728 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:08:47.750862 28760 raft_consensus.cc:993] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: : Instructing follower 61893f17f34b4cc9b898114d3c0a7023 to start an election
I20260709 13:08:47.751458 28760 raft_consensus.cc:1081] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 27 LEADER]: Signalling peer 61893f17f34b4cc9b898114d3c0a7023 to start an election
I20260709 13:08:47.728272 28771 consensus_queue.cc:260] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:47.756132 28771 ts_tablet_manager.cc:1434] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:08:47.762401 21950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
 from {username='slave'} at 127.0.0.1:54900
I20260709 13:08:47.763243 21950 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.763621 21950 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:47.764012 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-f5f518749c784001a1f5106719d0b72f received from {username='slave'} at 127.0.0.1:60038
I20260709 13:08:47.764503 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-f5f518749c784001a1f5106719d0b72f on tablet f5f518749c784001a1f5106719d0b72f with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:47.809942 21950 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:47.813994 21950 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 28 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:47.814674 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:47.815299 22020 raft_consensus.cc:3055] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:08:47.815614 22020 raft_consensus.cc:740] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:47.816473 22020 consensus_queue.cc:260] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:47.817385 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:47.817968 22610 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:47.818116 22020 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:47.825081 22610 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 28.
I20260709 13:08:47.838933 21914 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:47.847548 22610 raft_consensus.cc:1217] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:08:47.848294 22020 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 28.
I20260709 13:08:47.851271 28711 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:08:47.860260 28742 raft_consensus.cc:993] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:47.860831 28742 raft_consensus.cc:1081] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:47.862792 21873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b83eb73076f949419556cb7ef3746784"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:44780
I20260709 13:08:47.863324 21873 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.863667 21873 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.864816 28711 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 28 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:47.865798 28711 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:47.872524 28728 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:47.873329 22604 raft_consensus.cc:1217] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:08:47.875348 28728 tablet_bootstrap.cc:492] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:08:47.876157 28728 ts_tablet_manager.cc:1403] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.134s	user 0.036s	sys 0.036s
I20260709 13:08:47.894191 28759 raft_consensus.cc:993] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:47.894796 28759 raft_consensus.cc:1081] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:47.903328 21868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "130319e952f14561b08ef212107e1666"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:44780
I20260709 13:08:47.903941 21868 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.904289 21868 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:47.914064 28728 raft_consensus.cc:359] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:47.915035 28728 raft_consensus.cc:740] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:08:47.915768 28728 consensus_queue.cc:260] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:47.918586 28728 ts_tablet_manager.cc:1434] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:08:47.923908 28747 raft_consensus.cc:993] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:47.924424 28742 raft_consensus.cc:1081] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:47.926473 21875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:44780
I20260709 13:08:47.926983 21875 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.927327 21875 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.932484 21959 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-f9fc717cf49c47969c86d6c23778f56c received from {username='slave'} at 127.0.0.1:35490
I20260709 13:08:47.933131 21959 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-f9fc717cf49c47969c86d6c23778f56c on tablet f9fc717cf49c47969c86d6c23778f56c with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:47.957057 21868 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:47.958223 21875 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:47.961910 21873 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:47.964262 21873 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:47.966624 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:48.018330 22604 raft_consensus.cc:3055] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:48.018775 22604 raft_consensus.cc:740] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:48.019812 22604 consensus_queue.cc:260] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:47.971371 21868 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Requested vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:47.971998 22610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:48.021605 22610 raft_consensus.cc:3055] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:48.021930 22610 raft_consensus.cc:740] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:48.022652 22610 consensus_queue.cc:260] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:48.024024 22610 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:47.972976 21875 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:47.973249 22605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:48.025739 22605 raft_consensus.cc:3055] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:48.026027 22605 raft_consensus.cc:740] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:48.026821 22605 consensus_queue.cc:260] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:48.028071 22605 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.982364 22018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:48.032225 22018 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:48.031417 21766 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 27 to 28, leader changed from 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 28 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.988413 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:48.032984 22020 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.969643 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:48.036969 21941 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:48.021164 22604 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:48.083446 22020 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:48.091177 21941 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:48.098449 22604 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 14.
I20260709 13:08:48.118815 21839 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:48.103690 22605 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:48.110157 22018 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 20.
I20260709 13:08:48.121534 21841 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:48.112957 22610 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 20.
W20260709 13:08:48.114917 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 121141us
I20260709 13:08:48.120146 28756 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:48.122718 28762 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:48.124693 28762 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:48.125723 28762 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:48.124079 28756 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:48.129877 21838 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:48.129719 28756 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:48.130889 28702 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:48.135664 22610 raft_consensus.cc:1217] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:08:48.208865 28702 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:48.216882 28702 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:48.214277 21771 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 13 to 14, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 14 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.275858 22018 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 28 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 13:08:48.278045 28711 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.002s
I20260709 13:08:48.304715 28753 raft_consensus.cc:1064] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:08:48.315485 28787 raft_consensus.cc:1064] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:08:48.307950 28753 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:48.318553 28787 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:48.335139 22610 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 28 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 13:08:48.336915 28781 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 13:08:48.344028 22605 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:48.344017 21941 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:48.345772 28699 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:48.346781 28758 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:48.379024 21875 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:48.389560 21771 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 19 to 20, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 20 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.390910 21771 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 16 to 17, leader changed from bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 17 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.400260 28753 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:48.455137 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 99462.8us
I20260709 13:08:48.457026 22601 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEARNER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:48.466120 28787 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:48.470181 21950 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:48.476402 28787 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:08:48.524284 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 57684.1us
W20260709 13:08:48.524251 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47431.6us
I20260709 13:08:48.593775 28807 raft_consensus.cc:1064] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:08:48.565893 28799 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:48.606350 28807 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:48.614365 22020 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:48.618250 28702 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:48.659000 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 183465us
W20260709 13:08:48.676141 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 148589us
I20260709 13:08:48.685115 22023 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:48.711934 28756 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:48.718127 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:48.763533 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 79339.5us
I20260709 13:08:48.774398 21950 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:48.825217 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 72038.3us
W20260709 13:08:48.833247 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 122962us
W20260709 13:08:48.833714 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 63881.4us
I20260709 13:08:48.768775 22601 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:48.877557 21873 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:48.851542 28784 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:48.900466 22023 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:48.904706 22018 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:48.928285 28756 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:49.004355 22605 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:49.015168 22604 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:49.020184 22610 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:49.071182 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 130659us
I20260709 13:08:49.062584 28812 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:08:49.057530 28702 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 13:08:49.139040 28817 log.cc:927] Time spent T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:08:49.155437 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 96246.1us
I20260709 13:08:49.178401 21947 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:49.180393 28835 raft_consensus.cc:1064] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:08:49.182168 21947 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:49.189781 21915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.221073 22601 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:49.215680 21765 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.226009 28826 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:49.229982 28835 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:49.240912 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 57811.9us
I20260709 13:08:49.268332 28829 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:49.269999 21941 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:08:49.251005 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 77623.4us
I20260709 13:08:49.323119 21869 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:49.325416 22606 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:49.348272 28794 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
W20260709 13:08:49.456367 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 76847.8us
W20260709 13:08:49.475332 28846 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:08:49.475453 22576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 51933.2us
W20260709 13:08:49.597294 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 316062us
W20260709 13:08:49.610515 21913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.713991 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48640.3us
W20260709 13:08:49.715658 28846 log.cc:927] Time spent T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:49.656968 28758 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
W20260709 13:08:49.756825 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 93931.5us
I20260709 13:08:49.791800 28787 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:49.792354 28787 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:49.794869 28787 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:49.868404 21765 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49096 (request call id 297) took 1049 ms. Trace:
I20260709 13:08:49.869520 21765 rpcz_store.cc:276] 0709 13:08:48.818560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.833489 (+ 14929us) service_pool.cc:224] Handling call
0709 13:08:48.933181 (+ 99692us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b540033ccd4. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdc090 00007f635607af3a 00007f635be311cc 00007f635bf2f37e 00007f635a3f02a4 00007f635a3f0232 00007f635a3f0161 00007f635a3f00dc 00007f635a3ef392 00007f63543ad48c 00007f63543ac8c6
0709 13:08:49.868340 (+935159us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:49.484010 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.501381 (+ 17371us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.501431 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:08:49.501458 (+    27us) tablet.cc:662] Decoding operations
0709 13:08:49.501893 (+   435us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.501976 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.502023 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:49.502259 (+   236us) tablet.cc:701] Row locks acquired
0709 13:08:49.502284 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:08:49.502473 (+   189us) write_op.cc:270] Start()
0709 13:08:49.530252 (+ 27779us) write_op.cc:276] Timestamp: P: 1783602529502416 usec, L: 0
0709 13:08:49.530278 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.531045 (+   767us) log.cc:844] Serialized 591 byte log entry
0709 13:08:49.765706 (+234661us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.848864 (+ 83158us) write_op.cc:301] APPLY: starting
0709 13:08:49.848996 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.850510 (+  1514us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.850648 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.851617 (+   969us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.851891 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:49.851967 (+    76us) write_op.cc:312] APPLY: finished
0709 13:08:49.852245 (+   278us) log.cc:844] Serialized 25 byte log entry
0709 13:08:49.853069 (+   824us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.853164 (+    95us) write_op.cc:454] Released schema lock
0709 13:08:49.853206 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:49.869129 (+ 15923us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.869159 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":52073728,"child_traces":[["op",{"apply.queue_time_us":82873,"apply.run_cpu_time_us":4188,"apply.run_wall_time_us":20212,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":217976,"prepare.run_cpu_time_us":10827,"prepare.run_wall_time_us":126461,"raft.queue_time_us":159532,"replication_time_us":235272,"thread_start_us":439808,"threads_started":4,"wal-append.queue_time_us":70412}]]}
W20260709 13:08:49.874774 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 127333us
W20260709 13:08:49.903573 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 145820us
I20260709 13:08:49.915285 22015 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:49.916069 22016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:49.927676 22601 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:49.933086 28815 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:49.937458 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:49.974455 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.976868 28713 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:49.986639 22019 consensus_queue.cc:237] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:50.014957 21869 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:50.036705 21765 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.040292 28866 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:50.064419 21838 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:50.068734 28762 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:50.089502 28866 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:50.167150 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 65360.7us
W20260709 13:08:50.169430 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 65832.9us
W20260709 13:08:50.226154 28878 log.cc:927] Time spent T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:08:50.238323 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 66240.3us
I20260709 13:08:50.233534 28713 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:50.261423 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 61075.6us
I20260709 13:08:50.269979 22601 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:50.286423 28807 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.302793 22601 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.323423 28806 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:08:50.353049 21869 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.367627 21873 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.366293 22022 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.442545 21869 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:50.455991 21949 raft_consensus.cc:1275] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:50.459554 28753 consensus_queue.cc:1048] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:50.498056 22607 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.527045 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d"
dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
mode: GRACEFUL
new_leader_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:48038
I20260709 13:08:50.527951 21949 raft_consensus.cc:606] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Received request to transfer leadership to TS 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:50.530740 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:50.532471 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:50.533254 22601 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.530777 28753 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.549074 21766 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.562109 22607 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:50.567261 28812 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:08:50.581775 21770 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 12 to 13, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.590488 21941 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:50.593053 28809 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:50.596668 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:50.598363 21949 raft_consensus.cc:2955] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.607151 21941 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.631330 28868 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.638053 22607 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.645301 21947 raft_consensus.cc:2955] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.666662 21758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef15581ea60041b6a79f34c9e4dbe9c3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:50.696420 21758 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet ef15581ea60041b6a79f34c9e4dbe9c3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 13 but the committed config has opid_index of 14
I20260709 13:08:50.709018 21773 catalog_manager.cc:5697] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 13 to 14, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 18 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.711243 22022 consensus_queue.cc:237] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:50.717168 21773 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 13 to 14, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 16 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:50.778344 22607 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:50.787177 21873 raft_consensus.cc:1275] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:50.800086 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet ef15581ea60041b6a79f34c9e4dbe9c3 with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:33566
I20260709 13:08:50.800971 21863 tablet_service.cc:1558] Processing DeleteTablet for tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 with delete_type TABLET_DATA_TOMBSTONED (TS 95296a4420ed41b69191d3d4353cf2b0 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:59884
I20260709 13:08:50.825448 28865 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:50.855697 28865 consensus_queue.cc:1048] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 13:08:50.877540 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 49134us
I20260709 13:08:51.048143 28895 tablet_replica.cc:333] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:08:51.049324 28895 raft_consensus.cc:2243] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.050349 28895 raft_consensus.cc:2272] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:51.070216 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 71372.5us
I20260709 13:08:51.120641 28896 tablet_replica.cc:333] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:51.183538 28895 ts_tablet_manager.cc:1916] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:51.201285 28900 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:51.220682 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 257449us
I20260709 13:08:51.258323 28896 raft_consensus.cc:2243] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.259662 28896 raft_consensus.cc:2272] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.266193 28896 ts_tablet_manager.cc:1916] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:51.294782 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 248317us
I20260709 13:08:51.307168 21869 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:51.322134 22607 raft_consensus.cc:2955] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:51.334561 21947 consensus_queue.cc:237] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:51.357758 21766 catalog_manager.cc:5697] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index 12 to 13, VOTER 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) evicted. New cstate: current_term: 19 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:51.364349 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5f518749c784001a1f5106719d0b72f with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:51.365195 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 226331us
I20260709 13:08:51.398721 22607 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:51.403450 21869 raft_consensus.cc:1275] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:51.405364 28895 ts_tablet_manager.cc:1929] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 13:08:51.405861 28895 log.cc:1199] T ef15581ea60041b6a79f34c9e4dbe9c3 P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/ef15581ea60041b6a79f34c9e4dbe9c3
I20260709 13:08:51.409855 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet ef15581ea60041b6a79f34c9e4dbe9c3 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:08:51.414479 28896 ts_tablet_manager.cc:1929] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:08:51.414990 28896 log.cc:1199] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 95296a4420ed41b69191d3d4353cf2b0: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/wals/5375c76fdd4d4624b9b6cbaa44ae40c0
I20260709 13:08:51.435823 28781 raft_consensus.cc:993] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: : Instructing follower 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:51.436368 28781 raft_consensus.cc:1081] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Signalling peer 95296a4420ed41b69191d3d4353cf2b0 to start an election
I20260709 13:08:51.441663 28781 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:51.444729 21758 catalog_manager.cc:5028] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): tablet 5375c76fdd4d4624b9b6cbaa44ae40c0 (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:08:51.450426 21869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d"
dest_uuid: "95296a4420ed41b69191d3d4353cf2b0"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:08:51.451066 21869 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:51.451426 21869 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.451858 28781 consensus_queue.cc:1048] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:51.463398 21869 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:51.474807 28827 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:51.484725 21869 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:51.486066 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:51.486748 22015 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.488452 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:51.489158 21942 raft_consensus.cc:3055] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:51.489497 21942 raft_consensus.cc:740] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:51.490350 21942 consensus_queue.cc:260] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:51.491593 21942 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:51.500622 22607 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:51.503389 21942 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:51.524219 22015 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95296a4420ed41b69191d3d4353cf2b0 in term 17.
I20260709 13:08:51.525765 21841 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0; no voters: 
I20260709 13:08:51.529996 28919 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:51.530927 28919 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Becoming Leader. State: Replica: 95296a4420ed41b69191d3d4353cf2b0, State: Running, Role: LEADER
I20260709 13:08:51.531929 28919 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:51.536095 21875 raft_consensus.cc:2955] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:51.541019 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9fc717cf49c47969c86d6c23778f56c with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:51.555573 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:51.555894 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 55580.8us
I20260709 13:08:51.581081 21773 catalog_manager.cc:5697] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 13 to 14, VOTER 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3) evicted. New cstate: current_term: 18 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.604162 21931 tablet_service.cc:1558] Processing DeleteTablet for tablet f5f518749c784001a1f5106719d0b72f with delete_type TABLET_DATA_TOMBSTONED (TS 61893f17f34b4cc9b898114d3c0a7023 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38956
I20260709 13:08:51.650640 28925 tablet_replica.cc:333] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:08:51.651780 28925 raft_consensus.cc:2243] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.652894 28925 raft_consensus.cc:2272] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.668329 21765 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: term changed from 16 to 17, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1). New cstate: current_term: 17 leader_uuid: "95296a4420ed41b69191d3d4353cf2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.674966 22009 tablet_service.cc:1558] Processing DeleteTablet for tablet f9fc717cf49c47969c86d6c23778f56c with delete_type TABLET_DATA_TOMBSTONED (TS 51e52b544fab4275aab4f7fbe81942d2 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:33566
I20260709 13:08:51.691843 28895 tablet_replica.cc:333] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:08:51.725092 28925 ts_tablet_manager.cc:1916] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:51.734371 28895 raft_consensus.cc:2243] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.735513 28895 raft_consensus.cc:2272] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:51.739132 28895 ts_tablet_manager.cc:1916] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:51.755577 28925 ts_tablet_manager.cc:1929] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.12
I20260709 13:08:51.756245 28925 log.cc:1199] T f5f518749c784001a1f5106719d0b72f P 61893f17f34b4cc9b898114d3c0a7023: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/wals/f5f518749c784001a1f5106719d0b72f
I20260709 13:08:51.758348 21757 catalog_manager.cc:5028] TS 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): tablet f5f518749c784001a1f5106719d0b72f (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:08:51.928145 28895 ts_tablet_manager.cc:1929] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:08:51.928721 28895 log.cc:1199] T f9fc717cf49c47969c86d6c23778f56c P 51e52b544fab4275aab4f7fbe81942d2: Deleting WAL directory at /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/wals/f9fc717cf49c47969c86d6c23778f56c
I20260709 13:08:51.936856 21760 catalog_manager.cc:5028] TS 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): tablet f9fc717cf49c47969c86d6c23778f56c (table test-workload [id=1dcf9b53296142e9872b66d7539d2a36]) successfully deleted
I20260709 13:08:52.041452 21948 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:52.042932 28809 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:52.098892 22015 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Refusing update from remote peer 95296a4420ed41b69191d3d4353cf2b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:52.100416 28910 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:52.706696 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:52.966815 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:08:52.979470 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:53.040931 21942 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:53.061817 22017 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:53.063958 28827 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:53.065924 21868 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:53.068470 28827 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:53.073927 21914 consensus_peers.cc:597] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20e7b7ab39a74ba88aa5a6259c522f73. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.105355 28931 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.107210 22017 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.121554 21868 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.131392 22015 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:53.140241 21765 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.159502 21942 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:53.160173 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca34a4d332f1434f8089d28952415e70. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.160192 21868 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:53.161163 28900 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:53.167604 28816 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:53.189646 28816 raft_consensus.cc:2955] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.197829 21875 raft_consensus.cc:2955] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.222124 22015 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:53.255092 21948 raft_consensus.cc:2955] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.267392 21942 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:53.271064 28932 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:53.275040 21988 consensus_peers.cc:597] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54fabc2ab3354c0ab4e0d3f4670eb221. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.277961 21773 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 11, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 15 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.282599 21875 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:53.288389 28816 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:53.350427 28900 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.363178 21948 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.375965 21868 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index -1 to 13, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.401638 21771 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 reported cstate change: config changed from index -1 to 13, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 16 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.411629 21948 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:08:53.424197 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 62659us
W20260709 13:08:53.498615 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571): Couldn't send request to peer bcc802f7bc374bed98e2ee0596a8ebda. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2e697f6ebda4eec99aeb32b72b9bfa4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.501513 22017 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:53.502954 21868 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:53.504386 28827 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:53.515781 28854 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:53.534874 28954 ts_tablet_manager.cc:933] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:53.561631 28954 tablet_copy_client.cc:323] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:08:53.563526 21959 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet 20e7b7ab39a74ba88aa5a6259c522f73 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:08:53.564189 21959 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet 20e7b7ab39a74ba88aa5a6259c522f73 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-20e7b7ab39a74ba88aa5a6259c522f73
I20260709 13:08:53.573288 21959 tablet_copy_source_session.cc:215] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:53.577338 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e7b7ab39a74ba88aa5a6259c522f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.577852 21875 raft_consensus.cc:2955] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.589680 22017 raft_consensus.cc:2955] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.606447 28954 tablet_copy_client.cc:806] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:53.607234 28954 tablet_copy_client.cc:670] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:53.572027 28931 raft_consensus.cc:2955] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.647982 21765 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index -1 to 13, NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) added. New cstate: current_term: 18 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } } }
I20260709 13:08:53.673547 28958 ts_tablet_manager.cc:933] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:53.675781 28954 tablet_copy_client.cc:538] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:53.701228 28959 ts_tablet_manager.cc:933] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:53.774021 28954 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:08:53.756793 28958 tablet_copy_client.cc:323] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:08:53.799196 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet ca34a4d332f1434f8089d28952415e70 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:08:53.799840 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet ca34a4d332f1434f8089d28952415e70 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-ca34a4d332f1434f8089d28952415e70
I20260709 13:08:53.832152 22033 tablet_copy_source_session.cc:215] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:53.835978 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca34a4d332f1434f8089d28952415e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.859712 28959 tablet_copy_client.cc:323] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.3:35687
I20260709 13:08:53.873522 22033 tablet_copy_service.cc:140] P 51e52b544fab4275aab4f7fbe81942d2: Received BeginTabletCopySession request for tablet 54fabc2ab3354c0ab4e0d3f4670eb221 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:60038)
I20260709 13:08:53.874670 22033 tablet_copy_service.cc:161] P 51e52b544fab4275aab4f7fbe81942d2: Beginning new tablet copy session on tablet 54fabc2ab3354c0ab4e0d3f4670eb221 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:60038: session id = bcc802f7bc374bed98e2ee0596a8ebda-54fabc2ab3354c0ab4e0d3f4670eb221
I20260709 13:08:53.898015 28958 tablet_copy_client.cc:806] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:53.898731 28958 tablet_copy_client.cc:670] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
W20260709 13:08:53.903391 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 57176.1us
I20260709 13:08:53.910915 22033 tablet_copy_source_session.cc:215] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:53.920200 28958 tablet_copy_client.cc:538] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:53.930171 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54fabc2ab3354c0ab4e0d3f4670eb221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:53.951038 28958 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:08:53.980702 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.012382 28954 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:54.016810 28954 tablet_bootstrap.cc:492] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:08:54.017620 28954 ts_tablet_manager.cc:1403] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.244s	user 0.041s	sys 0.014s
I20260709 13:08:54.022197 28954 raft_consensus.cc:359] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:54.023082 28954 raft_consensus.cc:740] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:08:54.027294 28954 consensus_queue.cc:260] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:54.039649 28954 ts_tablet_manager.cc:1434] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:08:54.041983 21959 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-20e7b7ab39a74ba88aa5a6259c522f73 received from {username='slave'} at 127.0.0.1:35490
I20260709 13:08:54.042526 21959 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-20e7b7ab39a74ba88aa5a6259c522f73 on tablet 20e7b7ab39a74ba88aa5a6259c522f73 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:54.054046 28968 ts_tablet_manager.cc:933] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: Initiating tablet copy from peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:54.060492 28959 tablet_copy_client.cc:806] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:54.061252 28959 tablet_copy_client.cc:670] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:54.078830 28959 tablet_copy_client.cc:538] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:54.093927 22601 raft_consensus.cc:1217] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:08:54.128690 28959 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
I20260709 13:08:54.214047 28958 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:54.223663 28958 tablet_bootstrap.cc:492] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:08:54.224632 28958 ts_tablet_manager.cc:1403] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.274s	user 0.037s	sys 0.014s
I20260709 13:08:54.251870 28968 tablet_copy_client.cc:323] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Beginning tablet copy session from remote peer at address 127.20.69.2:44983
I20260709 13:08:54.262430 21959 tablet_copy_service.cc:140] P 61893f17f34b4cc9b898114d3c0a7023: Received BeginTabletCopySession request for tablet a2e697f6ebda4eec99aeb32b72b9bfa4 from peer bcc802f7bc374bed98e2ee0596a8ebda ({username='slave'} at 127.0.0.1:35490)
I20260709 13:08:54.263093 21959 tablet_copy_service.cc:161] P 61893f17f34b4cc9b898114d3c0a7023: Beginning new tablet copy session on tablet a2e697f6ebda4eec99aeb32b72b9bfa4 from peer bcc802f7bc374bed98e2ee0596a8ebda at {username='slave'} at 127.0.0.1:35490: session id = bcc802f7bc374bed98e2ee0596a8ebda-a2e697f6ebda4eec99aeb32b72b9bfa4
I20260709 13:08:54.272069 21959 tablet_copy_source_session.cc:215] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:54.281153 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e697f6ebda4eec99aeb32b72b9bfa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:54.282603 28958 raft_consensus.cc:359] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:54.283638 28958 raft_consensus.cc:740] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:08:54.284456 28958 consensus_queue.cc:260] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:54.308878 20756 tablet_server.cc:179] TabletServer@127.20.69.1:0 shutting down...
I20260709 13:08:54.309374 28958 ts_tablet_manager.cc:1434] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
W20260709 13:08:54.335464 22574 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:54.340541 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-ca34a4d332f1434f8089d28952415e70 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:08:54.341117 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-ca34a4d332f1434f8089d28952415e70 on tablet ca34a4d332f1434f8089d28952415e70 with peer bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:54.393805 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 52151.4us
W20260709 13:08:54.397846 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.409788 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.435096 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.459964 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.460283 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.462800 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.466058 21988 consensus_peers.cc:597] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.483691 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.489464 28968 tablet_copy_client.cc:806] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:54.490248 28968 tablet_copy_client.cc:670] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Starting download of 1 WAL segments...
W20260709 13:08:54.500937 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.502089 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.502698 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.499399 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.506379 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.519268 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.518232 28968 tablet_copy_client.cc:538] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:54.530511 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.531291 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.529533 21914 consensus_peers.cc:597] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.534466 21914 consensus_peers.cc:597] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.535269 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.535895 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.538249 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.550174 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.561775 28959 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:54.563046 28959 tablet_bootstrap.cc:492] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:08:54.563949 28959 ts_tablet_manager.cc:1403] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.436s	user 0.046s	sys 0.020s
W20260709 13:08:54.577481 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.578240 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.587553 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.600191 28968 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap starting.
W20260709 13:08:54.619248 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.603252 28959 raft_consensus.cc:359] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
W20260709 13:08:54.622979 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.626055 21914 consensus_peers.cc:597] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.627178 28959 raft_consensus.cc:740] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
W20260709 13:08:54.632232 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.646140 28959 consensus_queue.cc:260] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:54.686116 28959 ts_tablet_manager.cc:1434] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.002s
I20260709 13:08:54.703800 22033 tablet_copy_service.cc:342] P 51e52b544fab4275aab4f7fbe81942d2: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-54fabc2ab3354c0ab4e0d3f4670eb221 received from {username='slave'} at 127.0.0.1:60038
I20260709 13:08:54.704336 22033 tablet_copy_service.cc:434] P 51e52b544fab4275aab4f7fbe81942d2: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-54fabc2ab3354c0ab4e0d3f4670eb221 on tablet 54fabc2ab3354c0ab4e0d3f4670eb221 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:54.725364 28963 raft_consensus.cc:1064] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
W20260709 13:08:54.744910 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:54.751497 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.760869 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:08:54.759505 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.762068 20756 tablet_replica.cc:333] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
W20260709 13:08:54.763159 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.770000 20756 raft_consensus.cc:2243] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.772068 20756 raft_consensus.cc:2272] T e8f816617b58480bad6550570b514d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.789664 20756 tablet_replica.cc:333] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:54.793678 20756 raft_consensus.cc:2243] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.800668 20756 raft_consensus.cc:2272] T ef15581ea60041b6a79f34c9e4dbe9c3 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.807614 20756 tablet_replica.cc:333] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:54.821471 22607 raft_consensus.cc:1217] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:08:54.841970 28963 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:54.844818 20756 raft_consensus.cc:2243] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.845587 20756 raft_consensus.cc:2272] T 23093b4e74d34b3d87ab577135fa1517 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.848558 20756 tablet_replica.cc:333] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
W20260709 13:08:54.872247 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.872799 20756 raft_consensus.cc:2243] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.873485 20756 raft_consensus.cc:2272] T 2af20d42858245eb986768009de88379 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.901420 20756 tablet_replica.cc:333] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:54.905004 20756 raft_consensus.cc:2243] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:54.957823 20756 raft_consensus.cc:2272] T 105015b2b463442ab34e0509af7105fb P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:54.976454 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.995038 22023 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:54.997045 28977 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:55.000298 22607 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:55.043963 22607 raft_consensus.cc:1217] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEARNER]: Deduplicated request from leader. Original: 16.12->[16.13-16.13]   Dedup: 16.13->[]
I20260709 13:08:55.018739 28977 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:08:55.061395 20756 tablet_replica.cc:333] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.062397 20756 raft_consensus.cc:2243] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.063107 20756 raft_consensus.cc:2272] T 5d092f1c41e747e194d93526c0fad944 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:55.084033 21914 consensus_peers.cc:597] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.084630 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 68730.1us
I20260709 13:08:55.172969 20756 tablet_replica.cc:333] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.174098 20756 raft_consensus.cc:2243] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.174990 20756 raft_consensus.cc:2272] T 7685d376b61d438aa76f16fe47a7846d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.183511 20756 tablet_replica.cc:333] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
W20260709 13:08:55.201841 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 126295us
I20260709 13:08:55.220794 28827 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:55.229605 20756 raft_consensus.cc:2243] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.230592 20756 raft_consensus.cc:2272] T ca34a4d332f1434f8089d28952415e70 P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.206866 28934 raft_consensus.cc:493] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:55.235172 28934 raft_consensus.cc:515] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.237514 28934 leader_election.cc:290] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.243980 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.243980 22607 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:55.268790 20756 tablet_replica.cc:333] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.269850 20756 raft_consensus.cc:2243] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.270476 20756 raft_consensus.cc:2272] T 535d3d7bb32243b6b555376404412d8c P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.272187 28968 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:55.280575 28971 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:55.280879 28934 raft_consensus.cc:493] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:55.281311 28971 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.281469 28934 raft_consensus.cc:515] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.283818 28971 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.294359 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.302913 28972 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:55.303526 28972 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.285909 28934 leader_election.cc:290] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.305828 28972 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.287537 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.309156 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.314643 28972 raft_consensus.cc:493] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:55.315377 28972 raft_consensus.cc:515] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.303566 21771 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:55.319741 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.320478 28972 leader_election.cc:290] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.320995 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f11dd69f214cd6b7b169181c1a910b" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.322561 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65033a7eefd242a796408c7d54fed332" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.321195 28934 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:55.322221 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a809fa455ae4f1e908dd7d0f1f2ee8f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.323802 28934 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:55.331077 28968 tablet_bootstrap.cc:492] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: Bootstrap complete.
I20260709 13:08:55.330875 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.331988 28968 ts_tablet_manager.cc:1403] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent bootstrapping tablet: real 0.735s	user 0.077s	sys 0.033s
I20260709 13:08:55.332623 28934 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.334172 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3fd785266e045ce9ae6bb7160866b9d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.335697 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.339805 28968 raft_consensus.cc:359] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:55.341338 21838 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:55.349812 28968 raft_consensus.cc:740] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Initialized, Role: LEARNER
I20260709 13:08:55.350313 28934 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:55.350891 21838 leader_election.cc:304] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:55.352314 28972 raft_consensus.cc:2749] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:55.321235 20756 tablet_replica.cc:333] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.357015 20756 raft_consensus.cc:2243] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.358171 20756 raft_consensus.cc:2272] T 761d07666b514c36bcf7826ed77f8d8b P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.358598 28984 raft_consensus.cc:1064] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:08:55.361380 28984 consensus_queue.cc:237] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.362674 20756 tablet_replica.cc:333] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.363648 20756 raft_consensus.cc:2243] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.369966 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.370513 21841 leader_election.cc:304] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:55.372023 21841 leader_election.cc:304] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:55.372231 28972 raft_consensus.cc:2749] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:55.373833 21841 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:55.373853 28972 raft_consensus.cc:2749] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:55.376046 28972 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:55.379429 21841 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:55.374464 22015 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:55.389184 20756 raft_consensus.cc:2272] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.350603 28968 consensus_queue.cc:260] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:55.401094 28972 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:55.401786 28972 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.404706 28968 ts_tablet_manager.cc:1434] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: Time spent starting tablet: real 0.072s	user 0.000s	sys 0.009s
I20260709 13:08:55.392544 28971 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:55.405406 28972 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.406870 28971 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.409297 28971 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.409600 20756 tablet_replica.cc:333] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.410806 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.411170 20756 raft_consensus.cc:2243] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.411947 20756 raft_consensus.cc:2272] T d8f404cd14ba4c2687ffe2b7637e1da7 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.413560 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.414608 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.415426 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eddf7375a2842f7bbfd9ab2061e0027" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.423142 21838 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:55.394832 28934 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:55.437281 20756 tablet_replica.cc:333] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.449047 20756 raft_consensus.cc:2243] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.457126 22607 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:55.432077 28972 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:55.458433 20756 raft_consensus.cc:2272] T ade18365d2864739b70e41ba62311466 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.459614 28984 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:55.455718 28934 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:55.463868 20756 tablet_replica.cc:333] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.468001 21948 raft_consensus.cc:1275] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:55.469141 20756 raft_consensus.cc:2243] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:08:55.470288 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 70178.8us
I20260709 13:08:55.456703 28971 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:55.471488 28971 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.472803 28934 raft_consensus.cc:493] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:55.473359 28934 raft_consensus.cc:515] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.477130 28934 leader_election.cc:290] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.477756 28971 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.478484 20756 raft_consensus.cc:2272] T 1b7ba79f0d534cbba2170f41c42625e6 P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.479488 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.470920 28988 consensus_queue.cc:1048] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:08:55.470496 28972 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.507417 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e4c126dc6f477daa840b84b452bb59" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.510643 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.512907 21959 tablet_copy_service.cc:342] P 61893f17f34b4cc9b898114d3c0a7023: Request end of tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-a2e697f6ebda4eec99aeb32b72b9bfa4 received from {username='slave'} at 127.0.0.1:35490
I20260709 13:08:55.513419 21959 tablet_copy_service.cc:434] P 61893f17f34b4cc9b898114d3c0a7023: ending tablet copy session bcc802f7bc374bed98e2ee0596a8ebda-a2e697f6ebda4eec99aeb32b72b9bfa4 on tablet a2e697f6ebda4eec99aeb32b72b9bfa4 with peer bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:55.514737 20756 tablet_replica.cc:333] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.524132 21841 leader_election.cc:304] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:55.529372 20756 raft_consensus.cc:2243] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:08:55.530598 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 107610us
I20260709 13:08:55.533070 21838 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:55.537191 28995 raft_consensus.cc:2749] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:55.537964 28995 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:55.543612 20756 raft_consensus.cc:2272] T b83eb73076f949419556cb7ef3746784 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.546017 28972 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.522853 28934 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:55.554129 28934 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.555758 20756 tablet_replica.cc:333] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.519445 28971 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:55.556867 20756 raft_consensus.cc:2243] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.573201 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eeff5779b544ebaac041e407041b284" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.576836 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.577874 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:55.596336 21841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 72299.6us
I20260709 13:08:55.601007 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9fbee4e9e94929bc4675f1e7f4384d" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.589857 28998 raft_consensus.cc:493] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:55.557027 28971 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.600669 28934 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.606389 28998 raft_consensus.cc:515] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.615408 28948 raft_consensus.cc:1064] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
I20260709 13:08:55.609788 28972 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:55.604715 29002 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:55.617152 28972 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.617311 29002 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:55.618281 28948 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.619323 28972 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.619742 29002 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.612581 28998 leader_election.cc:290] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.621461 28971 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.658200 20756 raft_consensus.cc:2272] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.664155 20756 tablet_replica.cc:333] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.667140 20756 raft_consensus.cc:2243] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.668857 20756 raft_consensus.cc:2272] T 04a8fcd2517b44a4895a7b0ec8966a41 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.674013 20756 tablet_replica.cc:333] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.676489 20756 raft_consensus.cc:2243] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.682590 20756 raft_consensus.cc:2272] T 6c93691583c1413ca9d0cb9e64fbd7cd P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.686771 20756 tablet_replica.cc:333] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.694393 29006 raft_consensus.cc:493] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:55.707950 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.733894 28981 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:55.735108 28981 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.737056 28971 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:55.737435 21948 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.738579 28971 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.695196 20756 raft_consensus.cc:2243] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:55.710551 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.709523 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:55.776990 29000 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:55.778007 29000 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.780903 28994 raft_consensus.cc:493] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:55.782140 28994 raft_consensus.cc:515] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.783041 20756 raft_consensus.cc:2272] T da1dbb318a2c4a44b440673a00d826d1 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.783931 29000 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.785611 29006 raft_consensus.cc:515] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.789721 28972 raft_consensus.cc:493] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:55.790684 28972 raft_consensus.cc:515] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.772270 28934 raft_consensus.cc:493] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:08:55.797557 28934 raft_consensus.cc:515] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:55.803311 28981 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.805989 28994 leader_election.cc:290] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.808012 29006 leader_election.cc:290] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.794811 28995 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:08:55.819979 28995 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: NON_VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: true } }
I20260709 13:08:55.824426 28971 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.825027 28934 leader_election.cc:290] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:55.806133 28972 leader_election.cc:290] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.832371 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.835852 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b185f97673b24433b4222ebdebb6f211" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.837720 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f518749c784001a1f5106719d0b72f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.839069 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.839921 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c64648f65a9248d0b9e34c739a250e4c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.841465 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9fc717cf49c47969c86d6c23778f56c" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.845348 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.850557 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.850791 22023 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:55.852504 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.852684 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.857187 21948 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:08:55.860797 22573 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.69.62:45563, user_credentials={real_user=slave}} blocked reactor thread for 63001.7us
I20260709 13:08:55.870868 22606 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEARNER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:55.880635 28995 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.880884 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.885098 28948 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:55.888769 28827 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:55.895895 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.904107 28948 raft_consensus.cc:2955] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:55.922333 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.922730 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.909346 20756 tablet_replica.cc:333] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
W20260709 13:08:55.910377 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 146365us
I20260709 13:08:55.911494 21948 raft_consensus.cc:2955] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:55.914359 28934 raft_consensus.cc:493] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:55.926827 28934 raft_consensus.cc:515] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:55.928076 20756 raft_consensus.cc:2243] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:55.929749 28934 leader_election.cc:290] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:55.919561 21841 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:55.931284 28995 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:55.932222 20756 raft_consensus.cc:2272] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:55.924049 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:55.939110 21838 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:55.940222 28934 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:55.952040 21838 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:08:55.956257 21838 raft_consensus.cc:2686] T f9fc717cf49c47969c86d6c23778f56c P 95296a4420ed41b69191d3d4353cf2b0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:55.959328 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:55.962538 29010 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:55.970546 21838 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:55.965013 22606 raft_consensus.cc:2955] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:55.975539 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53533.8us
W20260709 13:08:55.977483 21988 consensus_peers.cc:597] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.984637 20756 tablet_replica.cc:333] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:55.993804 20756 raft_consensus.cc:2243] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.004268 22604 raft_consensus.cc:1275] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:56.004359 22607 raft_consensus.cc:1217] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:08:56.016320 28995 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:56.017961 20756 raft_consensus.cc:2272] T 2eddf7375a2842f7bbfd9ab2061e0027 P 95296a4420ed41b69191d3d4353cf2b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.021647 20756 tablet_replica.cc:333] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
W20260709 13:08:56.021759 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 51418.1us
I20260709 13:08:56.026628 20756 raft_consensus.cc:2243] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.048873 21838 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:56.052511 22574 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.053529 20756 raft_consensus.cc:2272] T 06e4c126dc6f477daa840b84b452bb59 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.054210 22574 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:56.062193 21773 catalog_manager.cc:5697] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 11 to 12, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.090713 22022 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.064680 28804 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:56.091280 22607 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.087316 28995 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:56.069490 28961 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.085770 28932 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.060369 20756 tablet_replica.cc:333] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.086843 21838 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:56.122473 28948 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.123174 28948 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.127197 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:56.128752 21988 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.128937 28948 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:56.129573 21987 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:56.131198 28948 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:56.140705 20756 raft_consensus.cc:2243] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.144348 20756 raft_consensus.cc:2272] T f5f518749c784001a1f5106719d0b72f P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.149570 21771 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: config changed from index 13 to 14, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.155448 28995 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:56.156261 21838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 69522.8us
I20260709 13:08:56.165690 21838 leader_election.cc:304] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:56.166577 28995 raft_consensus.cc:2749] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:56.175446 28977 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.176117 28977 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.178198 28977 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:56.180923 29007 consensus_queue.cc:1048] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:08:56.216336 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:56.208731 28995 raft_consensus.cc:493] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:08:56.223934 28995 raft_consensus.cc:515] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.226706 28995 leader_election.cc:290] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:56.229130 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:56.232136 21771 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 12 to 13, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 14 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.200058 21948 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } attrs { replace: true } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.236081 22022 consensus_queue.cc:237] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.237038 20756 tablet_replica.cc:333] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.254179 20756 raft_consensus.cc:2243] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.239423 28827 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.254908 28827 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.256719 28827 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:56.257959 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:56.258674 22023 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
I20260709 13:08:56.259843 20756 raft_consensus.cc:2272] T eda002bd6903433da20d221420291f1e P 95296a4420ed41b69191d3d4353cf2b0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.259999 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:56.260866 29010 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.260907 22607 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:56.261554 29010 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.263180 20756 tablet_replica.cc:333] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.263083 28932 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:56.264211 29010 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:56.266371 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.266530 28827 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:56.267127 28827 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.267496 28827 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:56.267594 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:56.268682 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a949ee94dddab00a0afe84da820" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.269124 21757 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20e7b7ab39a74ba88aa5a6259c522f73 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:56.275296 22607 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 12.
W20260709 13:08:56.278241 21988 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.281065 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9daa6d16d543f0a8cb8b3d482b3d80" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.284351 28948 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.264436 20756 raft_consensus.cc:2243] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.288890 28804 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.289121 28827 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.289371 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f51668452ae440fa9267f7cb2f597c9" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.289601 28804 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.293093 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.291049 28827 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:56.292912 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.301033 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:56.304435 21946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41144a85d9d645d9a3eb3ef87b761a44" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.288981 20756 raft_consensus.cc:2272] T 130319e952f14561b08ef212107e1666 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.294200 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105015b2b463442ab34e0509af7105fb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:56.296658 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81a928ac9f854ce1bcb7c9b78983b84f" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.316473 22023 raft_consensus.cc:3060] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:56.316548 21838 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:56.317785 21838 leader_election.cc:304] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:56.313723 22601 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.319048 21838 leader_election.cc:304] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:56.321605 21838 leader_election.cc:304] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:56.321976 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590d7eea40954779924038b15b716b58" candidate_uuid: "95296a4420ed41b69191d3d4353cf2b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.328523 21942 raft_consensus.cc:1275] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:08:56.328933 28998 raft_consensus.cc:2749] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:56.329447 28985 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:56.331609 28985 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.332056 28985 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:56.326676 21758 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46813.6us
I20260709 13:08:56.319257 28995 raft_consensus.cc:2749] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:56.325523 28934 raft_consensus.cc:2749] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:56.326704 29002 raft_consensus.cc:2749] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:56.363308 22607 raft_consensus.cc:2955] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.369467 21838 leader_election.cc:304] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:56.374907 28998 raft_consensus.cc:2749] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:56.375573 21760 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 54fabc2ab3354c0ab4e0d3f4670eb221 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:56.381258 22023 raft_consensus.cc:2468] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 20.
I20260709 13:08:56.382627 21838 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:56.392794 20756 tablet_replica.cc:333] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.390528 28985 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.399544 28932 consensus_queue.cc:1048] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:56.402961 20756 raft_consensus.cc:2243] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.403795 28934 raft_consensus.cc:2749] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:56.403988 28985 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:56.405114 21838 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:56.406338 28804 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:56.401751 21916 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:56.407483 29007 raft_consensus.cc:2804] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:56.408178 29007 raft_consensus.cc:697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
I20260709 13:08:56.408412 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.409180 21941 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:08:56.409320 29007 consensus_queue.cc:237] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.411228 21950 raft_consensus.cc:2955] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 14 to 15, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.411249 22573 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:56.417289 28986 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:56.417718 28986 raft_consensus.cc:493] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.418120 28986 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:56.421953 21988 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.406354 20756 raft_consensus.cc:2272] T 3bdea259b2284b5c9cec755539e72888 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.428707 28986 raft_consensus.cc:515] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.430941 21838 leader_election.cc:304] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:08:56.435794 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f816617b58480bad6550570b514d80" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:56.436439 22601 raft_consensus.cc:3060] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:56.439834 21838 leader_election.cc:304] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95296a4420ed41b69191d3d4353cf2b0; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:08:56.436720 22574 leader_election.cc:336] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.440941 21765 catalog_manager.cc:5697] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: config changed from index 14 to 15, VOTER 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) evicted. New cstate: current_term: 16 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.433495 28934 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:56.448585 21838 raft_consensus.cc:2686] T 81a928ac9f854ce1bcb7c9b78983b84f P 95296a4420ed41b69191d3d4353cf2b0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:08:56.450680 21758 catalog_manager.cc:4755] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20e7b7ab39a74ba88aa5a6259c522f73: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:08:56.442233 29002 raft_consensus.cc:2749] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:56.475482 28827 raft_consensus.cc:1064] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: attempting to promote NON_VOTER bcc802f7bc374bed98e2ee0596a8ebda to VOTER
W20260709 13:08:56.484442 21914 leader_election.cc:336] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.485059 21914 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:56.488828 28977 raft_consensus.cc:2749] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:56.490422 20756 tablet_replica.cc:333] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.491542 20756 raft_consensus.cc:2243] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.492218 20756 raft_consensus.cc:2272] T 41144a85d9d645d9a3eb3ef87b761a44 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.498585 28827 consensus_queue.cc:237] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.510681 28986 leader_election.cc:290] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:56.511754 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef15581ea60041b6a79f34c9e4dbe9c3" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:56.512459 21942 raft_consensus.cc:3060] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:56.512745 20756 tablet_replica.cc:333] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.513700 20756 raft_consensus.cc:2243] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.514556 20756 raft_consensus.cc:2272] T e3fd785266e045ce9ae6bb7160866b9d P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.516341 28985 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.517078 28985 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.521822 20756 tablet_replica.cc:333] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.529192 22601 raft_consensus.cc:2468] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 13.
W20260709 13:08:56.530315 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 46000.9us
W20260709 13:08:56.530987 21914 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:56.531683 21914 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.539938 21988 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:56.542763 28948 raft_consensus.cc:2804] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:56.543337 28948 raft_consensus.cc:697] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:56.544411 21988 leader_election.cc:336] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.544350 28948 consensus_queue.cc:237] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.552066 28985 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:56.536794 20756 raft_consensus.cc:2243] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.553229 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:56.553542 20756 raft_consensus.cc:2272] T a3f11dd69f214cd6b7b169181c1a910b P 95296a4420ed41b69191d3d4353cf2b0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.554647 22022 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:56.555027 21988 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:56.556510 28932 raft_consensus.cc:2749] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:56.559494 28977 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:56.557847 21765 catalog_manager.cc:5697] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 19 to 20, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 20 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.568670 20756 tablet_replica.cc:333] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.569641 20756 raft_consensus.cc:2243] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.578099 21942 raft_consensus.cc:2468] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
W20260709 13:08:56.538426 22574 leader_election.cc:336] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:56.585722 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 47788.5us
I20260709 13:08:56.585912 22573 leader_election.cc:304] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:56.593333 20756 raft_consensus.cc:2272] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.601447 28986 raft_consensus.cc:2804] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:56.602089 28986 raft_consensus.cc:697] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:56.602979 28986 consensus_queue.cc:237] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.621771 28948 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.623466 28948 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.625890 28948 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:56.628024 20756 tablet_replica.cc:333] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.627833 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:08:56.614946 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.630487 28901 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.631145 28901 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:56.631911 21988 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.633795 28901 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:56.634583 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:56.635313 22022 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
I20260709 13:08:56.636657 21988 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:56.636665 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:56.637725 28901 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:56.637888 28985 raft_consensus.cc:2749] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:56.638190 28901 raft_consensus.cc:493] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.638717 28901 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:56.644430 22601 raft_consensus.cc:1275] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEARNER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:56.645944 20756 raft_consensus.cc:2243] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.650063 21765 catalog_manager.cc:5697] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 12 to 13, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 13 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.660205 29019 consensus_queue.cc:1048] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:56.664129 20756 raft_consensus.cc:2272] T c64648f65a9248d0b9e34c739a250e4c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.663682 28901 raft_consensus.cc:515] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.666235 28901 leader_election.cc:290] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:56.667179 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83eb73076f949419556cb7ef3746784" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:56.667954 22020 raft_consensus.cc:3060] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:56.665576 21773 catalog_manager.cc:5697] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 16 to 17, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 17 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.684670 22020 raft_consensus.cc:2468] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:08:56.692101 22576 leader_election.cc:304] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:56.692473 20756 tablet_replica.cc:333] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.693378 28804 raft_consensus.cc:2804] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:56.693605 20756 raft_consensus.cc:2243] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.693885 28804 raft_consensus.cc:697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:56.694554 20756 raft_consensus.cc:2272] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.694795 28804 consensus_queue.cc:237] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:56.696821 22574 leader_election.cc:336] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.696864 28742 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.697546 28742 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.702665 29007 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.703015 28742 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:56.703326 29007 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.704947 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:56.705628 22022 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 21.
I20260709 13:08:56.706670 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:56.707726 20756 tablet_replica.cc:333] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.711150 20756 raft_consensus.cc:2243] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.711495 29007 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:56.712128 20756 raft_consensus.cc:2272] T 590d7eea40954779924038b15b716b58 P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.713912 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:56.714808 28742 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:56.715178 28742 raft_consensus.cc:493] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.715509 28742 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:56.715911 20756 tablet_replica.cc:333] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.716953 20756 raft_consensus.cc:2243] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.717794 20756 raft_consensus.cc:2272] T ad0b6a949ee94dddab00a0afe84da820 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.721179 20756 tablet_replica.cc:333] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.722429 20756 raft_consensus.cc:2243] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.723592 20756 raft_consensus.cc:2272] T b7a6203a9eab4b71b33f702b49f0945f P 95296a4420ed41b69191d3d4353cf2b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.726661 20756 tablet_replica.cc:333] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.727550 20756 raft_consensus.cc:2243] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.728729 20756 raft_consensus.cc:2272] T bd12cba9f1b74b1b908b1d598ca51a8c P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:56.729815 22574 leader_election.cc:336] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.731923 20756 tablet_replica.cc:333] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.732969 20756 raft_consensus.cc:2243] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.733217 29019 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.733850 29019 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.734827 20756 raft_consensus.cc:2272] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 95296a4420ed41b69191d3d4353cf2b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.737401 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:56.738438 20756 tablet_replica.cc:333] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.739434 20756 raft_consensus.cc:2243] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.740447 29019 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:56.740671 20756 raft_consensus.cc:2272] T e067dbcd1ae14ea1a16378539be836cb P 95296a4420ed41b69191d3d4353cf2b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.744388 28742 raft_consensus.cc:515] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:56.746002 22574 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:56.747886 21914 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.748790 21914 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:56.751669 28827 raft_consensus.cc:2749] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:56.755669 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b7ba79f0d534cbba2170f41c42625e6" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:56.756338 22022 raft_consensus.cc:3060] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:56.756399 20756 tablet_replica.cc:333] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
W20260709 13:08:56.757318 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.757486 20756 raft_consensus.cc:2243] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.758281 20756 raft_consensus.cc:2272] T b185f97673b24433b4222ebdebb6f211 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.770083 21773 catalog_manager.cc:5697] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 14 to 15, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.772814 28742 leader_election.cc:290] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:56.774173 22574 leader_election.cc:336] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:56.776365 21914 leader_election.cc:336] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.776387 29007 raft_consensus.cc:2955] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.778527 21914 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:56.764464 22022 raft_consensus.cc:2468] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 22.
I20260709 13:08:56.783417 28827 raft_consensus.cc:2749] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:56.790146 20756 tablet_replica.cc:333] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.790313 22576 leader_election.cc:304] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:56.791132 20756 raft_consensus.cc:2243] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.792068 28742 raft_consensus.cc:2804] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:56.792654 28742 raft_consensus.cc:697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
W20260709 13:08:56.792840 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.798870 28948 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.799537 28948 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.803182 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.803886 21942 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:56.805138 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:56.806020 28985 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:56.806403 22022 raft_consensus.cc:1275] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:56.806514 28948 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:56.808341 28827 consensus_queue.cc:1048] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:56.792033 20756 raft_consensus.cc:2272] T 4a9fbee4e9e94929bc4675f1e7f4384d P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.806418 28985 raft_consensus.cc:493] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.809983 22601 raft_consensus.cc:2955] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
I20260709 13:08:56.811111 28985 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:56.812135 20756 tablet_replica.cc:333] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.813038 20756 raft_consensus.cc:2243] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.814276 20756 raft_consensus.cc:2272] T cb3ae54bf5ef462ba44e223978c42103 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:56.816283 21988 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.819298 28948 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.820067 28948 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.822808 28948 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:56.824748 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:56.826864 28932 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
W20260709 13:08:56.827170 21988 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.827672 21988 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:56.827620 28932 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.793552 28742 consensus_queue.cc:237] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:56.829727 28989 raft_consensus.cc:2749] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:56.832260 28932 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:56.835572 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:56.836239 21942 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 16.
I20260709 13:08:56.838675 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:56.839511 28932 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:56.839891 28932 raft_consensus.cc:493] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:56.840241 28932 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:56.841053 21914 consensus_peers.cc:597] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.847975 22022 raft_consensus.cc:2955] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } } }
W20260709 13:08:56.853767 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.854436 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.862409 28932 raft_consensus.cc:515] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.868243 21773 catalog_manager.cc:5697] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: config changed from index 13 to 14, bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.872148 20756 tablet_replica.cc:333] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.871743 28985 raft_consensus.cc:515] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:56.873086 20756 raft_consensus.cc:2243] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.873752 20756 raft_consensus.cc:2272] T 5af1794ba4454baf843df541f302e8e0 P 95296a4420ed41b69191d3d4353cf2b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.877349 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d57015ad0d14c41a8a97e3c1e1d63f4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:56.877936 21942 raft_consensus.cc:3060] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:56.884815 21942 raft_consensus.cc:2468] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 19.
I20260709 13:08:56.886031 21987 leader_election.cc:304] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:56.887145 28989 raft_consensus.cc:2804] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:08:56.901948 21988 leader_election.cc:336] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:56.904215 21988 leader_election.cc:336] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.901937 20756 tablet_replica.cc:333] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.907315 20756 raft_consensus.cc:2243] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.901703 28985 leader_election.cc:290] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:56.903461 28989 raft_consensus.cc:697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:56.915256 28932 leader_election.cc:290] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:56.918440 20756 raft_consensus.cc:2272] T 65033a7eefd242a796408c7d54fed332 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.927533 28989 consensus_queue.cc:237] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:56.935484 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.945463 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1dbb318a2c4a44b440673a00d826d1" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:56.946115 21942 raft_consensus.cc:3060] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:56.947288 21988 leader_election.cc:336] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:56.949564 20756 tablet_replica.cc:333] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.950412 20756 raft_consensus.cc:2243] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:56.951225 20756 raft_consensus.cc:2272] T 7eeff5779b544ebaac041e407041b284 P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.953868 21942 raft_consensus.cc:2468] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:56.961054 20756 tablet_replica.cc:333] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.962142 20756 raft_consensus.cc:2243] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:56.963276 20756 raft_consensus.cc:2272] T f33dbfc0299d475ebf12544cb959443d P 95296a4420ed41b69191d3d4353cf2b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.967608 20756 tablet_replica.cc:333] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:56.968334 20756 raft_consensus.cc:2243] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:56.975600 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.984526 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.997093 20756 raft_consensus.cc:2272] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:56.986497 21987 leader_election.cc:304] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.005667 22601 raft_consensus.cc:1275] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:57.019641 29031 raft_consensus.cc:2804] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:57.020282 29031 raft_consensus.cc:697] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
W20260709 13:08:57.021652 21914 consensus_peers.cc:597] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:57.021322 29031 consensus_queue.cc:237] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:57.025334 29032 consensus_queue.cc:1048] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:57.033309 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.035367 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.033910 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.036355 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.009543 21773 catalog_manager.cc:5697] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 21 to 22, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 22 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:57.037060 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.037214 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.037925 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.038734 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.045167 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.072305 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:57.076633 21773 catalog_manager.cc:5697] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 18 to 19, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 19 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:57.097922 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:57.099511 28977 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.100171 28977 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:57.121670 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.121706 21914 leader_election.cc:336] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.109840 28977 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:08:57.174906 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53305.8us
I20260709 13:08:57.168728 21773 catalog_manager.cc:5697] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 16 to 17, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 17 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:57.135548 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.183676 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 48216.4us
I20260709 13:08:57.108171 21941 raft_consensus.cc:1275] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:08:57.175016 21914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53355.1us
I20260709 13:08:57.186547 28986 consensus_queue.cc:1048] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:57.106992 20756 tablet_replica.cc:333] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:57.194998 20756 raft_consensus.cc:2243] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.195878 20756 raft_consensus.cc:2272] T 7dafb6252675441ca7ff8bf9e864644c P 95296a4420ed41b69191d3d4353cf2b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.119058 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:57.201758 21914 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:57.228682 20756 tablet_replica.cc:333] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:57.229631 20756 raft_consensus.cc:2243] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.230506 20756 raft_consensus.cc:2272] T 20e7b7ab39a74ba88aa5a6259c522f73 P 95296a4420ed41b69191d3d4353cf2b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:57.232791 28827 raft_consensus.cc:2749] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:57.282253 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 46550.4us
I20260709 13:08:57.289492 20756 tablet_replica.cc:333] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0: stopping tablet replica
I20260709 13:08:57.290273 20756 raft_consensus.cc:2243] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:57.290978 20756 raft_consensus.cc:2272] T 2f51668452ae440fa9267f7cb2f597c9 P 95296a4420ed41b69191d3d4353cf2b0 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:57.305179 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.305898 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.308199 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.318526 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.323719 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:57.324558 22022 raft_consensus.cc:1275] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:57.326068 28901 consensus_queue.cc:1048] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:57.331207 28901 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.331840 28901 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.334061 28901 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:57.337728 21950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
W20260709 13:08:57.338378 22574 leader_election.cc:336] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:57.338393 21950 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:08:57.358940 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:08:57.375967 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:57.377430 28901 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:57.384321 28901 raft_consensus.cc:493] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.384866 28901 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:57.430739 21941 raft_consensus.cc:1275] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:57.439572 29033 consensus_queue.cc:1048] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:57.441723 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.444471 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.452209 22574 connection.cc:769] client connection to 127.20.69.1:38039 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:08:57.452880 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.455284 21988 connection.cc:573] client connection to 127.20.69.1:38039 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:08:57.458549 29031 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.459095 29031 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:57.521173 21914 connection.cc:769] client connection to 127.20.69.1:38039 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:08:57.524468 29031 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:57.471911 28901 raft_consensus.cc:515] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.528398 28901 leader_election.cc:290] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:57.542395 21942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:57.541435 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c93691583c1413ca9d0cb9e64fbd7cd" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:57.544443 21941 raft_consensus.cc:3060] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:57.554219 22020 raft_consensus.cc:1275] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:08:57.559295 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.563925 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.573199 21941 raft_consensus.cc:2468] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 20.
I20260709 13:08:57.574522 22573 leader_election.cc:304] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:57.575728 28981 raft_consensus.cc:2804] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:57.576421 28981 raft_consensus.cc:697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 20 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:57.577416 28981 consensus_queue.cc:237] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.582223 21950 raft_consensus.cc:1275] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:57.586660 28948 consensus_queue.cc:1048] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:57.594870 22574 leader_election.cc:336] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.595379 28901 consensus_queue.cc:1048] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:57.595992 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.606976 21988 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.611750 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.627674 28989 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:57.629724 21765 catalog_manager.cc:5697] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 19 to 20, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 20 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:57.632395 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.667526 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:57.724679 21914 consensus_peers.cc:597] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:57.732698 28901 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.733210 28986 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.733347 28901 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.733831 28986 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.735574 28901 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:57.735761 28986 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:57.741467 22574 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:08:57.742013 22574 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:08:57.744081 21758 catalog_manager.cc:4755] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20e7b7ab39a74ba88aa5a6259c522f73: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:08:57.744648 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:57.748977 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:57.749763 22023 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 22.
I20260709 13:08:57.752012 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:57.754170 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.755841 28742 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:57.756244 28742 raft_consensus.cc:493] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.756634 28742 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:57.767450 28742 raft_consensus.cc:515] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.769598 28742 leader_election.cc:290] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:57.775000 22574 leader_election.cc:336] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.775185 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.777462 28742 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:57.779171 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda002bd6903433da20d221420291f1e" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:57.779870 22023 raft_consensus.cc:3060] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:57.790271 22023 raft_consensus.cc:2468] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 23.
I20260709 13:08:57.794617 22576 leader_election.cc:304] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.795437 28742 raft_consensus.cc:2804] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:57.795959 28742 raft_consensus.cc:697] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 23 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:57.796792 28742 consensus_queue.cc:237] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.804387 29007 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.805109 29007 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:57.807411 29007 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:57.809638 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:57.814719 28977 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.815301 28977 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:57.817589 28977 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:57.821151 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:08:57.821916 22023 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 18.
I20260709 13:08:57.823791 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
I20260709 13:08:57.824967 28977 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:57.825389 28977 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.825785 28977 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:57.830000 21914 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.830605 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.831554 28961 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:57.838243 21914 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.841845 29033 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.842526 29033 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.845119 29033 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:57.854913 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:57.855826 22601 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:57.865526 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:08:57.869869 29032 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:57.870332 29032 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.870716 29032 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:57.886636 29032 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:08:57.889001 21988 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.890203 21773 catalog_manager.cc:5697] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 22 to 23, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 23 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.894457 29032 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:57.902657 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130319e952f14561b08ef212107e1666" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:08:57.903355 22601 raft_consensus.cc:3060] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:57.921324 28977 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:57.924561 22601 raft_consensus.cc:2468] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
W20260709 13:08:57.930454 21988 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.934383 21988 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.936300 29032 raft_consensus.cc:2804] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:57.937803 29032 raft_consensus.cc:697] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:57.938793 29032 consensus_queue.cc:237] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.939915 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdea259b2284b5c9cec755539e72888" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:08:57.940514 22020 raft_consensus.cc:3060] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:57.939206 28977 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:08:57.946019 21914 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.957870 28742 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.958721 28742 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.959359 22020 raft_consensus.cc:2468] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61893f17f34b4cc9b898114d3c0a7023 in term 19.
I20260709 13:08:57.963866 21916 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.964855 28977 raft_consensus.cc:2804] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:57.966068 28977 raft_consensus.cc:697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Becoming Leader. State: Replica: 61893f17f34b4cc9b898114d3c0a7023, State: Running, Role: LEADER
W20260709 13:08:57.967136 22574 leader_election.cc:336] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:57.967140 28977 consensus_queue.cc:237] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:57.979511 21773 catalog_manager.cc:5697] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 20 to 21, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 21 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.988909 28961 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.989514 28961 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:57.993860 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:57.994572 21941 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
I20260709 13:08:57.995540 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:57.996520 28981 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:57.996935 28981 raft_consensus.cc:493] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:57.997318 28981 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:58.000816 21914 leader_election.cc:336] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:58.002321 28961 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:08:58.003947 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:08:57.994980 28742 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:58.033463 21773 catalog_manager.cc:5697] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 reported cstate change: term changed from 18 to 19, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2). New cstate: current_term: 19 leader_uuid: "61893f17f34b4cc9b898114d3c0a7023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:58.008708 28981 raft_consensus.cc:515] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:58.062191 22601 raft_consensus.cc:2393] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61893f17f34b4cc9b898114d3c0a7023 in current term 18: Already voted for candidate bcc802f7bc374bed98e2ee0596a8ebda in this term.
I20260709 13:08:58.065673 21914 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:08:58.066710 28977 raft_consensus.cc:3060] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:58.069129 22574 leader_election.cc:336] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:58.070180 29032 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:58.070744 29032 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:58.072809 28981 leader_election.cc:290] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:58.072968 29032 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:58.074158 21941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb3ae54bf5ef462ba44e223978c42103" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:58.075238 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:58.078707 28977 raft_consensus.cc:2749] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:58.078902 21947 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 20.
I20260709 13:08:58.080437 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 
W20260709 13:08:58.083232 21988 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:58.087594 21941 raft_consensus.cc:2468] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:08:58.089452 22573 leader_election.cc:304] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:58.091471 28742 raft_consensus.cc:2804] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:58.091941 28742 raft_consensus.cc:697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:08:58.112320 21947 raft_consensus.cc:1275] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:58.117759 28742 consensus_queue.cc:237] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:08:58.122741 28981 consensus_queue.cc:1048] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:58.119709 29032 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:58.124404 29032 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:58.124890 29032 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:58.161599 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:58.173105 29032 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:58.191679 28977 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:58.192305 28977 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:58.194440 28977 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:08:58.195955 21773 catalog_manager.cc:5697] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 17 to 18, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 18 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.201100 22020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:08:58.208248 21988 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:58.214809 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:58.215559 21947 raft_consensus.cc:3060] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:58.215723 29032 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:58.234716 21947 raft_consensus.cc:2468] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 21.
I20260709 13:08:58.237031 21987 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:58.238008 29032 raft_consensus.cc:2804] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:58.238529 29032 raft_consensus.cc:697] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:58.239379 29032 consensus_queue.cc:237] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:58.275177 29031 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:58.275781 29031 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:58.277647 21914 leader_election.cc:336] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:58.278142 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:58.279388 28961 raft_consensus.cc:2749] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:58.282047 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:58.288484 21988 leader_election.cc:336] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:58.283016 29031 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:08:58.299479 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023" is_pre_election: true
I20260709 13:08:58.300335 21947 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 17.
I20260709 13:08:58.301483 21987 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:58.316175 22020 raft_consensus.cc:1275] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:58.317247 29033 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:58.317763 29033 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 95296a4420ed41b69191d3d4353cf2b0)
I20260709 13:08:58.317541 28986 consensus_queue.cc:1048] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:58.318240 29033 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:58.322188 21773 catalog_manager.cc:5697] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 20 to 21, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 21 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:58.332866 29033 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:08:58.336658 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "61893f17f34b4cc9b898114d3c0a7023"
I20260709 13:08:58.337373 21947 raft_consensus.cc:3060] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:58.341179 29033 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Requested vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:08:58.357112 21988 leader_election.cc:336] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:58.360816 21947 raft_consensus.cc:2468] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:08:58.362494 21987 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:08:58.365674 29032 raft_consensus.cc:2804] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:58.366309 29032 raft_consensus.cc:697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:08:58.367183 29032 consensus_queue.cc:237] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:08:58.379349 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.425455 21773 catalog_manager.cc:5697] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 17 to 18, leader changed from 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 18 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:58.464860 20756 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21896)
I20260709 13:08:58.474850 22023 raft_consensus.cc:1275] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer 61893f17f34b4cc9b898114d3c0a7023: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:58.476922 28977 consensus_queue.cc:1048] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:58.553697 21914 consensus_peers.cc:597] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:58.561573 21988 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.565760 21947 raft_consensus.cc:1275] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:58.578657 22601 raft_consensus.cc:1275] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:58.583285 28742 consensus_queue.cc:1048] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:58.591518 29033 consensus_queue.cc:1048] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:58.656670 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:58.665890 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.686913 21947 raft_consensus.cc:1275] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:58.688544 29032 consensus_queue.cc:1048] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:58.810372 21758 catalog_manager.cc:4755] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20e7b7ab39a74ba88aa5a6259c522f73: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:08:58.857489 21947 raft_consensus.cc:1275] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:58.859241 29033 consensus_queue.cc:1048] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:58.896394 21988 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:59.117344 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.131413 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.166904 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.238319 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.303956 21914 consensus_peers.cc:597] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.305497 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.335873 22574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 13:08:59.353091 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.379551 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.384570 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.465404 20756 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21896)
W20260709 13:08:59.491992 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.501289 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.527292 21914 consensus_peers.cc:597] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.528244 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.528910 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.556033 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.584553 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.650831 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.658943 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.664947 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.674052 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.674947 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.675458 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.686986 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.766356 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.770763 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.773887 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.884819 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.891338 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.911927 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.941443 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.029464 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.034937 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.108012 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.323668 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.465893 20756 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:00.582217 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.584170 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.584885 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.683668 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.741966 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.835682 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:00.863741 21914 consensus_peers.cc:597] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.907660 21758 catalog_manager.cc:4755] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20e7b7ab39a74ba88aa5a6259c522f73: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:00.964820 21988 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.041059 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.080772 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.263865 21988 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.263429 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.466435 20756 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:01.520360 21914 consensus_peers.cc:597] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:01.610926 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.703922 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.750065 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.811614 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.815244 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.896711 21914 consensus_peers.cc:597] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:01.902693 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.918779 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.014896 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.035538 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.036193 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.075459 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.195279 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.197026 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.216519 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.217123 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.218859 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 59967.7us
W20260709 13:09:02.235479 21914 consensus_peers.cc:597] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.240523 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.270187 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.294708 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.317468 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.363462 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.365582 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.466948 20756 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:02.511479 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.558140 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.569620 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.579777 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.591337 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.691752 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.692504 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:02.706161 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.796532 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.810734 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.899966 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.921527 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.932745 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.022769 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.163794 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.344293 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.368777 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.442157 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.467862 20756 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:03.619693 21988 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.682914 21988 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.693742 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:03.818642 21914 consensus_peers.cc:597] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:03.890712 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.053066 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.055466 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.155864 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.211679 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.211881 21914 consensus_peers.cc:597] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:04.271030 21914 consensus_peers.cc:597] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.283833 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.288460 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.349298 21914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111) [suppressed 453 similar messages]
W20260709 13:09:04.368530 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.399839 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.468524 20756 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:04.540481 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.578864 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.587643 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.626457 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.635761 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.638248 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.755199 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.809021 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.844749 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.845443 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.850611 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.897495 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.899747 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.900658 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.901258 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.908813 21914 consensus_peers.cc:597] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.963095 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:04.975961 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.034976 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:05.116277 21758 catalog_manager.cc:4755] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 54fabc2ab3354c0ab4e0d3f4670eb221: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:05.156544 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:05.176870 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.186182 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.187983 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.229734 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.429342 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.469070 20756 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:05.494841 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.495457 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.543645 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.603260 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:05.888401 21916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:35687, user_credentials={real_user=slave}} blocked reactor thread for 76343.6us
W20260709 13:09:05.923406 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:05.924118 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.032891 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:41571, user_credentials={real_user=slave}} blocked reactor thread for 102083us
W20260709 13:09:06.076124 21914 consensus_peers.cc:597] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.122385 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 123026us
W20260709 13:09:06.122489 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.248749 21988 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.289134 21988 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.383484 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.407855 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.453749 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.470278 20756 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:06.572053 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.608526 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.624136 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.690845 21914 consensus_peers.cc:597] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:06.761227 21914 consensus_peers.cc:597] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:06.764202 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.809090 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.824280 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:06.961366 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.015156 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.132540 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.173130 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.214691 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.251217 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.259068 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.263291 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.280753 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.357518 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.375962 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.399458 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.409451 21987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 76774.7us
W20260709 13:09:07.444294 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.449242 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.470881 20756 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:07.496547 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.522442 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.569602 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.623559 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.686367 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.699556 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.700076 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.705924 21914 consensus_peers.cc:597] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.827301 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.914929 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.917868 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:07.959992 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:07.972290 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.000129 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.162818 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.244189 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.386289 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.385923 21914 consensus_peers.cc:597] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.446223 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.451709 21988 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.471549 20756 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:08.528033 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:08.546408 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.646399 21988 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.866372 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:08.949036 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 55790us
W20260709 13:09:08.962985 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.038534 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.079753 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.104101 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.264541 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.269107 21914 consensus_peers.cc:597] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:09.310621 21914 consensus_peers.cc:597] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.367154 22574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111) [suppressed 467 similar messages]
W20260709 13:09:09.391695 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.472090 20756 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:09.498343 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.522410 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.654274 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.666208 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.730093 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.741138 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.762635 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.763568 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.887863 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.903122 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.917419 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:09.921224 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.936952 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.939122 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.944697 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.955600 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:09.989907 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.034162 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.070397 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.277591 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:10.297814 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:10.373641 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.401438 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.473242 20756 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:10.477887 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.517846 21914 consensus_peers.cc:597] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.553858 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.558040 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:10.628120 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.662082 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.692682 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:10.739853 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:10.787144 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:10.849939 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.029062 21988 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.059962 21914 consensus_peers.cc:597] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.182024 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.265841 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.373167 21988 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.399343 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:11.452872 22574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 53568.8us
W20260709 13:09:11.454058 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.473860 20756 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 21896)
W20260709 13:09:11.621599 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.635871 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.752302 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.759739 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.846896 21914 consensus_peers.cc:597] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:11.871707 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.874822 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.941618 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:11.956063 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.000216 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.002242 21914 consensus_peers.cc:597] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:12.043205 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.160676 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.179560 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.199203 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.293848 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.295194 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.342976 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.356353 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.403911 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.413017 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.471848 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.497145 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.520377 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.545061 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.603226 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:12.622934 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.814420 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:12.858798 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.007400 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:13.024991 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.026727 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.049151 21914 consensus_peers.cc:597] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.108808 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.140117 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.192924 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.293025 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:13.314460 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:13.315248 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.347977 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.356845 21758 catalog_manager.cc:4755] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20e7b7ab39a74ba88aa5a6259c522f73: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:13.439882 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:13.447204 21914 consensus_peers.cc:597] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.449208 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:13.471076 21988 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:13.618268 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:13.623205 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:13.968324 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.044943 21988 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.072819 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.125701 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.252131 21914 consensus_peers.cc:597] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.281857 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.333596 21914 consensus_peers.cc:597] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:14.360931 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.372867 21914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111) [suppressed 471 similar messages]
W20260709 13:09:14.386024 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.440450 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.466708 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.536067 22573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:44983, user_credentials={real_user=slave}} blocked reactor thread for 45791.2us
W20260709 13:09:14.611488 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.617956 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.671027 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:14.672370 20756 tablet_server.cc:196] TabletServer@127.20.69.1:0 shutdown complete.
W20260709 13:09:14.707190 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.772529 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.787056 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.837198 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.875736 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.934829 21914 consensus_peers.cc:597] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:14.936435 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:14.962117 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.044343 21914 consensus_peers.cc:597] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:15.046447 20756 tablet_server.cc:179] TabletServer@127.20.69.2:0 shutting down...
W20260709 13:09:15.066066 21987 consensus_peers.cc:597] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.077783 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.096758 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.126608 22573 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.130931 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.133122 21914 consensus_peers.cc:597] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.138471 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.146996 21987 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.153940 22573 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.165753 21987 consensus_peers.cc:597] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.182766 22573 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.181360 21987 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.191819 21987 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.223405 22573 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.224046 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.230669 22573 consensus_peers.cc:597] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.247144 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.258996 21987 consensus_peers.cc:597] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.293650 21987 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.314254 22573 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.318046 22573 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.321911 22573 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.323768 21914 consensus_peers.cc:597] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.327695 21987 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.329792 22573 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.331894 21914 consensus_peers.cc:597] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:15.347652 21987 consensus_peers.cc:597] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.350782 22573 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.361626 21987 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.389067 22573 consensus_peers.cc:597] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.389608 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:15.389945 21987 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.393790 20756 tablet_replica.cc:333] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
W20260709 13:09:15.400535 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:15.410722 20756 raft_consensus.cc:2243] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.413420 20756 raft_consensus.cc:2272] T ef15581ea60041b6a79f34c9e4dbe9c3 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.436250 20756 tablet_replica.cc:333] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
W20260709 13:09:15.439635 22573 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.443499 21987 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.447404 20756 raft_consensus.cc:2243] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.450019 20756 raft_consensus.cc:2272] T 866936931060464d858e0e11cefba859 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.453267 20756 tablet_replica.cc:333] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
W20260709 13:09:15.462776 21987 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.498193 21987 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.498864 21987 consensus_peers.cc:597] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.502027 20756 raft_consensus.cc:2243] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.506603 20756 raft_consensus.cc:2272] T 080e5fa3988746d88e6350506ed3b136 P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.526531 22573 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.530148 20756 tablet_replica.cc:333] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
W20260709 13:09:15.551386 21987 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.556663 21987 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.560261 21987 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.574240 20756 raft_consensus.cc:2243] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.575753 20756 raft_consensus.cc:2272] T 2af20d42858245eb986768009de88379 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.647945 20756 tablet_replica.cc:333] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
W20260709 13:09:15.656970 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:15.665099 20756 raft_consensus.cc:2243] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.673807 20756 raft_consensus.cc:2272] T 105015b2b463442ab34e0509af7105fb P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.677155 20756 tablet_replica.cc:333] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.681378 20756 raft_consensus.cc:2243] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.682592 20756 raft_consensus.cc:2272] T 7eeff5779b544ebaac041e407041b284 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.686116 20756 tablet_replica.cc:333] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.690438 20756 raft_consensus.cc:2243] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.694415 20756 raft_consensus.cc:2272] T f8f8c3db69fa448a9f5e5d132c33b414 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.705885 20756 tablet_replica.cc:333] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.707314 20756 raft_consensus.cc:2243] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.708520 20756 raft_consensus.cc:2272] T 535d3d7bb32243b6b555376404412d8c P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.711614 20756 tablet_replica.cc:333] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.716583 20756 raft_consensus.cc:2243] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.717980 20756 raft_consensus.cc:2272] T 7685d376b61d438aa76f16fe47a7846d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.721171 20756 tablet_replica.cc:333] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.733347 20756 raft_consensus.cc:2243] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.734318 20756 raft_consensus.cc:2272] T ca34a4d332f1434f8089d28952415e70 P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.737357 20756 tablet_replica.cc:333] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.738320 20756 raft_consensus.cc:2243] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.739266 20756 raft_consensus.cc:2272] T d8f404cd14ba4c2687ffe2b7637e1da7 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.742537 20756 tablet_replica.cc:333] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.743480 20756 raft_consensus.cc:2243] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.745558 20756 raft_consensus.cc:2272] T 761d07666b514c36bcf7826ed77f8d8b P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.748826 20756 tablet_replica.cc:333] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.749714 20756 raft_consensus.cc:2243] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.750417 20756 raft_consensus.cc:2272] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.753487 20756 tablet_replica.cc:333] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.754406 20756 raft_consensus.cc:2243] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.755651 20756 raft_consensus.cc:2272] T 7baa5a75e229412297990ddc378b6aad P 61893f17f34b4cc9b898114d3c0a7023 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.758960 20756 tablet_replica.cc:333] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.759961 20756 raft_consensus.cc:2243] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.761803 20756 raft_consensus.cc:2272] T ade18365d2864739b70e41ba62311466 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.783103 20756 tablet_replica.cc:333] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.784118 20756 raft_consensus.cc:2243] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.785764 20756 raft_consensus.cc:2272] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.789085 20756 tablet_replica.cc:333] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.789983 20756 raft_consensus.cc:2243] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.804924 20756 raft_consensus.cc:2272] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.805893 21914 consensus_peers.cc:597] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:15.807898 20756 tablet_replica.cc:333] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.808920 20756 raft_consensus.cc:2243] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.813572 20756 raft_consensus.cc:2272] T 6c93691583c1413ca9d0cb9e64fbd7cd P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.818476 21914 consensus_peers.cc:597] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:15.829535 20756 tablet_replica.cc:333] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.830621 20756 raft_consensus.cc:2243] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.831660 20756 raft_consensus.cc:2272] T 82fae287aad247d99c33e1a07c6e82a3 P 61893f17f34b4cc9b898114d3c0a7023 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.834944 20756 tablet_replica.cc:333] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.838048 20756 raft_consensus.cc:2243] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.840257 20756 raft_consensus.cc:2272] T da1dbb318a2c4a44b440673a00d826d1 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.844292 20756 tablet_replica.cc:333] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.845228 20756 raft_consensus.cc:2243] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.846315 20756 raft_consensus.cc:2272] T 81a928ac9f854ce1bcb7c9b78983b84f P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.849474 20756 tablet_replica.cc:333] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.850345 20756 raft_consensus.cc:2243] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.851402 20756 raft_consensus.cc:2272] T 2eddf7375a2842f7bbfd9ab2061e0027 P 61893f17f34b4cc9b898114d3c0a7023 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.867394 20756 tablet_replica.cc:333] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.868389 20756 raft_consensus.cc:2243] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:09:15.873071 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:15.889792 20756 raft_consensus.cc:2272] T f9fc717cf49c47969c86d6c23778f56c P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.893029 20756 tablet_replica.cc:333] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.894083 20756 raft_consensus.cc:2243] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.894876 20756 raft_consensus.cc:2272] T a3f11dd69f214cd6b7b169181c1a910b P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.895375 21914 consensus_peers.cc:597] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:15.897971 20756 tablet_replica.cc:333] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.899304 20756 raft_consensus.cc:2243] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.901489 20756 raft_consensus.cc:2272] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.911441 20756 tablet_replica.cc:333] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.912441 20756 raft_consensus.cc:2243] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.913761 20756 raft_consensus.cc:2272] T c64648f65a9248d0b9e34c739a250e4c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.924420 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:15.924860 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:15.925242 20756 tablet_replica.cc:333] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
W20260709 13:09:15.930387 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:15.930945 20756 raft_consensus.cc:2243] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.931639 20756 raft_consensus.cc:2272] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.934665 20756 tablet_replica.cc:333] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.935482 20756 raft_consensus.cc:2243] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.936236 20756 raft_consensus.cc:2272] T 590d7eea40954779924038b15b716b58 P 61893f17f34b4cc9b898114d3c0a7023 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.939414 20756 tablet_replica.cc:333] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.945290 20756 raft_consensus.cc:2243] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.946748 20756 raft_consensus.cc:2272] T 3bdea259b2284b5c9cec755539e72888 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.949957 20756 tablet_replica.cc:333] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.957404 20756 raft_consensus.cc:2243] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.958237 20756 raft_consensus.cc:2272] T 41144a85d9d645d9a3eb3ef87b761a44 P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.961315 20756 tablet_replica.cc:333] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.962347 20756 raft_consensus.cc:2243] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.965027 20756 raft_consensus.cc:2272] T e3fd785266e045ce9ae6bb7160866b9d P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.968055 20756 tablet_replica.cc:333] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.973429 20756 raft_consensus.cc:2243] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.974617 20756 raft_consensus.cc:2272] T ad0b6a949ee94dddab00a0afe84da820 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.983161 20756 tablet_replica.cc:333] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.984208 20756 raft_consensus.cc:2243] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.984982 20756 raft_consensus.cc:2272] T 2f51668452ae440fa9267f7cb2f597c9 P 61893f17f34b4cc9b898114d3c0a7023 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.988045 20756 tablet_replica.cc:333] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:15.993554 20756 raft_consensus.cc:2243] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.994494 20756 raft_consensus.cc:2272] T b185f97673b24433b4222ebdebb6f211 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.003577 20756 tablet_replica.cc:333] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.004578 20756 raft_consensus.cc:2243] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.005347 20756 raft_consensus.cc:2272] T cb3ae54bf5ef462ba44e223978c42103 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.176537 20756 tablet_replica.cc:333] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.179157 20756 raft_consensus.cc:2243] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.183221 20756 raft_consensus.cc:2272] T 4a9fbee4e9e94929bc4675f1e7f4384d P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.215121 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:16.220971 29095 raft_consensus.cc:493] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:16.256932 20756 tablet_replica.cc:333] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.222146 29095 raft_consensus.cc:515] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:16.269701 29153 raft_consensus.cc:493] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:16.271054 20756 raft_consensus.cc:2243] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.281026 29095 leader_election.cc:290] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:16.282523 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:16.307698 20756 raft_consensus.cc:2272] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.320996 29153 raft_consensus.cc:515] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:16.331390 29157 raft_consensus.cc:493] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:09:16.360576 29155 raft_consensus.cc:493] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:09:16.362375 29155 raft_consensus.cc:515] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:16.372136 29157 raft_consensus.cc:515] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:16.324378 29153 leader_election.cc:290] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:16.387646 29095 raft_consensus.cc:493] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:09:16.392115 29095 raft_consensus.cc:515] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:16.389660 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33dbfc0299d475ebf12544cb959443d" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:16.397125 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e067dbcd1ae14ea1a16378539be836cb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
W20260709 13:09:16.407678 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38039, user_credentials={real_user=slave}} blocked reactor thread for 92301.5us
I20260709 13:09:16.413352 29095 leader_election.cc:290] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:09:16.423588 29153 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:16.430778 20756 tablet_replica.cc:333] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.424485 29153 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:16.440085 29153 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:09:16.434682 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:16.432312 20756 raft_consensus.cc:2243] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.430778 29157 leader_election.cc:290] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:09:16.449119 21988 consensus_peers.cc:597] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:16.444343 29155 leader_election.cc:290] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:09:16.450736 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:16.461567 20756 raft_consensus.cc:2272] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.464805 29155 raft_consensus.cc:493] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:16.468075 29155 raft_consensus.cc:515] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:09:16.473078 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:16.477167 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dafb6252675441ca7ff8bf9e864644c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:16.484997 29155 leader_election.cc:290] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:16.501248 20756 tablet_replica.cc:333] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.528368 29155 raft_consensus.cc:493] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:09:16.529770 29095 raft_consensus.cc:493] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bcc802f7bc374bed98e2ee0596a8ebda)
I20260709 13:09:16.531253 29095 raft_consensus.cc:515] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:16.533464 29095 leader_election.cc:290] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:09:16.535045 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:16.539848 29155 raft_consensus.cc:515] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:16.540855 20756 raft_consensus.cc:2243] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.542537 20756 raft_consensus.cc:2272] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.544276 29155 leader_election.cc:290] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:09:16.537626 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:16.551189 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd12cba9f1b74b1b908b1d598ca51a8c" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:16.552009 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54fabc2ab3354c0ab4e0d3f4670eb221" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:16.553649 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af1794ba4454baf843df541f302e8e0" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:16.554316 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2be7847b8c4a19be52a47f4a860ceb" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:16.556165 22601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a6203a9eab4b71b33f702b49f0945f" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:16.556584 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9152786e68fb4b41a29fa44da39a923a" candidate_uuid: "61893f17f34b4cc9b898114d3c0a7023" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:16.564020 20756 tablet_replica.cc:333] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.566148 20756 raft_consensus.cc:2243] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.584510 20756 raft_consensus.cc:2272] T a6be2f940d334bd0b3c9d1b89bc17d2f P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.610142 21914 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:09:16.611250 29155 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:16.614239 21914 leader_election.cc:304] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:09:16.615150 29155 raft_consensus.cc:2749] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:16.617234 21914 leader_election.cc:304] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:09:16.620026 29155 raft_consensus.cc:2749] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:16.623230 20756 tablet_replica.cc:333] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.624318 20756 raft_consensus.cc:2243] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:16.625644 21914 leader_election.cc:336] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:16.626243 21914 leader_election.cc:304] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:09:16.627028 21914 raft_consensus.cc:2686] T f33dbfc0299d475ebf12544cb959443d P 61893f17f34b4cc9b898114d3c0a7023: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:09:16.627801 21914 leader_election.cc:336] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:16.628274 21914 leader_election.cc:304] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:16.629072 29155 raft_consensus.cc:2749] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:16.632030 21914 leader_election.cc:336] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:16.632524 21914 leader_election.cc:304] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:09:16.633363 29155 raft_consensus.cc:2749] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:16.634274 21914 leader_election.cc:336] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:16.634711 21914 leader_election.cc:304] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:09:16.635319 21914 raft_consensus.cc:2686] T 5af1794ba4454baf843df541f302e8e0 P 61893f17f34b4cc9b898114d3c0a7023: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:09:16.635905 21914 leader_election.cc:336] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:16.636296 21914 leader_election.cc:304] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:16.637040 29155 raft_consensus.cc:2749] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:16.638319 21914 leader_election.cc:336] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:16.638767 21914 leader_election.cc:304] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61893f17f34b4cc9b898114d3c0a7023; no voters: 95296a4420ed41b69191d3d4353cf2b0, bcc802f7bc374bed98e2ee0596a8ebda
W20260709 13:09:16.639374 21914 raft_consensus.cc:2686] T b7a6203a9eab4b71b33f702b49f0945f P 61893f17f34b4cc9b898114d3c0a7023: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:16.643277 20756 raft_consensus.cc:2272] T 2f2be7847b8c4a19be52a47f4a860ceb P 61893f17f34b4cc9b898114d3c0a7023 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.646632 20756 tablet_replica.cc:333] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.647563 20756 raft_consensus.cc:2243] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.649793 20756 raft_consensus.cc:2272] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.653514 20756 tablet_replica.cc:333] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.654321 20756 raft_consensus.cc:2243] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.655330 20756 raft_consensus.cc:2272] T 7dafb6252675441ca7ff8bf9e864644c P 61893f17f34b4cc9b898114d3c0a7023 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.658869 20756 tablet_replica.cc:333] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.659890 20756 raft_consensus.cc:2243] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.662284 20756 raft_consensus.cc:2272] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.665556 20756 tablet_replica.cc:333] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.666585 20756 raft_consensus.cc:2243] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.667910 20756 raft_consensus.cc:2272] T bd12cba9f1b74b1b908b1d598ca51a8c P 61893f17f34b4cc9b898114d3c0a7023 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.671372 20756 tablet_replica.cc:333] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.672170 20756 raft_consensus.cc:2243] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.673861 20756 raft_consensus.cc:2272] T e067dbcd1ae14ea1a16378539be836cb P 61893f17f34b4cc9b898114d3c0a7023 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.678769 20756 tablet_replica.cc:333] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.679621 20756 raft_consensus.cc:2243] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.680572 20756 raft_consensus.cc:2272] T 9152786e68fb4b41a29fa44da39a923a P 61893f17f34b4cc9b898114d3c0a7023 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.685743 20756 tablet_replica.cc:333] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023: stopping tablet replica
I20260709 13:09:16.686559 20756 raft_consensus.cc:2243] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:16.688071 20756 raft_consensus.cc:2272] T 20e7b7ab39a74ba88aa5a6259c522f73 P 61893f17f34b4cc9b898114d3c0a7023 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.707391 29149 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:16.708218 29149 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:09:16.730893 22573 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.736469 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:16.738660 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:16.739912 29150 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:09:16.755142 29149 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:16.826609 21988 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:16.843523 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:16.849476 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:16.883214 29158 raft_consensus.cc:493] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:16.884243 29158 raft_consensus.cc:515] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:16.884771 29139 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:16.885521 29139 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:16.886683 29158 leader_election.cc:290] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:09:16.887588 29139 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:16.898339 21988 leader_election.cc:336] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:16.899030 21988 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:16.900982 21987 leader_election.cc:336] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.904102 21987 leader_election.cc:304] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:16.904963 29158 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:16.905550 29158 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:16.908068 29158 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:09:16.910296 21987 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.911294 21987 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:16.914013 29158 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:16.910841 29139 raft_consensus.cc:2749] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.916707 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:16.917346 22607 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 28.
I20260709 13:09:16.927599 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
W20260709 13:09:16.931574 21987 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.942879 29158 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:09:16.943488 29158 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:16.943955 29158 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:16.948096 29139 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:16.948865 29139 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:16.951339 29139 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:09:16.953769 21988 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:16.967702 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:09:16.976382 21987 leader_election.cc:336] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:16.977001 21987 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:09:16.981175 29164 raft_consensus.cc:2749] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:17.002246 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:16.999564 29158 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.015730 29139 raft_consensus.cc:493] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.016420 29139 raft_consensus.cc:515] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:17.019140 29139 leader_election.cc:290] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:09:17.020162 29158 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 29 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:09:17.023242 22607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baa5a75e229412297990ddc378b6aad" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda"
I20260709 13:09:17.027367 22607 raft_consensus.cc:3060] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:09:17.036010 22607 raft_consensus.cc:2468] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 29.
W20260709 13:09:17.040279 21987 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.046180 29158 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.048285 29158 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:17.053040 21988 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:09:17.055543 21988 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:17.055857 21987 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.056495 29139 raft_consensus.cc:2804] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:09:17.060925 29139 raft_consensus.cc:697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 29 LEADER]: Becoming Leader. State: Replica: 51e52b544fab4275aab4f7fbe81942d2, State: Running, Role: LEADER
I20260709 13:09:17.062170 29139 consensus_queue.cc:237] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 28.21, Last appended by leader: 21, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.063927 29161 raft_consensus.cc:493] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.064589 29161 raft_consensus.cc:515] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:17.066936 29161 leader_election.cc:290] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:09:17.069206 29158 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:17.080689 21988 leader_election.cc:336] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:17.086751 21988 leader_election.cc:304] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.085157 29158 raft_consensus.cc:493] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.087656 29161 raft_consensus.cc:2749] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:17.091856 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:17.087867 29158 raft_consensus.cc:515] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:09:17.100899 21987 leader_election.cc:336] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.102593 21987 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.101876 29158 leader_election.cc:290] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:09:17.125042 29158 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.125825 29158 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:17.126222 29139 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.126902 29139 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.127789 21765 catalog_manager.cc:5697] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 reported cstate change: term changed from 28 to 29, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3). New cstate: current_term: 29 leader_uuid: "51e52b544fab4275aab4f7fbe81942d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.129144 29139 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:09:17.130595 29159 raft_consensus.cc:493] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.131193 29159 raft_consensus.cc:515] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:17.133255 29159 leader_election.cc:290] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:17.134706 21987 leader_election.cc:336] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.130142 29158 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:17.147347 21987 leader_election.cc:336] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.148097 21987 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.148978 21987 leader_election.cc:336] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.151804 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:17.155462 29152 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.156154 29152 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.158087 21988 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:09:17.159525 29152 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:17.159585 21988 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:17.160254 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.160462 29161 raft_consensus.cc:2749] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:17.163244 22573 leader_election.cc:336] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.175057 29166 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:17.175215 21988 leader_election.cc:336] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:17.175761 21988 leader_election.cc:304] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.176396 29166 raft_consensus.cc:2749] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:17.179924 29152 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.180657 29152 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.183446 29152 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:17.187645 22573 leader_election.cc:336] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.191241 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:17.192996 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:17.193709 22015 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
I20260709 13:09:17.195089 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:17.195650 22015 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 18.
I20260709 13:09:17.198890 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:17.200098 29152 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:17.200524 29152 raft_consensus.cc:493] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.201014 29152 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:17.222117 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:17.225392 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:09:17.227619 21988 leader_election.cc:336] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:17.228176 21988 leader_election.cc:304] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:09:17.229418 21988 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:17.229872 29163 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:17.229979 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.215318 29152 raft_consensus.cc:515] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.230427 29163 raft_consensus.cc:493] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.230912 29163 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:17.231271 29166 raft_consensus.cc:2749] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:17.232208 29161 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:17.232399 21988 leader_election.cc:336] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:17.235836 21988 leader_election.cc:304] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.236784 29166 raft_consensus.cc:2749] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:17.239729 22573 leader_election.cc:336] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.241554 29152 leader_election.cc:290] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:17.242847 29163 raft_consensus.cc:515] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.244750 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f8c3db69fa448a9f5e5d132c33b414" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:09:17.245447 22015 raft_consensus.cc:3060] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.246091 29166 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.246780 29166 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:17.249495 29166 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:09:17.252651 29152 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:09:17.253613 21987 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.253597 29152 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.256208 22015 raft_consensus.cc:2468] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
W20260709 13:09:17.267030 21988 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:17.260810 22573 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:17.269618 22574 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:17.270583 22574 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.271571 29136 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:17.276837 29152 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:17.277333 22573 leader_election.cc:336] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.277379 29163 leader_election.cc:290] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:17.274861 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.279233 29166 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:17.281772 22576 leader_election.cc:304] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:17.284403 29163 raft_consensus.cc:2804] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:17.285454 29163 raft_consensus.cc:697] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:09:17.296844 22015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aeb7bdadb4e4d378fb5799fdc7eaa72" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:09:17.297521 22015 raft_consensus.cc:3060] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:17.297844 29163 consensus_queue.cc:237] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.305361 29166 raft_consensus.cc:493] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.305863 22015 raft_consensus.cc:2468] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 19.
I20260709 13:09:17.306099 29166 raft_consensus.cc:515] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:09:17.315511 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:17.317340 21987 leader_election.cc:336] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:17.319468 29166 leader_election.cc:290] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:17.330204 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:17.362579 22576 leader_election.cc:304] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:17.364102 29136 raft_consensus.cc:2804] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:17.364916 29136 raft_consensus.cc:697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:09:17.365996 29136 consensus_queue.cc:237] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.402297 21765 catalog_manager.cc:5697] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 15 to 16, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 16 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:17.403245 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:17.404362 21765 catalog_manager.cc:5697] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 18 to 19, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 19 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:17.462195 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:17.466351 21988 leader_election.cc:336] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:17.473943 21988 leader_election.cc:304] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.483598 29166 raft_consensus.cc:2749] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:17.531208 22573 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.541867 21988 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:17.542726 21988 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:17.543408 21988 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:17.547987 22606 raft_consensus.cc:1275] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Refusing update from remote peer 51e52b544fab4275aab4f7fbe81942d2: Log matching property violated. Preceding OpId in replica: term: 28 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
W20260709 13:09:17.566293 21988 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:17.577080 29166 consensus_queue.cc:1048] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
W20260709 13:09:17.601750 21988 consensus_peers.cc:597] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.610775 21987 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.613986 21987 consensus_peers.cc:597] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.648999 21987 consensus_peers.cc:597] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.665897 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:17.751422 22023 raft_consensus.cc:1275] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:17.753340 29136 consensus_queue.cc:1048] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:09:17.772178 22573 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.776240 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:17.792192 29163 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.793488 29163 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:09:17.797816 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:17.792884 21988 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:17.805016 22574 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:17.819833 22573 consensus_peers.cc:597] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.832512 21987 consensus_peers.cc:597] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.836305 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:17.821277 29163 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:17.850009 22576 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.850917 29181 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:17.853922 22573 consensus_peers.cc:597] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.877203 21987 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.884532 22573 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
W20260709 13:09:17.885576 22573 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.886081 22573 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.891597 29177 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:09:17.892303 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:17.892246 29177 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:17.893843 29176 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:17.894441 29176 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:09:17.897851 22573 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.898420 29176 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
W20260709 13:09:17.899358 22573 consensus_peers.cc:597] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.899855 21987 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.900933 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
W20260709 13:09:17.908717 21987 leader_election.cc:336] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:17.910523 29177 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:09:17.912431 21988 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:09:17.914191 29176 raft_consensus.cc:2749] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:17.920881 22573 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.930431 21987 consensus_peers.cc:597] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.933521 22017 raft_consensus.cc:1275] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Refusing update from remote peer bcc802f7bc374bed98e2ee0596a8ebda: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:09:17.938158 21987 consensus_peers.cc:597] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.938812 21987 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:17.945703 22606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e697f6ebda4eec99aeb32b72b9bfa4" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:17.946412 22606 raft_consensus.cc:2468] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e52b544fab4275aab4f7fbe81942d2 in term 18.
I20260709 13:09:17.950208 29181 consensus_queue.cc:1048] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Connected to new peer: Peer: permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:09:17.953142 22573 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.948115 21988 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:17.957893 21987 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.958228 21988 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:17.959477 29176 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:17.977242 21987 consensus_peers.cc:597] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.990576 21988 consensus_peers.cc:597] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:18.016253 21987 consensus_peers.cc:597] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:18.049170 29161 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:18.049786 29161 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:18.051925 29161 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4:41571)
I20260709 13:09:18.052906 22604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "51e52b544fab4275aab4f7fbe81942d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" is_pre_election: true
I20260709 13:09:18.056579 29136 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:18.057205 29136 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:18.059409 29136 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:18.061537 21987 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:18.061781 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:18.062172 21987 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, bcc802f7bc374bed98e2ee0596a8ebda
I20260709 13:09:18.062451 22022 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 16.
I20260709 13:09:18.063745 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 
I20260709 13:09:18.064384 29161 raft_consensus.cc:2749] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:18.065984 29136 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:18.066483 29136 raft_consensus.cc:493] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
W20260709 13:09:18.068265 22573 leader_election.cc:336] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:18.068385 29136 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:18.074751 22573 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:18.066361 21987 consensus_peers.cc:597] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:18.092118 29136 raft_consensus.cc:515] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:09:18.118758 22573 leader_election.cc:336] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:18.120507 29136 leader_election.cc:290] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:18.123289 29183 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:18.123885 29183 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:18.126368 29183 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:18.137266 22573 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:18.138418 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6be2f940d334bd0b3c9d1b89bc17d2f" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
W20260709 13:09:18.240190 21987 consensus_peers.cc:597] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:18.240728 21987 consensus_peers.cc:597] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:18.245698 22017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2" is_pre_election: true
I20260709 13:09:18.246392 22017 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 14.
W20260709 13:09:18.272686 22573 consensus_peers.cc:597] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:18.273226 22573 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:18.273651 22573 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:18.283226 22022 raft_consensus.cc:3060] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:18.294685 22022 raft_consensus.cc:2468] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 17.
W20260709 13:09:18.298943 21987 consensus_peers.cc:597] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:18.300957 22576 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:18.302170 22576 leader_election.cc:304] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:18.306840 29182 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:18.307312 29182 raft_consensus.cc:493] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Starting leader election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:18.307708 29182 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:18.306877 29152 raft_consensus.cc:2804] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:18.309264 29152 raft_consensus.cc:697] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:09:18.310204 29152 consensus_queue.cc:237] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:09:18.315335 21988 consensus_peers.cc:597] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:18.315878 29182 raft_consensus.cc:515] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:18.318074 29182 leader_election.cc:290] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Requested vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:18.319708 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e7b7ab39a74ba88aa5a6259c522f73" candidate_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "51e52b544fab4275aab4f7fbe81942d2"
I20260709 13:09:18.320291 22022 raft_consensus.cc:3060] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:18.343518 21987 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:18.350598 22573 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:18.351212 22022 raft_consensus.cc:2468] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcc802f7bc374bed98e2ee0596a8ebda in term 15.
W20260709 13:09:18.352010 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:18.351444 21765 catalog_manager.cc:5697] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 16 to 17, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 17 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:18.355171 22573 leader_election.cc:336] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:18.366127 22576 leader_election.cc:304] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2, bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:18.366962 29182 raft_consensus.cc:2804] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:18.367449 29182 raft_consensus.cc:697] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Becoming Leader. State: Replica: bcc802f7bc374bed98e2ee0596a8ebda, State: Running, Role: LEADER
I20260709 13:09:18.368384 29182 consensus_queue.cc:237] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:09:18.424702 21988 consensus_peers.cc:597] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:18.424978 21987 consensus_peers.cc:597] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:18.433286 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:09:18.446372 21765 catalog_manager.cc:5697] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda reported cstate change: term changed from 14 to 15, leader changed from 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2) to bcc802f7bc374bed98e2ee0596a8ebda (127.20.69.4). New cstate: current_term: 15 leader_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:18.495190 21987 consensus_peers.cc:597] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:18.498188 20756 tablet_server.cc:196] TabletServer@127.20.69.2:0 shutdown complete.
W20260709 13:09:18.502734 21988 consensus_peers.cc:597] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:18.508025 29166 raft_consensus.cc:493] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:18.508688 29166 raft_consensus.cc:515] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:18.511837 29166 leader_election.cc:290] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:18.518139 21987 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
W20260709 13:09:18.520639 21988 leader_election.cc:336] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:18.523408 21988 leader_election.cc:304] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:18.525323 29166 raft_consensus.cc:2749] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:18.569072 21987 consensus_peers.cc:597] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:18.645747 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:18.652350 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:18.672616 20756 tablet_server.cc:179] TabletServer@127.20.69.3:0 shutting down...
I20260709 13:09:18.789220 29185 raft_consensus.cc:493] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:18.789834 29185 raft_consensus.cc:515] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:18.792315 29185 leader_election.cc:290] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:09:18.836726 29166 raft_consensus.cc:493] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:18.838347 29166 raft_consensus.cc:515] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
W20260709 13:09:18.882336 21987 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:18.840471 29166 leader_election.cc:290] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:18.890143 21987 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
W20260709 13:09:18.892370 21988 consensus_peers.cc:597] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:18.892917 21988 leader_election.cc:336] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:18.893599 21988 leader_election.cc:304] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:18.895944 29166 raft_consensus.cc:493] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:18.901728 29166 raft_consensus.cc:515] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } }
I20260709 13:09:18.904012 29166 leader_election.cc:290] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:09:18.907269 29166 raft_consensus.cc:2749] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:18.914423 21987 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
W20260709 13:09:18.917670 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:18.926319 22573 consensus_peers.cc:597] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.930027 21988 consensus_peers.cc:597] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:09:18.932523 22573 consensus_peers.cc:597] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.932808 21988 leader_election.cc:336] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:18.936826 21988 leader_election.cc:304] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:18.937812 29193 raft_consensus.cc:2749] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:18.941088 22576 consensus_peers.cc:597] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.941704 22576 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.942245 22576 consensus_peers.cc:597] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.947376 21988 leader_election.cc:336] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:18.949504 21988 leader_election.cc:304] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51e52b544fab4275aab4f7fbe81942d2; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:18.950311 29166 raft_consensus.cc:2749] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:18.959221 22576 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.959897 22576 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.960407 22576 consensus_peers.cc:597] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.962227 22576 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.963613 22576 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.972363 22576 consensus_peers.cc:597] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.978824 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:18.980001 20756 tablet_replica.cc:333] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:18.981122 20756 raft_consensus.cc:2243] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.982447 20756 raft_consensus.cc:2272] T 080e5fa3988746d88e6350506ed3b136 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.985440 20756 tablet_replica.cc:333] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:18.986265 20756 raft_consensus.cc:2243] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:18.986872 20756 raft_consensus.cc:2272] T 105015b2b463442ab34e0509af7105fb P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.990477 20756 tablet_replica.cc:333] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:18.991310 20756 raft_consensus.cc:2243] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.992764 20756 raft_consensus.cc:2272] T e8f816617b58480bad6550570b514d80 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:18.995551 20756 tablet_replica.cc:333] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:18.996353 20756 raft_consensus.cc:2243] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:18.997614 20756 raft_consensus.cc:2272] T 866936931060464d858e0e11cefba859 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.003206 20756 tablet_replica.cc:333] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.004177 20756 raft_consensus.cc:2243] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:19.005813 22576 consensus_peers.cc:597] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.006801 20756 raft_consensus.cc:2272] T 23093b4e74d34b3d87ab577135fa1517 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.009925 20756 tablet_replica.cc:333] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.010848 20756 raft_consensus.cc:2243] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.011713 20756 raft_consensus.cc:2272] T 7eeff5779b544ebaac041e407041b284 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.014516 20756 tablet_replica.cc:333] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.017568 20756 raft_consensus.cc:2243] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.019634 20756 raft_consensus.cc:2272] T a2e697f6ebda4eec99aeb32b72b9bfa4 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.022547 20756 tablet_replica.cc:333] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.024878 20756 raft_consensus.cc:2243] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.025660 20756 raft_consensus.cc:2272] T 5d092f1c41e747e194d93526c0fad944 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.028126 20756 tablet_replica.cc:333] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.028854 20756 raft_consensus.cc:2243] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.029313 20756 raft_consensus.cc:2272] T f8f8c3db69fa448a9f5e5d132c33b414 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.031177 20756 tablet_replica.cc:333] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.031741 20756 raft_consensus.cc:2243] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.032279 20756 raft_consensus.cc:2272] T 535d3d7bb32243b6b555376404412d8c P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.035142 20756 tablet_replica.cc:333] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.035729 20756 raft_consensus.cc:2243] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.036231 20756 raft_consensus.cc:2272] T 7685d376b61d438aa76f16fe47a7846d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.038517 20756 tablet_replica.cc:333] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.039139 20756 raft_consensus.cc:2243] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.039678 20756 raft_consensus.cc:2272] T 4a9fbee4e9e94929bc4675f1e7f4384d P 51e52b544fab4275aab4f7fbe81942d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.041952 20756 tablet_replica.cc:333] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.042619 20756 raft_consensus.cc:2243] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.043816 20756 raft_consensus.cc:2272] T b185f97673b24433b4222ebdebb6f211 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.047144 20756 tablet_replica.cc:333] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.048044 20756 raft_consensus.cc:2243] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.049510 20756 raft_consensus.cc:2272] T ca34a4d332f1434f8089d28952415e70 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.052331 20756 tablet_replica.cc:333] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.053098 20756 raft_consensus.cc:2243] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.055052 20756 raft_consensus.cc:2272] T 761d07666b514c36bcf7826ed77f8d8b P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.057545 20756 tablet_replica.cc:333] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.058174 20756 raft_consensus.cc:2243] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.059232 20756 raft_consensus.cc:2272] T 8d57015ad0d14c41a8a97e3c1e1d63f4 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.061785 20756 tablet_replica.cc:333] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.062650 20756 raft_consensus.cc:2243] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.063824 20756 raft_consensus.cc:2272] T 7baa5a75e229412297990ddc378b6aad P 51e52b544fab4275aab4f7fbe81942d2 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.066624 20756 tablet_replica.cc:333] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.067576 20756 raft_consensus.cc:2243] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.068320 20756 raft_consensus.cc:2272] T ade18365d2864739b70e41ba62311466 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.071009 20756 tablet_replica.cc:333] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.071834 20756 raft_consensus.cc:2243] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.072659 20756 raft_consensus.cc:2272] T 1b7ba79f0d534cbba2170f41c42625e6 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.073004 29198 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:19.073630 29198 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:19.075449 20756 tablet_replica.cc:333] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.075851 29198 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
I20260709 13:09:19.076288 20756 raft_consensus.cc:2243] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.078510 20756 raft_consensus.cc:2272] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.081396 20756 tablet_replica.cc:333] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.082391 20756 raft_consensus.cc:2243] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.083009 20756 raft_consensus.cc:2272] T b83eb73076f949419556cb7ef3746784 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.085752 20756 tablet_replica.cc:333] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
W20260709 13:09:19.086021 22574 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:19.086568 20756 raft_consensus.cc:2243] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.087731 20756 raft_consensus.cc:2272] T 06e4c126dc6f477daa840b84b452bb59 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.090699 20756 tablet_replica.cc:333] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.091534 20756 raft_consensus.cc:2243] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.092157 20756 raft_consensus.cc:2272] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.094511 22576 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.095386 20756 tablet_replica.cc:333] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.096302 20756 raft_consensus.cc:2243] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.097425 20756 raft_consensus.cc:2272] T 82fae287aad247d99c33e1a07c6e82a3 P 51e52b544fab4275aab4f7fbe81942d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.100203 20756 tablet_replica.cc:333] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.101069 20756 raft_consensus.cc:2243] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.102339 20756 raft_consensus.cc:2272] T da1dbb318a2c4a44b440673a00d826d1 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.105167 20756 tablet_replica.cc:333] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.106307 20756 raft_consensus.cc:2243] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.107803 22573 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:19.107987 20756 raft_consensus.cc:2272] T 81a928ac9f854ce1bcb7c9b78983b84f P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.108518 22573 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:19.109416 29198 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:19.111223 20756 tablet_replica.cc:333] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.112002 20756 raft_consensus.cc:2243] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.112728 20756 raft_consensus.cc:2272] T 2eddf7375a2842f7bbfd9ab2061e0027 P 51e52b544fab4275aab4f7fbe81942d2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.115478 20756 tablet_replica.cc:333] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.116331 20756 raft_consensus.cc:2243] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:19.117064 22576 consensus_peers.cc:597] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.117213 20756 raft_consensus.cc:2272] T 04a8fcd2517b44a4895a7b0ec8966a41 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.119421 20756 tablet_replica.cc:333] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.120023 20756 raft_consensus.cc:2243] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.121059 20756 raft_consensus.cc:2272] T f5f518749c784001a1f5106719d0b72f P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.123279 20756 tablet_replica.cc:333] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.123848 20756 raft_consensus.cc:2243] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.124377 20756 raft_consensus.cc:2272] T 3bdea259b2284b5c9cec755539e72888 P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.126744 20756 tablet_replica.cc:333] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.127660 20756 raft_consensus.cc:2243] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.128747 20756 raft_consensus.cc:2272] T 41144a85d9d645d9a3eb3ef87b761a44 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.131403 20756 tablet_replica.cc:333] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.132123 20756 raft_consensus.cc:2243] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.132792 20756 raft_consensus.cc:2272] T eda002bd6903433da20d221420291f1e P 51e52b544fab4275aab4f7fbe81942d2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.134878 20756 tablet_replica.cc:333] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.135463 20756 raft_consensus.cc:2243] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.136883 20756 raft_consensus.cc:2272] T 130319e952f14561b08ef212107e1666 P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.139434 20756 tablet_replica.cc:333] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.140208 20756 raft_consensus.cc:2243] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.140864 20756 raft_consensus.cc:2272] T 8a809fa455ae4f1e908dd7d0f1f2ee8f P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.143599 20756 tablet_replica.cc:333] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.144398 20756 raft_consensus.cc:2243] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.145043 20756 raft_consensus.cc:2272] T c64648f65a9248d0b9e34c739a250e4c P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.147431 20756 tablet_replica.cc:333] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.148075 20756 raft_consensus.cc:2243] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.149237 20756 raft_consensus.cc:2272] T 590d7eea40954779924038b15b716b58 P 51e52b544fab4275aab4f7fbe81942d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.151731 20756 tablet_replica.cc:333] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
W20260709 13:09:19.151929 21804 debug-util.cc:398] Leaking SignalData structure 0x7b0800177660 after lost signal to thread 20759
I20260709 13:09:19.152426 20756 raft_consensus.cc:2243] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.153016 21804 debug-util.cc:398] Leaking SignalData structure 0x7b080013a9e0 after lost signal to thread 21807
I20260709 13:09:19.153574 20756 raft_consensus.cc:2272] T a3f11dd69f214cd6b7b169181c1a910b P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.154410 21804 debug-util.cc:398] Leaking SignalData structure 0x7b08000dae40 after lost signal to thread 22048
I20260709 13:09:19.156212 20756 tablet_replica.cc:333] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.157037 20756 raft_consensus.cc:2243] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.158085 20756 raft_consensus.cc:2272] T 2f51668452ae440fa9267f7cb2f597c9 P 51e52b544fab4275aab4f7fbe81942d2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.160732 20756 tablet_replica.cc:333] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.161479 20756 raft_consensus.cc:2243] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.162686 20756 raft_consensus.cc:2272] T f33dbfc0299d475ebf12544cb959443d P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.163160 22576 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.165498 20756 tablet_replica.cc:333] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
W20260709 13:09:19.165850 21804 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2a80 after lost signal to thread 22634
I20260709 13:09:19.166323 20756 raft_consensus.cc:2243] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.168905 20756 raft_consensus.cc:2272] T a6be2f940d334bd0b3c9d1b89bc17d2f P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.171772 20756 tablet_replica.cc:333] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.172564 20756 raft_consensus.cc:2243] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.173393 20756 raft_consensus.cc:2272] T 65033a7eefd242a796408c7d54fed332 P 51e52b544fab4275aab4f7fbe81942d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.176079 20756 tablet_replica.cc:333] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.176913 20756 raft_consensus.cc:2243] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:19.176855 22576 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.177748 20756 raft_consensus.cc:2272] T 2f2be7847b8c4a19be52a47f4a860ceb P 51e52b544fab4275aab4f7fbe81942d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.180514 20756 tablet_replica.cc:333] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.181322 20756 raft_consensus.cc:2243] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.182567 20756 raft_consensus.cc:2272] T 54fabc2ab3354c0ab4e0d3f4670eb221 P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.185401 20756 tablet_replica.cc:333] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.186206 20756 raft_consensus.cc:2243] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.187434 20756 raft_consensus.cc:2272] T e067dbcd1ae14ea1a16378539be836cb P 51e52b544fab4275aab4f7fbe81942d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.190600 20756 tablet_replica.cc:333] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.191363 20756 raft_consensus.cc:2243] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.192029 20756 raft_consensus.cc:2272] T 9152786e68fb4b41a29fa44da39a923a P 51e52b544fab4275aab4f7fbe81942d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.195058 20756 tablet_replica.cc:333] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.195776 20756 raft_consensus.cc:2243] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.196890 20756 raft_consensus.cc:2272] T 7dafb6252675441ca7ff8bf9e864644c P 51e52b544fab4275aab4f7fbe81942d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.199710 20756 tablet_replica.cc:333] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2: stopping tablet replica
I20260709 13:09:19.200496 20756 raft_consensus.cc:2243] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.201601 20756 raft_consensus.cc:2272] T 20e7b7ab39a74ba88aa5a6259c522f73 P 51e52b544fab4275aab4f7fbe81942d2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.299800 22574 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:19.382433 22573 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111) [suppressed 701 similar messages]
W20260709 13:09:19.421500 22574 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:19.552048 22574 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:19.772686 22573 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:19.791694 22574 consensus_peers.cc:597] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:19.816056 22574 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:19.848701 22631 debug-util.cc:398] Leaking SignalData structure 0x7b0800204780 after lost signal to thread 20759
W20260709 13:09:19.849944 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08000b65a0 after lost signal to thread 21807
W20260709 13:09:19.851233 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3500 after lost signal to thread 22048
W20260709 13:09:19.852546 22631 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9560 after lost signal to thread 22634
W20260709 13:09:19.892756 22574 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:19.897595 22574 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:19.907573 22574 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:19.919513 22574 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:19.995916 22574 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:20.084345 29198 raft_consensus.cc:493] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.084939 29198 raft_consensus.cc:515] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.087148 29198 leader_election.cc:290] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:20.098153 22574 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:09:20.099081 22573 leader_election.cc:336] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
W20260709 13:09:20.100631 22576 leader_election.cc:336] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
I20260709 13:09:20.101060 22576 leader_election.cc:304] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:20.103765 29195 raft_consensus.cc:2749] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:20.133816 22573 consensus_peers.cc:597] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:20.160722 29198 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.161279 29198 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.163504 29198 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:20.175738 22573 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
W20260709 13:09:20.177613 22576 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
I20260709 13:09:20.178035 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:20.179226 29195 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:09:20.184242 22573 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.212265 22573 consensus_peers.cc:597] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.226667 22573 consensus_peers.cc:597] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.340921 22573 consensus_peers.cc:597] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.356469 22573 consensus_peers.cc:597] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.358397 22574 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:20.375937 22574 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:09:20.410712 29195 raft_consensus.cc:493] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.411253 29195 raft_consensus.cc:515] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.412354 29200 raft_consensus.cc:493] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.412955 29200 raft_consensus.cc:515] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.413771 29195 leader_election.cc:290] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:20.415047 29200 leader_election.cc:290] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:20.415310 22573 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:20.426175 29195 raft_consensus.cc:493] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
W20260709 13:09:20.420073 22576 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
I20260709 13:09:20.426775 29195 raft_consensus.cc:515] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:09:20.427670 22574 leader_election.cc:336] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:20.430524 22574 leader_election.cc:304] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
W20260709 13:09:20.435699 22573 consensus_peers.cc:597] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.436172 22576 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
W20260709 13:09:20.444765 22574 leader_election.cc:336] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:20.437775 29195 leader_election.cc:290] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:20.438586 29200 raft_consensus.cc:2749] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:20.451110 22574 leader_election.cc:304] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:20.453006 29198 raft_consensus.cc:493] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.453583 29198 raft_consensus.cc:515] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.455646 29198 leader_election.cc:290] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:20.456550 29200 raft_consensus.cc:2749] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:20.456774 22576 leader_election.cc:336] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
W20260709 13:09:20.470088 22573 leader_election.cc:336] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:20.471082 22573 leader_election.cc:304] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:20.473913 29200 raft_consensus.cc:2749] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:20.478958 22576 leader_election.cc:336] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
I20260709 13:09:20.479561 29200 raft_consensus.cc:493] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.480855 29200 raft_consensus.cc:515] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.483263 29200 leader_election.cc:290] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:20.485306 22573 consensus_peers.cc:597] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.500202 22576 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
W20260709 13:09:20.505182 22573 leader_election.cc:336] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:20.506048 22573 leader_election.cc:304] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:20.509769 29200 raft_consensus.cc:2749] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:20.522215 22573 consensus_peers.cc:597] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:20.538118 29200 raft_consensus.cc:493] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.538676 29200 raft_consensus.cc:515] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.540963 29200 leader_election.cc:290] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:20.542857 22573 leader_election.cc:336] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:20.545722 29200 raft_consensus.cc:493] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.547082 29200 raft_consensus.cc:515] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } attrs { replace: true } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.550124 29200 leader_election.cc:290] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:20.551064 22573 leader_election.cc:304] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
W20260709 13:09:20.557040 22574 leader_election.cc:336] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:20.565466 29200 raft_consensus.cc:2749] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:20.567775 22576 leader_election.cc:336] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
W20260709 13:09:20.571879 22576 leader_election.cc:336] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
W20260709 13:09:20.581653 22574 consensus_peers.cc:597] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:09:20.583135 22576 leader_election.cc:304] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:20.586037 29200 raft_consensus.cc:2749] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:20.594769 22573 leader_election.cc:336] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:20.605044 22573 leader_election.cc:304] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:20.608160 29200 raft_consensus.cc:493] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:20.611182 29200 raft_consensus.cc:515] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.613960 29200 leader_election.cc:290] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
I20260709 13:09:20.614506 29195 raft_consensus.cc:2749] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:20.615181 22573 leader_election.cc:336] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
W20260709 13:09:20.620424 22574 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:20.633754 22576 leader_election.cc:336] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
I20260709 13:09:20.634567 22576 leader_election.cc:304] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:20.641098 29198 raft_consensus.cc:2749] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:09:20.643344 29200 raft_consensus.cc:493] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:20.643985 29200 raft_consensus.cc:515] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } attrs { replace: true } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:20.651463 29200 leader_election.cc:290] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:20.655776 22574 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
W20260709 13:09:20.659535 22573 consensus_peers.cc:597] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.680016 22576 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
I20260709 13:09:20.681002 22576 leader_election.cc:304] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:20.685365 29200 raft_consensus.cc:2749] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:20.687346 22573 leader_election.cc:336] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
W20260709 13:09:20.774973 22573 consensus_peers.cc:597] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.930584 22574 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:20.961673 22573 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.979063 22573 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:21.003446 22574 consensus_peers.cc:597] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:21.042812 22576 consensus_peers.cc:597] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.076699 22576 consensus_peers.cc:597] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.140443 22576 consensus_peers.cc:597] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.235924 29200 raft_consensus.cc:493] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 61893f17f34b4cc9b898114d3c0a7023)
I20260709 13:09:21.236579 29200 raft_consensus.cc:515] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "95296a4420ed41b69191d3d4353cf2b0" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38039 } } peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
W20260709 13:09:21.243382 22574 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:21.245770 29200 leader_election.cc:290] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039), 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983)
W20260709 13:09:21.257606 22573 leader_election.cc:336] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:21.258229 22573 leader_election.cc:304] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 61893f17f34b4cc9b898114d3c0a7023, 95296a4420ed41b69191d3d4353cf2b0
I20260709 13:09:21.260313 29200 raft_consensus.cc:2749] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:21.325088 22574 consensus_peers.cc:597] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:09:21.331332 22576 consensus_peers.cc:597] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.349953 22574 consensus_peers.cc:597] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:09:21.382998 22576 consensus_peers.cc:597] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.383597 22576 consensus_peers.cc:597] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.403461 22576 consensus_peers.cc:597] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.420729 22573 consensus_peers.cc:597] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.447184 20756 tablet_server.cc:196] TabletServer@127.20.69.3:0 shutdown complete.
W20260709 13:09:21.465873 22576 consensus_peers.cc:597] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.467145 22574 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): Couldn't send request to peer 95296a4420ed41b69191d3d4353cf2b0. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:09:21.504448 22576 consensus_peers.cc:597] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.528306 22576 consensus_peers.cc:597] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.579552 22576 consensus_peers.cc:597] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.612727 20756 tablet_server.cc:179] TabletServer@127.20.69.4:0 shutting down...
W20260709 13:09:21.640348 22576 consensus_peers.cc:597] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:21.669566 22573 consensus_peers.cc:597] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Couldn't send request to peer 61893f17f34b4cc9b898114d3c0a7023. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.696416 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:21.697382 20756 tablet_replica.cc:333] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.698455 20756 raft_consensus.cc:2243] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.699376 20756 raft_consensus.cc:2272] T 54fabc2ab3354c0ab4e0d3f4670eb221 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.702474 20756 tablet_replica.cc:333] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.703300 20756 raft_consensus.cc:2243] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.704505 20756 pending_rounds.cc:70] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: Trying to abort 1 pending ops.
I20260709 13:09:21.704792 20756 pending_rounds.cc:77] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda: Aborting op as it isn't in flight: id { term: 15 index: 14 } timestamp: 7305636079086784512 op_type: NO_OP noop_request { }
I20260709 13:09:21.705215 20756 raft_consensus.cc:2889] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:21.705551 20756 raft_consensus.cc:2272] T 20e7b7ab39a74ba88aa5a6259c522f73 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.708412 20756 tablet_replica.cc:333] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.709273 20756 raft_consensus.cc:2243] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.710160 20756 raft_consensus.cc:2272] T f9fc717cf49c47969c86d6c23778f56c P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.713346 20756 tablet_replica.cc:333] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.714185 20756 raft_consensus.cc:2243] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.714994 20756 raft_consensus.cc:2272] T f5f518749c784001a1f5106719d0b72f P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.717952 20756 tablet_replica.cc:333] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.718801 20756 raft_consensus.cc:2243] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.719982 20756 raft_consensus.cc:2272] T d8f404cd14ba4c2687ffe2b7637e1da7 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.722929 20756 tablet_replica.cc:333] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.723810 20756 raft_consensus.cc:2243] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.724491 20756 raft_consensus.cc:2272] T 130319e952f14561b08ef212107e1666 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.727337 20756 tablet_replica.cc:333] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.728163 20756 raft_consensus.cc:2243] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.729332 20756 raft_consensus.cc:2272] T ad0b6a949ee94dddab00a0afe84da820 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.732076 20756 tablet_replica.cc:333] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.733006 20756 raft_consensus.cc:2243] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.734329 20756 raft_consensus.cc:2272] T ef15581ea60041b6a79f34c9e4dbe9c3 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.737315 20756 tablet_replica.cc:333] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.738091 20756 raft_consensus.cc:2243] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.739300 20756 raft_consensus.cc:2272] T 0aeb7bdadb4e4d378fb5799fdc7eaa72 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.741945 20756 tablet_replica.cc:333] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.742740 20756 raft_consensus.cc:2243] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.743422 20756 raft_consensus.cc:2272] T a2e697f6ebda4eec99aeb32b72b9bfa4 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.746776 20756 tablet_replica.cc:333] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.747609 20756 raft_consensus.cc:2243] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.748680 20756 raft_consensus.cc:2272] T 9152786e68fb4b41a29fa44da39a923a P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.751361 20756 tablet_replica.cc:333] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.752105 20756 raft_consensus.cc:2243] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.752738 20756 raft_consensus.cc:2272] T 866936931060464d858e0e11cefba859 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.755352 20756 tablet_replica.cc:333] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.756096 20756 raft_consensus.cc:2243] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.757270 20756 raft_consensus.cc:2272] T bd12cba9f1b74b1b908b1d598ca51a8c P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.760167 20756 tablet_replica.cc:333] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.760988 20756 raft_consensus.cc:2243] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.762080 20756 raft_consensus.cc:2272] T eda002bd6903433da20d221420291f1e P bcc802f7bc374bed98e2ee0596a8ebda [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.764803 20756 tablet_replica.cc:333] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.765542 20756 raft_consensus.cc:2243] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.766552 20756 raft_consensus.cc:2272] T 65033a7eefd242a796408c7d54fed332 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.769318 20756 tablet_replica.cc:333] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.770164 20756 raft_consensus.cc:2243] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.771317 20756 raft_consensus.cc:2272] T f8f8c3db69fa448a9f5e5d132c33b414 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.774156 20756 tablet_replica.cc:333] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.774911 20756 raft_consensus.cc:2243] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.775509 20756 raft_consensus.cc:2272] T 080e5fa3988746d88e6350506ed3b136 P bcc802f7bc374bed98e2ee0596a8ebda [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.778452 20756 tablet_replica.cc:333] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.779210 20756 raft_consensus.cc:2243] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.780355 20756 raft_consensus.cc:2272] T 5af1794ba4454baf843df541f302e8e0 P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.783130 20756 tablet_replica.cc:333] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.783880 20756 raft_consensus.cc:2243] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.785112 20756 raft_consensus.cc:2272] T cb3ae54bf5ef462ba44e223978c42103 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.786513 22576 consensus_peers.cc:597] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda -> Peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Couldn't send request to peer 51e52b544fab4275aab4f7fbe81942d2. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:21.787940 20756 tablet_replica.cc:333] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.788807 20756 raft_consensus.cc:2243] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.789486 20756 raft_consensus.cc:2272] T ca34a4d332f1434f8089d28952415e70 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.792411 20756 tablet_replica.cc:333] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.793198 20756 raft_consensus.cc:2243] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.794296 20756 raft_consensus.cc:2272] T 23093b4e74d34b3d87ab577135fa1517 P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.796993 20756 tablet_replica.cc:333] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.797717 20756 raft_consensus.cc:2243] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.798866 20756 raft_consensus.cc:2272] T 0d9daa6d16d543f0a8cb8b3d482b3d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.801549 20756 tablet_replica.cc:333] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.802302 20756 raft_consensus.cc:2243] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.802893 20756 raft_consensus.cc:2272] T 5375c76fdd4d4624b9b6cbaa44ae40c0 P bcc802f7bc374bed98e2ee0596a8ebda [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.805670 20756 tablet_replica.cc:333] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.806429 20756 raft_consensus.cc:2243] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.807309 20756 raft_consensus.cc:2272] T 82fae287aad247d99c33e1a07c6e82a3 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.809994 20756 tablet_replica.cc:333] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.810712 20756 raft_consensus.cc:2243] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.812067 20756 raft_consensus.cc:2272] T 1b7ba79f0d534cbba2170f41c42625e6 P bcc802f7bc374bed98e2ee0596a8ebda [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.814810 20756 tablet_replica.cc:333] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.815536 20756 raft_consensus.cc:2243] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.816674 20756 raft_consensus.cc:2272] T 06e4c126dc6f477daa840b84b452bb59 P bcc802f7bc374bed98e2ee0596a8ebda [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.819339 20756 tablet_replica.cc:333] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.820091 20756 raft_consensus.cc:2243] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.821091 20756 pending_rounds.cc:70] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Trying to abort 1 pending ops.
I20260709 13:09:21.821313 20756 pending_rounds.cc:77] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda: Aborting op as it isn't in flight: id { term: 17 index: 15 } timestamp: 7305636078867173376 op_type: NO_OP noop_request { }
I20260709 13:09:21.821651 20756 raft_consensus.cc:2889] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:21.821978 20756 raft_consensus.cc:2272] T a6be2f940d334bd0b3c9d1b89bc17d2f P bcc802f7bc374bed98e2ee0596a8ebda [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.823091 29200 raft_consensus.cc:493] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 51e52b544fab4275aab4f7fbe81942d2)
I20260709 13:09:21.823549 29200 raft_consensus.cc:515] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "61893f17f34b4cc9b898114d3c0a7023" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 44983 } } peers { permanent_uuid: "51e52b544fab4275aab4f7fbe81942d2" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 35687 } } peers { permanent_uuid: "bcc802f7bc374bed98e2ee0596a8ebda" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 41571 } attrs { promote: false } }
I20260709 13:09:21.824743 20756 tablet_replica.cc:333] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.825527 20756 raft_consensus.cc:2243] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.826787 20756 raft_consensus.cc:2272] T b83eb73076f949419556cb7ef3746784 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.825459 29200 leader_election.cc:290] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983), 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687)
W20260709 13:09:21.829413 22573 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 61893f17f34b4cc9b898114d3c0a7023 (127.20.69.2:44983): Network error: Client connection negotiation failed: client connection to 127.20.69.2:44983: connect: Connection refused (error 111)
I20260709 13:09:21.829725 20756 tablet_replica.cc:333] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.830597 20756 raft_consensus.cc:2243] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:09:21.831115 22576 leader_election.cc:336] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 51e52b544fab4275aab4f7fbe81942d2 (127.20.69.3:35687): Network error: Client connection negotiation failed: client connection to 127.20.69.3:35687: connect: Connection refused (error 111)
I20260709 13:09:21.831512 22576 leader_election.cc:304] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcc802f7bc374bed98e2ee0596a8ebda; no voters: 51e52b544fab4275aab4f7fbe81942d2, 61893f17f34b4cc9b898114d3c0a7023
I20260709 13:09:21.831576 20756 raft_consensus.cc:2272] T 5d092f1c41e747e194d93526c0fad944 P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.832140 29200 raft_consensus.cc:2749] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:09:21.834304 20756 tablet_replica.cc:333] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.835043 20756 raft_consensus.cc:2243] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.836133 20756 raft_consensus.cc:2272] T e3fd785266e045ce9ae6bb7160866b9d P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.838903 20756 tablet_replica.cc:333] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.839645 20756 raft_consensus.cc:2243] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.840746 20756 raft_consensus.cc:2272] T 6c93691583c1413ca9d0cb9e64fbd7cd P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.843426 20756 tablet_replica.cc:333] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.844129 20756 raft_consensus.cc:2243] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.845216 20756 raft_consensus.cc:2272] T b7a6203a9eab4b71b33f702b49f0945f P bcc802f7bc374bed98e2ee0596a8ebda [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.847769 20756 tablet_replica.cc:333] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.848443 20756 raft_consensus.cc:2243] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.849108 20756 raft_consensus.cc:2272] T 7baa5a75e229412297990ddc378b6aad P bcc802f7bc374bed98e2ee0596a8ebda [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.851723 20756 tablet_replica.cc:333] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.852396 20756 raft_consensus.cc:2243] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.853480 20756 raft_consensus.cc:2272] T 2af20d42858245eb986768009de88379 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.856204 20756 tablet_replica.cc:333] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.856911 20756 raft_consensus.cc:2243] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.857498 20756 raft_consensus.cc:2272] T e8f816617b58480bad6550570b514d80 P bcc802f7bc374bed98e2ee0596a8ebda [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.860066 20756 tablet_replica.cc:333] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.860723 20756 raft_consensus.cc:2243] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.861722 20756 raft_consensus.cc:2272] T 04a8fcd2517b44a4895a7b0ec8966a41 P bcc802f7bc374bed98e2ee0596a8ebda [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.864303 20756 tablet_replica.cc:333] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda: stopping tablet replica
I20260709 13:09:21.864941 20756 raft_consensus.cc:2243] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.865952 20756 raft_consensus.cc:2272] T 2f2be7847b8c4a19be52a47f4a860ceb P bcc802f7bc374bed98e2ee0596a8ebda [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.199026 20756 tablet_server.cc:196] TabletServer@127.20.69.4:0 shutdown complete.
I20260709 13:09:22.268937 20756 master.cc:562] Master@127.20.69.62:45563 shutting down...
W20260709 13:09:22.306908 21821 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:09:22.307200 21821 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:22.307360 21821 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:25.474167 21804 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3d80 after lost signal to thread 20759
W20260709 13:09:25.474557 21804 debug-util.cc:398] Leaking SignalData structure 0x7b08001f40e0 after lost signal to thread 21807
W20260709 13:09:29.771528 21758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111) [suppressed 263 similar messages]
W20260709 13:09:29.775946 21758 catalog_manager.cc:4755] TS 95296a4420ed41b69191d3d4353cf2b0 (127.20.69.1:38039): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 20e7b7ab39a74ba88aa5a6259c522f73: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38039: connect: Connection refused (error 111)
I20260709 13:09:31.046444 20756 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:31.047493 20756 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:31.047883 20756 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2e9dea115c0a415895e1d51deced12f4: stopping tablet replica
I20260709 13:09:31.250108 20756 master.cc:584] Master@127.20.69.62:45563 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (240301 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:31.373916 20756 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.69.62:37947
I20260709 13:09:31.375114 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.380798 29205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.380815 29204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.383512 29207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.383559 20756 server_base.cc:1061] running on GCE node
I20260709 13:09:31.386884 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.387135 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.387303 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602571387281 us; error 0 us; skew 500 ppm
I20260709 13:09:31.387823 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.392105 20756 webserver.cc:533] Webserver started at http://127.20.69.62:41653/ using document root <none> and password file <none>
I20260709 13:09:31.393165 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.393509 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.394098 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.396432 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/master-0-root/instance:
uuid: "84e4fcab92c047b4a7853b0eafa48991"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.404944 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:31.410261 29212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.411262 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:09:31.411758 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/master-0-root
uuid: "84e4fcab92c047b4a7853b0eafa48991"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.412204 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.439594 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.440981 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.486994 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.62:37947
I20260709 13:09:31.487135 29263 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.62:37947 every 8 connection(s)
I20260709 13:09:31.494025 29264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.506646 29264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991: Bootstrap starting.
I20260709 13:09:31.513013 29264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.518005 29264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991: No bootstrap required, opened a new log
I20260709 13:09:31.520396 29264 raft_consensus.cc:359] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84e4fcab92c047b4a7853b0eafa48991" member_type: VOTER }
I20260709 13:09:31.521003 29264 raft_consensus.cc:385] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.521283 29264 raft_consensus.cc:740] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e4fcab92c047b4a7853b0eafa48991, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.521950 29264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84e4fcab92c047b4a7853b0eafa48991" member_type: VOTER }
I20260709 13:09:31.522446 29264 raft_consensus.cc:399] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:31.522696 29264 raft_consensus.cc:493] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:31.522962 29264 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.527925 29264 raft_consensus.cc:515] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84e4fcab92c047b4a7853b0eafa48991" member_type: VOTER }
I20260709 13:09:31.528582 29264 leader_election.cc:304] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84e4fcab92c047b4a7853b0eafa48991; no voters: 
I20260709 13:09:31.529848 29264 leader_election.cc:290] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:31.530289 29267 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.531773 29267 raft_consensus.cc:697] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 1 LEADER]: Becoming Leader. State: Replica: 84e4fcab92c047b4a7853b0eafa48991, State: Running, Role: LEADER
I20260709 13:09:31.532567 29267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84e4fcab92c047b4a7853b0eafa48991" member_type: VOTER }
I20260709 13:09:31.533078 29264 sys_catalog.cc:565] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:31.541019 29268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84e4fcab92c047b4a7853b0eafa48991" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84e4fcab92c047b4a7853b0eafa48991" member_type: VOTER } }
I20260709 13:09:31.541879 29268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:31.541940 29269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84e4fcab92c047b4a7853b0eafa48991. Latest consensus state: current_term: 1 leader_uuid: "84e4fcab92c047b4a7853b0eafa48991" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84e4fcab92c047b4a7853b0eafa48991" member_type: VOTER } }
I20260709 13:09:31.542752 29269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:31.543876 29277 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:31.548995 29277 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:31.550249 20756 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:31.558661 29277 catalog_manager.cc:1383] Generated new cluster ID: 8a8ef5c9eef144368fdf95fac06499b8
I20260709 13:09:31.558962 29277 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:31.581369 29277 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:31.582775 29277 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:31.606739 29277 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991: Generated new TSK 0
I20260709 13:09:31.607379 29277 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:31.617355 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.623955 29285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.625867 29286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.627148 29288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.628185 20756 server_base.cc:1061] running on GCE node
I20260709 13:09:31.631211 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.631457 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.631657 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602571631641 us; error 0 us; skew 500 ppm
I20260709 13:09:31.632838 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.636940 20756 webserver.cc:533] Webserver started at http://127.20.69.1:45471/ using document root <none> and password file <none>
I20260709 13:09:31.637952 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.638267 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.638656 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.641067 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/instance:
uuid: "23e24e0c40f44bc79274c2081c9fc002"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.649179 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:31.653954 29293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.655014 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:09:31.655368 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "23e24e0c40f44bc79274c2081c9fc002"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.655671 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.675935 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.677897 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.680308 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.684459 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.684754 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:31.684950 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.685105 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.728853 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:40325
I20260709 13:09:31.728972 29355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:40325 every 8 connection(s)
I20260709 13:09:31.734534 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.742141 29360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.744202 29361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.746522 29363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.747411 20756 server_base.cc:1061] running on GCE node
I20260709 13:09:31.748258 29356 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37947
I20260709 13:09:31.748733 29356 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:31.749576 29356 heartbeater.cc:507] Master 127.20.69.62:37947 requested a full tablet report, sending...
I20260709 13:09:31.749976 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.750245 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.750417 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602571750401 us; error 0 us; skew 500 ppm
I20260709 13:09:31.751047 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.752012 29229 ts_manager.cc:194] Registered new tserver with Master: 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:31.753767 20756 webserver.cc:533] Webserver started at http://127.20.69.2:40965/ using document root <none> and password file <none>
I20260709 13:09:31.754317 29229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34850
I20260709 13:09:31.754316 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.754825 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.755136 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.756438 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/instance:
uuid: "a5dacd0232c24e92bc64f941b7410a9d"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.761514 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:31.765293 29368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.766137 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:31.766497 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-1-root
uuid: "a5dacd0232c24e92bc64f941b7410a9d"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.766840 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.790223 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.791587 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.793162 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.795697 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.795959 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.796240 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.796415 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.837893 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.2:32963
I20260709 13:09:31.837993 29430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.2:32963 every 8 connection(s)
I20260709 13:09:31.843072 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.851068 29434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.852198 29435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.855922 29437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.856657 20756 server_base.cc:1061] running on GCE node
I20260709 13:09:31.856987 29431 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37947
I20260709 13:09:31.857470 29431 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:31.857849 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.858162 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.858397 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602571858360 us; error 0 us; skew 500 ppm
I20260709 13:09:31.858419 29431 heartbeater.cc:507] Master 127.20.69.62:37947 requested a full tablet report, sending...
I20260709 13:09:31.859162 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.860987 29229 ts_manager.cc:194] Registered new tserver with Master: a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:31.862128 20756 webserver.cc:533] Webserver started at http://127.20.69.3:40045/ using document root <none> and password file <none>
I20260709 13:09:31.862793 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.863035 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.862953 29229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34860
I20260709 13:09:31.863512 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.865178 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/instance:
uuid: "81cf9a977cb447069d98dedbda0e4f06"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.870096 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:31.873674 29442 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.874490 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:31.874760 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-2-root
uuid: "81cf9a977cb447069d98dedbda0e4f06"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.875025 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.895438 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.896728 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.898204 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.900481 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.900679 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.901001 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.901166 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.946067 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.3:37103
I20260709 13:09:31.946159 29504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.3:37103 every 8 connection(s)
I20260709 13:09:31.951442 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.959807 29508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.962535 29509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.964457 20756 server_base.cc:1061] running on GCE node
W20260709 13:09:31.964483 29511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.965981 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.966315 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.966554 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602571966536 us; error 0 us; skew 500 ppm
I20260709 13:09:31.966982 29505 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37947
I20260709 13:09:31.967238 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.967427 29505 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:31.968667 29505 heartbeater.cc:507] Master 127.20.69.62:37947 requested a full tablet report, sending...
I20260709 13:09:31.970826 20756 webserver.cc:533] Webserver started at http://127.20.69.4:42249/ using document root <none> and password file <none>
I20260709 13:09:31.970978 29229 ts_manager.cc:194] Registered new tserver with Master: 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:31.971524 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.971796 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.972076 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.972640 29229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34874
I20260709 13:09:31.973407 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-3-root/instance:
uuid: "470465ef54334dbc8be5230ca16dc1a8"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.978432 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:31.982220 29516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.983248 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:09:31.983531 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-3-root
uuid: "470465ef54334dbc8be5230ca16dc1a8"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:31.983795 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.996076 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.997476 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.998980 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:32.001464 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:32.001672 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.001977 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:32.002135 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:32.044703 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.4:40041
I20260709 13:09:32.044831 29578 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.4:40041 every 8 connection(s)
I20260709 13:09:32.058615 29579 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37947
I20260709 13:09:32.059026 29579 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:32.059799 29579 heartbeater.cc:507] Master 127.20.69.62:37947 requested a full tablet report, sending...
I20260709 13:09:32.061760 29229 ts_manager.cc:194] Registered new tserver with Master: 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:32.062661 20756 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014686585s
I20260709 13:09:32.063171 29229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34882
I20260709 13:09:32.091903 29229 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34888:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:32.341042 29543 tablet_service.cc:1511] Processing CreateTablet for tablet 1a43a0adadf04f62a440ac2f485f116d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:32.342703 29543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a43a0adadf04f62a440ac2f485f116d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.347504 29544 tablet_service.cc:1511] Processing CreateTablet for tablet a7f0a5f595ee48d48b1bdf8c5f330f0a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:32.349103 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f0a5f595ee48d48b1bdf8c5f330f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.349143 29542 tablet_service.cc:1511] Processing CreateTablet for tablet eb067576b44a4b3fa9852a63cc5f17ec (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:32.354350 29542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb067576b44a4b3fa9852a63cc5f17ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.359426 29541 tablet_service.cc:1511] Processing CreateTablet for tablet 189ffad2edf44a8da1f0fb3c5cb386c3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:32.361198 29541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189ffad2edf44a8da1f0fb3c5cb386c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.366204 29540 tablet_service.cc:1511] Processing CreateTablet for tablet 895df96ea5c54121bb29dba7f08193a0 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:32.367859 29540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895df96ea5c54121bb29dba7f08193a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.376704 29539 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4628fa3c2c4dc29582dbdc8f25f8d1 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:32.378319 29539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4628fa3c2c4dc29582dbdc8f25f8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.380303 29321 tablet_service.cc:1511] Processing CreateTablet for tablet a7f0a5f595ee48d48b1bdf8c5f330f0a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:32.380839 29320 tablet_service.cc:1511] Processing CreateTablet for tablet f1c831fc495543c8beff6a28e80c0aa0 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:32.381439 29318 tablet_service.cc:1511] Processing CreateTablet for tablet bd7d4ae59b2148a9ba089ad2475cddbe (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:32.381893 29321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f0a5f595ee48d48b1bdf8c5f330f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.382871 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7d4ae59b2148a9ba089ad2475cddbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.383306 29319 tablet_service.cc:1511] Processing CreateTablet for tablet 1a43a0adadf04f62a440ac2f485f116d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:32.384739 29319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a43a0adadf04f62a440ac2f485f116d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.385797 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c831fc495543c8beff6a28e80c0aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.388128 29317 tablet_service.cc:1511] Processing CreateTablet for tablet 189ffad2edf44a8da1f0fb3c5cb386c3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:32.390406 29317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189ffad2edf44a8da1f0fb3c5cb386c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.392910 29316 tablet_service.cc:1511] Processing CreateTablet for tablet 895df96ea5c54121bb29dba7f08193a0 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:32.393551 29315 tablet_service.cc:1511] Processing CreateTablet for tablet 60b29284ee8e4bb2b1b7c2f7c9319103 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:32.394557 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895df96ea5c54121bb29dba7f08193a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.395273 29315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b29284ee8e4bb2b1b7c2f7c9319103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.412674 29538 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3086b5afd543099cb84670c2da84bd (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:32.414225 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3086b5afd543099cb84670c2da84bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.425916 29470 tablet_service.cc:1511] Processing CreateTablet for tablet f1c831fc495543c8beff6a28e80c0aa0 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:32.427559 29470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c831fc495543c8beff6a28e80c0aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.430169 29469 tablet_service.cc:1511] Processing CreateTablet for tablet 1a43a0adadf04f62a440ac2f485f116d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:32.431653 29469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a43a0adadf04f62a440ac2f485f116d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.434023 29468 tablet_service.cc:1511] Processing CreateTablet for tablet eb067576b44a4b3fa9852a63cc5f17ec (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:32.435597 29468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb067576b44a4b3fa9852a63cc5f17ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.443729 29467 tablet_service.cc:1511] Processing CreateTablet for tablet bd7d4ae59b2148a9ba089ad2475cddbe (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:32.444682 29394 tablet_service.cc:1511] Processing CreateTablet for tablet eb067576b44a4b3fa9852a63cc5f17ec (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:32.445935 29467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7d4ae59b2148a9ba089ad2475cddbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.446141 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb067576b44a4b3fa9852a63cc5f17ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.449869 29393 tablet_service.cc:1511] Processing CreateTablet for tablet bd7d4ae59b2148a9ba089ad2475cddbe (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:32.450052 29465 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4628fa3c2c4dc29582dbdc8f25f8d1 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:32.451375 29393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7d4ae59b2148a9ba089ad2475cddbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.451849 29466 tablet_service.cc:1511] Processing CreateTablet for tablet 895df96ea5c54121bb29dba7f08193a0 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:32.453325 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895df96ea5c54121bb29dba7f08193a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.453923 29392 tablet_service.cc:1511] Processing CreateTablet for tablet 189ffad2edf44a8da1f0fb3c5cb386c3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:32.455473 29392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189ffad2edf44a8da1f0fb3c5cb386c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.457970 29391 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4628fa3c2c4dc29582dbdc8f25f8d1 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:32.458526 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4628fa3c2c4dc29582dbdc8f25f8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.459492 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4628fa3c2c4dc29582dbdc8f25f8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.462466 29395 tablet_service.cc:1511] Processing CreateTablet for tablet f1c831fc495543c8beff6a28e80c0aa0 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:32.462535 29464 tablet_service.cc:1511] Processing CreateTablet for tablet 60b29284ee8e4bb2b1b7c2f7c9319103 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:32.464043 29395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c831fc495543c8beff6a28e80c0aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.478166 29541 tablet_service.cc:1511] Processing CreateTablet for tablet 0df9a8d24a9d4474be608101a853cacb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:32.480369 29541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df9a8d24a9d4474be608101a853cacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.484169 29464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b29284ee8e4bb2b1b7c2f7c9319103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.486847 29389 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3086b5afd543099cb84670c2da84bd (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:32.509763 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3086b5afd543099cb84670c2da84bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.487638 29396 tablet_service.cc:1511] Processing CreateTablet for tablet a7f0a5f595ee48d48b1bdf8c5f330f0a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:32.513585 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f0a5f595ee48d48b1bdf8c5f330f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.487785 29318 tablet_service.cc:1511] Processing CreateTablet for tablet 0df9a8d24a9d4474be608101a853cacb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:32.488648 29321 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3086b5afd543099cb84670c2da84bd (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:32.517653 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df9a8d24a9d4474be608101a853cacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.521258 29321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3086b5afd543099cb84670c2da84bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.490199 29463 tablet_service.cc:1511] Processing CreateTablet for tablet 0df9a8d24a9d4474be608101a853cacb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:32.525650 29463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df9a8d24a9d4474be608101a853cacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.493816 29388 tablet_service.cc:1511] Processing CreateTablet for tablet a1ae9afbd8b84370bae083fab7970e20 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:32.529603 29388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ae9afbd8b84370bae083fab7970e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.499020 29462 tablet_service.cc:1511] Processing CreateTablet for tablet a1ae9afbd8b84370bae083fab7970e20 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:32.534024 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ae9afbd8b84370bae083fab7970e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.465891 29390 tablet_service.cc:1511] Processing CreateTablet for tablet 60b29284ee8e4bb2b1b7c2f7c9319103 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:32.536495 29390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b29284ee8e4bb2b1b7c2f7c9319103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.544014 29599 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
W20260709 13:09:32.551170 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:32.554065 29538 tablet_service.cc:1511] Processing CreateTablet for tablet a1ae9afbd8b84370bae083fab7970e20 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:32.556049 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ae9afbd8b84370bae083fab7970e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.570423 29599 tablet_bootstrap.cc:654] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.591831 29320 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0651fb124d44bf80d91e28c36d58d3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:32.593319 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0651fb124d44bf80d91e28c36d58d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.601491 29600 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:32.615103 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0651fb124d44bf80d91e28c36d58d3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:32.619148 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0651fb124d44bf80d91e28c36d58d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.663738 29543 tablet_service.cc:1511] Processing CreateTablet for tablet 9e018f136fea466ab0d7ed7aa4592f06 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:32.665287 29602 tablet_bootstrap.cc:492] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:32.665711 29543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e018f136fea466ab0d7ed7aa4592f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.669239 29319 tablet_service.cc:1511] Processing CreateTablet for tablet 9e018f136fea466ab0d7ed7aa4592f06 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:32.670939 29319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e018f136fea466ab0d7ed7aa4592f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.677296 29393 tablet_service.cc:1511] Processing CreateTablet for tablet 9e018f136fea466ab0d7ed7aa4592f06 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:32.678793 29393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e018f136fea466ab0d7ed7aa4592f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.683574 29600 tablet_bootstrap.cc:654] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.686167 29465 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0651fb124d44bf80d91e28c36d58d3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:32.687547 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0651fb124d44bf80d91e28c36d58d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.700145 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 1940d3c343814440a73d53c937f06f56 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:32.701681 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1940d3c343814440a73d53c937f06f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.701599 29541 tablet_service.cc:1511] Processing CreateTablet for tablet 1940d3c343814440a73d53c937f06f56 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:32.702942 29541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1940d3c343814440a73d53c937f06f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.701676 29318 tablet_service.cc:1511] Processing CreateTablet for tablet 1940d3c343814440a73d53c937f06f56 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:32.710438 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1940d3c343814440a73d53c937f06f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.730649 29601 tablet_bootstrap.cc:492] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:32.733103 29466 tablet_service.cc:1511] Processing CreateTablet for tablet e65b26d5bb9645bfaa8468e215b4b65d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:32.734625 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65b26d5bb9645bfaa8468e215b4b65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.734475 29538 tablet_service.cc:1511] Processing CreateTablet for tablet e65b26d5bb9645bfaa8468e215b4b65d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:32.735994 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65b26d5bb9645bfaa8468e215b4b65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.731948 29391 tablet_service.cc:1511] Processing CreateTablet for tablet e65b26d5bb9645bfaa8468e215b4b65d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:32.742129 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65b26d5bb9645bfaa8468e215b4b65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.742226 29602 tablet_bootstrap.cc:654] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.749055 29321 tablet_service.cc:1511] Processing CreateTablet for tablet 53e855aeeff54a25af4276a79567436b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:32.750502 29321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e855aeeff54a25af4276a79567436b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.751382 29467 tablet_service.cc:1511] Processing CreateTablet for tablet 53e855aeeff54a25af4276a79567436b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:32.752730 29467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e855aeeff54a25af4276a79567436b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.757798 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 53e855aeeff54a25af4276a79567436b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:32.759272 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e855aeeff54a25af4276a79567436b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.759990 29601 tablet_bootstrap.cc:654] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.763655 29356 heartbeater.cc:499] Master 127.20.69.62:37947 was elected leader, sending a full tablet report...
I20260709 13:09:32.770753 29599 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:32.771350 29599 ts_tablet_manager.cc:1403] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.228s	user 0.009s	sys 0.029s
I20260709 13:09:32.772411 29543 tablet_service.cc:1511] Processing CreateTablet for tablet 4c38085886474ddd9d257bc1c526903f (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:32.773916 29543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c38085886474ddd9d257bc1c526903f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.774366 29600 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:32.774904 29600 ts_tablet_manager.cc:1403] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.174s	user 0.006s	sys 0.017s
I20260709 13:09:32.774809 29599 raft_consensus.cc:359] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:32.775779 29599 raft_consensus.cc:385] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.776113 29599 raft_consensus.cc:740] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.785363 29599 consensus_queue.cc:260] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:32.791083 29319 tablet_service.cc:1511] Processing CreateTablet for tablet 4c38085886474ddd9d257bc1c526903f (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:32.792029 29389 tablet_service.cc:1511] Processing CreateTablet for tablet 4c38085886474ddd9d257bc1c526903f (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:32.792567 29319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c38085886474ddd9d257bc1c526903f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.793407 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c38085886474ddd9d257bc1c526903f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.800485 29600 raft_consensus.cc:359] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:32.801530 29600 raft_consensus.cc:385] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.801903 29600 raft_consensus.cc:740] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.802791 29600 consensus_queue.cc:260] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:32.820662 29544 tablet_service.cc:1511] Processing CreateTablet for tablet ab1dcaf42e0d4b14a3f96b090c1ae07e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:32.822139 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1dcaf42e0d4b14a3f96b090c1ae07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.826584 29320 tablet_service.cc:1511] Processing CreateTablet for tablet ab1dcaf42e0d4b14a3f96b090c1ae07e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:32.827980 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1dcaf42e0d4b14a3f96b090c1ae07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.845907 29601 tablet_bootstrap.cc:492] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:32.846487 29601 ts_tablet_manager.cc:1403] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.170s	user 0.010s	sys 0.013s
I20260709 13:09:32.850612 29601 raft_consensus.cc:359] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:32.851470 29601 raft_consensus.cc:385] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.852133 29601 raft_consensus.cc:740] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.853084 29601 consensus_queue.cc:260] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:32.865833 29467 tablet_service.cc:1511] Processing CreateTablet for tablet ab1dcaf42e0d4b14a3f96b090c1ae07e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:32.867282 29467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1dcaf42e0d4b14a3f96b090c1ae07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.868230 29431 heartbeater.cc:499] Master 127.20.69.62:37947 was elected leader, sending a full tablet report...
I20260709 13:09:32.873747 29599 ts_tablet_manager.cc:1434] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.102s	user 0.022s	sys 0.021s
I20260709 13:09:32.876502 29602 tablet_bootstrap.cc:492] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:32.877094 29602 ts_tablet_manager.cc:1403] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.212s	user 0.014s	sys 0.003s
I20260709 13:09:32.888374 29579 heartbeater.cc:499] Master 127.20.69.62:37947 was elected leader, sending a full tablet report...
I20260709 13:09:32.891383 29599 tablet_bootstrap.cc:492] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:32.884795 29602 raft_consensus.cc:359] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:32.897285 29602 raft_consensus.cc:385] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.897616 29602 raft_consensus.cc:740] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.898767 29599 tablet_bootstrap.cc:654] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.898509 29602 consensus_queue.cc:260] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:32.900236 29608 raft_consensus.cc:493] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.900911 29608 raft_consensus.cc:515] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:32.904158 29608 leader_election.cc:290] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:32.918592 29466 tablet_service.cc:1511] Processing CreateTablet for tablet 7f75a290a07449f1a429e85726f0db84 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:32.920008 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f75a290a07449f1a429e85726f0db84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.926928 29541 tablet_service.cc:1511] Processing CreateTablet for tablet 7f75a290a07449f1a429e85726f0db84 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:32.928850 29541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f75a290a07449f1a429e85726f0db84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.933485 29600 ts_tablet_manager.cc:1434] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.158s	user 0.010s	sys 0.008s
I20260709 13:09:32.934731 29600 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:32.937611 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7e7b55465b4831a7f942c64dc80ef7 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:32.939579 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7e7b55465b4831a7f942c64dc80ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.941334 29601 ts_tablet_manager.cc:1434] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.095s	user 0.018s	sys 0.024s
I20260709 13:09:32.942232 29601 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:32.921581 29391 tablet_service.cc:1511] Processing CreateTablet for tablet 7f75a290a07449f1a429e85726f0db84 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:32.943938 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f75a290a07449f1a429e85726f0db84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.948915 29601 tablet_bootstrap.cc:654] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.956061 29543 tablet_service.cc:1511] Processing CreateTablet for tablet 694e86fc16f64d159c1132b17d8ef34b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:32.954615 29467 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7e7b55465b4831a7f942c64dc80ef7 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:32.960518 29600 tablet_bootstrap.cc:654] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.963986 29543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694e86fc16f64d159c1132b17d8ef34b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.971168 29505 heartbeater.cc:499] Master 127.20.69.62:37947 was elected leader, sending a full tablet report...
I20260709 13:09:32.971151 29611 raft_consensus.cc:493] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.972136 29611 raft_consensus.cc:515] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:32.973711 29602 ts_tablet_manager.cc:1434] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.096s	user 0.017s	sys 0.026s
I20260709 13:09:32.976569 29467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7e7b55465b4831a7f942c64dc80ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:32.979326 29318 tablet_service.cc:1511] Processing CreateTablet for tablet 694e86fc16f64d159c1132b17d8ef34b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:32.980772 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694e86fc16f64d159c1132b17d8ef34b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:32.984278 29357 tablet.cc:2406] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:32.993257 29389 tablet_service.cc:1511] Processing CreateTablet for tablet 694e86fc16f64d159c1132b17d8ef34b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:32.994784 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694e86fc16f64d159c1132b17d8ef34b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.000336 29465 tablet_service.cc:1511] Processing CreateTablet for tablet dd516b0c89f946de845897e58c667be6 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:33.006153 29320 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7e7b55465b4831a7f942c64dc80ef7 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:33.007634 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7e7b55465b4831a7f942c64dc80ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.007696 29321 tablet_service.cc:1511] Processing CreateTablet for tablet dd516b0c89f946de845897e58c667be6 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:33.009099 29321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd516b0c89f946de845897e58c667be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.009654 29602 tablet_bootstrap.cc:492] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:33.007901 29544 tablet_service.cc:1511] Processing CreateTablet for tablet dd516b0c89f946de845897e58c667be6 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:33.013716 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd516b0c89f946de845897e58c667be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.021925 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd516b0c89f946de845897e58c667be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.023663 29611 leader_election.cc:290] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:33.053689 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 787fe78a1da34fb38a66dc8e8e4a416d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:33.054508 29601 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:33.055052 29601 ts_tablet_manager.cc:1403] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.113s	user 0.007s	sys 0.008s
I20260709 13:09:33.052292 29538 tablet_service.cc:1511] Processing CreateTablet for tablet 787fe78a1da34fb38a66dc8e8e4a416d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:33.058596 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787fe78a1da34fb38a66dc8e8e4a416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.059381 29319 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6a22b4c6b24ef8b19f1a79234febac (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:33.060792 29319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6a22b4c6b24ef8b19f1a79234febac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.057407 29607 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.062134 29607 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.066007 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787fe78a1da34fb38a66dc8e8e4a416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.070832 29607 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:33.072299 29601 raft_consensus.cc:359] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.086565 29601 raft_consensus.cc:385] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.095142 29600 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:33.106140 29600 ts_tablet_manager.cc:1403] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.172s	user 0.022s	sys 0.034s
I20260709 13:09:33.108688 29601 raft_consensus.cc:740] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.109628 29601 consensus_queue.cc:260] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.097002 29599 tablet_bootstrap.cc:492] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:33.096354 29394 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6a22b4c6b24ef8b19f1a79234febac (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:33.103353 29470 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6a22b4c6b24ef8b19f1a79234febac (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:33.086405 29393 tablet_service.cc:1511] Processing CreateTablet for tablet 787fe78a1da34fb38a66dc8e8e4a416d (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:33.110792 29599 ts_tablet_manager.cc:1403] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.220s	user 0.020s	sys 0.022s
I20260709 13:09:33.111676 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6a22b4c6b24ef8b19f1a79234febac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.111748 29470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6a22b4c6b24ef8b19f1a79234febac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.115036 29599 raft_consensus.cc:359] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.116506 29599 raft_consensus.cc:385] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.116936 29599 raft_consensus.cc:740] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.116140 29393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787fe78a1da34fb38a66dc8e8e4a416d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.118180 29600 raft_consensus.cc:359] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.118935 29600 raft_consensus.cc:385] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.119222 29600 raft_consensus.cc:740] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.110146 29602 tablet_bootstrap.cc:654] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.121848 29601 ts_tablet_manager.cc:1434] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:09:33.122545 29599 consensus_queue.cc:260] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.126747 29599 ts_tablet_manager.cc:1434] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:33.129911 29599 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:33.131076 29541 tablet_service.cc:1511] Processing CreateTablet for tablet 5216cf90df5f43a090fc0d60c20f0e23 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:33.134095 29315 tablet_service.cc:1511] Processing CreateTablet for tablet 5216cf90df5f43a090fc0d60c20f0e23 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:33.141821 29466 tablet_service.cc:1511] Processing CreateTablet for tablet ed2a16c1a5674ca19b3c85e15da674df (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:33.136706 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
W20260709 13:09:33.143971 29296 leader_election.cc:343] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.142064 29541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5216cf90df5f43a090fc0d60c20f0e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.142093 29315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5216cf90df5f43a090fc0d60c20f0e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.135078 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 5216cf90df5f43a090fc0d60c20f0e23 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:33.149791 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5216cf90df5f43a090fc0d60c20f0e23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.119993 29600 consensus_queue.cc:260] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.153399 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2a16c1a5674ca19b3c85e15da674df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.123034 29601 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:33.191612 29609 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.192395 29609 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.199734 29610 raft_consensus.cc:493] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.200350 29610 raft_consensus.cc:515] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.203262 29610 leader_election.cc:290] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:33.203330 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:33.204111 29554 raft_consensus.cc:2468] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:33.208212 29296 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:33.209156 29608 raft_consensus.cc:2804] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.209532 29608 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.209846 29608 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:33.210325 29215 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 57304.4us
I20260709 13:09:33.210536 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb067576b44a4b3fa9852a63cc5f17ec" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:33.212318 29443 leader_election.cc:343] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.217166 29607 raft_consensus.cc:493] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.217629 29600 ts_tablet_manager.cc:1434] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.111s	user 0.002s	sys 0.014s
I20260709 13:09:33.217736 29607 raft_consensus.cc:515] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.218756 29600 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:33.220250 29607 leader_election.cc:290] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:33.224125 29316 tablet_service.cc:1511] Processing CreateTablet for tablet ed2a16c1a5674ca19b3c85e15da674df (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:33.227384 29601 tablet_bootstrap.cc:654] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.228284 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2a16c1a5674ca19b3c85e15da674df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.226379 29391 tablet_service.cc:1511] Processing CreateTablet for tablet b3fc6d2066784e858af22723c6508fc5 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:33.233549 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fc6d2066784e858af22723c6508fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.234886 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:33.236810 29295 leader_election.cc:343] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.237377 29295 leader_election.cc:304] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:33.238878 29543 tablet_service.cc:1511] Processing CreateTablet for tablet ed2a16c1a5674ca19b3c85e15da674df (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:33.240451 29543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2a16c1a5674ca19b3c85e15da674df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.256590 29602 tablet_bootstrap.cc:492] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:33.264863 29465 tablet_service.cc:1511] Processing CreateTablet for tablet b3fc6d2066784e858af22723c6508fc5 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:33.266350 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fc6d2066784e858af22723c6508fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.267562 29317 tablet_service.cc:1511] Processing CreateTablet for tablet ec95604cb33f41a39ea52005380127cb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:33.268985 29317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec95604cb33f41a39ea52005380127cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.270725 29467 tablet_service.cc:1511] Processing CreateTablet for tablet ec95604cb33f41a39ea52005380127cb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:33.272046 29467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec95604cb33f41a39ea52005380127cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.273746 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb067576b44a4b3fa9852a63cc5f17ec" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:33.274443 29554 raft_consensus.cc:2468] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:33.274575 29396 tablet_service.cc:1511] Processing CreateTablet for tablet ec95604cb33f41a39ea52005380127cb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:33.275835 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec95604cb33f41a39ea52005380127cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.275969 29445 leader_election.cc:304] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:33.277310 29611 raft_consensus.cc:2804] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.277704 29611 raft_consensus.cc:493] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.278048 29611 raft_consensus.cc:3060] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.292086 29602 ts_tablet_manager.cc:1403] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.283s	user 0.016s	sys 0.002s
I20260709 13:09:33.293679 29610 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.295606 29610 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.298197 29631 raft_consensus.cc:2749] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.298859 29610 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:33.261317 29609 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:33.321880 29544 tablet_service.cc:1511] Processing CreateTablet for tablet b3fc6d2066784e858af22723c6508fc5 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:33.323345 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fc6d2066784e858af22723c6508fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.301327 29608 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.350677 29600 tablet_bootstrap.cc:700] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Time spent opening tablet: real 0.104s	user 0.003s	sys 0.000s
I20260709 13:09:33.357023 29320 tablet_service.cc:1511] Processing CreateTablet for tablet bdf053ddbc384257a33de229f027366e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:33.361619 29538 tablet_service.cc:1511] Processing CreateTablet for tablet bdf053ddbc384257a33de229f027366e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:33.365896 29463 tablet_service.cc:1511] Processing CreateTablet for tablet ef92dc4e7b304f9e8f8e5318c7df0a9c (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:33.371675 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:33.372710 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:33.395596 29316 tablet_service.cc:1511] Processing CreateTablet for tablet ef92dc4e7b304f9e8f8e5318c7df0a9c (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:33.378397 29539 tablet_service.cc:1511] Processing CreateTablet for tablet ef92dc4e7b304f9e8f8e5318c7df0a9c (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:33.397104 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef92dc4e7b304f9e8f8e5318c7df0a9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:33.397689 29371 leader_election.cc:343] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.397869 29318 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa47941789a4465bfdfbd693ad766ba (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:09:33.398531 29371 leader_election.cc:343] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.399255 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa47941789a4465bfdfbd693ad766ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.394964 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf053ddbc384257a33de229f027366e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.379711 29608 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:33.382025 29602 raft_consensus.cc:359] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.383070 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:33.400938 29602 raft_consensus.cc:385] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.401180 29552 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.401341 29602 raft_consensus.cc:740] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.402349 29539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef92dc4e7b304f9e8f8e5318c7df0a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.402324 29602 consensus_queue.cc:260] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.389725 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb067576b44a4b3fa9852a63cc5f17ec" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:33.404335 29599 tablet_bootstrap.cc:654] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.390000 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:33.391340 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb067576b44a4b3fa9852a63cc5f17ec" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:33.391623 29542 tablet_service.cc:1511] Processing CreateTablet for tablet 81821b5154314716bfe0d430b08ffb5e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:33.406733 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:33.407712 29600 tablet_bootstrap.cc:654] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:33.408075 29517 leader_election.cc:343] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.394929 29463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef92dc4e7b304f9e8f8e5318c7df0a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.386134 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 81821b5154314716bfe0d430b08ffb5e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:33.403030 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf053ddbc384257a33de229f027366e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.425347 29470 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa47941789a4465bfdfbd693ad766ba (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:33.428936 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:33.430248 29331 raft_consensus.cc:2393] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:33.348142 29611 raft_consensus.cc:515] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.406752 29542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81821b5154314716bfe0d430b08ffb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.410429 29602 ts_tablet_manager.cc:1434] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.002s
I20260709 13:09:33.435613 29601 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:33.410459 29389 tablet_service.cc:1511] Processing CreateTablet for tablet 81821b5154314716bfe0d430b08ffb5e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:09:33.411935 29294 leader_election.cc:343] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.437624 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81821b5154314716bfe0d430b08ffb5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:33.412583 29517 leader_election.cc:343] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.417032 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:33.448433 29294 leader_election.cc:343] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.449888 29552 raft_consensus.cc:2468] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:33.451267 29296 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:33.418854 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81821b5154314716bfe0d430b08ffb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.452515 29608 raft_consensus.cc:2804] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.453053 29608 raft_consensus.cc:697] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:33.453869 29608 consensus_queue.cc:237] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.419719 29394 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa47941789a4465bfdfbd693ad766ba (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:33.435695 29602 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:33.457629 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa47941789a4465bfdfbd693ad766ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.436481 29601 ts_tablet_manager.cc:1403] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.314s	user 0.017s	sys 0.017s
I20260709 13:09:33.462564 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb067576b44a4b3fa9852a63cc5f17ec" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:33.463251 29553 raft_consensus.cc:3060] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.463527 29602 tablet_bootstrap.cc:654] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.412520 29391 tablet_service.cc:1511] Processing CreateTablet for tablet bdf053ddbc384257a33de229f027366e (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:33.442628 29480 raft_consensus.cc:2393] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 1: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:33.442893 29517 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:33.465061 29601 raft_consensus.cc:359] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.465533 29607 raft_consensus.cc:2749] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.446223 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:33.465991 29611 leader_election.cc:290] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:33.466202 29470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa47941789a4465bfdfbd693ad766ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.467332 29518 leader_election.cc:304] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:33.468667 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf053ddbc384257a33de229f027366e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:33.482470 29370 leader_election.cc:343] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.482995 29370 leader_election.cc:304] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:33.484243 29610 raft_consensus.cc:2749] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.488291 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb067576b44a4b3fa9852a63cc5f17ec" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:33.489912 29443 leader_election.cc:343] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.497347 29611 raft_consensus.cc:493] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.498027 29611 raft_consensus.cc:515] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.501405 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4628fa3c2c4dc29582dbdc8f25f8d1" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:33.502908 29443 leader_election.cc:343] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.505319 29611 leader_election.cc:290] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:33.509965 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4628fa3c2c4dc29582dbdc8f25f8d1" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
W20260709 13:09:33.511526 29445 leader_election.cc:343] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.512073 29445 leader_election.cc:304] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:33.513442 29611 raft_consensus.cc:2749] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.473054 29601 raft_consensus.cc:385] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.528868 29601 raft_consensus.cc:740] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.529702 29601 consensus_queue.cc:260] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.532243 29601 ts_tablet_manager.cc:1434] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.071s	user 0.003s	sys 0.001s
I20260709 13:09:33.547686 29539 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee25eabd993465aafd680f5ab69e5ce (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:33.548348 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:33.549232 29539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee25eabd993465aafd680f5ab69e5ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.536952 29396 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee25eabd993465aafd680f5ab69e5ce (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:33.552328 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee25eabd993465aafd680f5ab69e5ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:33.554008 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:33.536083 29317 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee25eabd993465aafd680f5ab69e5ce (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:33.553691 29465 tablet_service.cc:1511] Processing CreateTablet for tablet 51388e1eccfc4e28afe0b67f552695c6 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:33.555223 29317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee25eabd993465aafd680f5ab69e5ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.555223 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51388e1eccfc4e28afe0b67f552695c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:33.564735 29369 leader_election.cc:343] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.565304 29369 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:33.568511 29544 tablet_service.cc:1511] Processing CreateTablet for tablet 51388e1eccfc4e28afe0b67f552695c6 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:33.569998 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51388e1eccfc4e28afe0b67f552695c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.572791 29553 raft_consensus.cc:2468] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:33.574234 29445 leader_election.cc:304] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:33.575420 29611 raft_consensus.cc:2804] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.575925 29611 raft_consensus.cc:697] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:33.576057 29315 tablet_service.cc:1511] Processing CreateTablet for tablet 51388e1eccfc4e28afe0b67f552695c6 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:33.577472 29315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51388e1eccfc4e28afe0b67f552695c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.577521 29607 raft_consensus.cc:2749] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.580920 29611 consensus_queue.cc:237] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:33.586992 29599 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:33.587618 29599 ts_tablet_manager.cc:1403] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.458s	user 0.034s	sys 0.031s
I20260709 13:09:33.589923 29610 raft_consensus.cc:2749] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.590782 29387 tablet_service.cc:1511] Processing CreateTablet for tablet c04c7be6ae194d58a25d56e4c5628b4a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:33.592216 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04c7be6ae194d58a25d56e4c5628b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.594293 29600 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:33.594901 29600 ts_tablet_manager.cc:1403] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.376s	user 0.011s	sys 0.010s
I20260709 13:09:33.598932 29229 catalog_manager.cc:5697] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.602823 29601 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:33.609894 29538 tablet_service.cc:1511] Processing CreateTablet for tablet c04c7be6ae194d58a25d56e4c5628b4a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:33.611320 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04c7be6ae194d58a25d56e4c5628b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.618464 29600 raft_consensus.cc:359] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:33.620757 29600 raft_consensus.cc:385] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.621039 29600 raft_consensus.cc:740] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.621717 29600 consensus_queue.cc:260] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:33.623462 29600 ts_tablet_manager.cc:1434] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.002s
I20260709 13:09:33.626955 29599 raft_consensus.cc:359] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:33.627776 29599 raft_consensus.cc:385] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.628084 29599 raft_consensus.cc:740] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.628873 29599 consensus_queue.cc:260] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:33.629299 29316 tablet_service.cc:1511] Processing CreateTablet for tablet ce1d7834cd644ccdb86354a7aca74628 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:33.630908 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1d7834cd644ccdb86354a7aca74628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.633656 29599 ts_tablet_manager.cc:1434] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:09:33.634780 29599 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:33.637668 29463 tablet_service.cc:1511] Processing CreateTablet for tablet c04c7be6ae194d58a25d56e4c5628b4a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:33.639065 29463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04c7be6ae194d58a25d56e4c5628b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.639178 29389 tablet_service.cc:1511] Processing CreateTablet for tablet ce1d7834cd644ccdb86354a7aca74628 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:33.640825 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1d7834cd644ccdb86354a7aca74628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.643651 29466 tablet_service.cc:1511] Processing CreateTablet for tablet ce1d7834cd644ccdb86354a7aca74628 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:33.645082 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1d7834cd644ccdb86354a7aca74628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.646873 29318 tablet_service.cc:1511] Processing CreateTablet for tablet 19f5075a32114023bc747cfd4d99a934 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:33.648247 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f5075a32114023bc747cfd4d99a934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.643613 29600 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:33.669838 29602 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:33.669562 29465 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce1e737440642bcabdd71181160d267 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:33.670413 29602 ts_tablet_manager.cc:1403] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.235s	user 0.029s	sys 0.058s
I20260709 13:09:33.671001 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce1e737440642bcabdd71181160d267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.673770 29602 raft_consensus.cc:359] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:33.674551 29602 raft_consensus.cc:385] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.674837 29602 raft_consensus.cc:740] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.675632 29602 consensus_queue.cc:260] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:33.678155 29602 ts_tablet_manager.cc:1434] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:33.679342 29602 tablet_bootstrap.cc:492] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:33.681373 29539 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce1e737440642bcabdd71181160d267 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:33.682754 29539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce1e737440642bcabdd71181160d267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.684710 29315 tablet_service.cc:1511] Processing CreateTablet for tablet 9ce1e737440642bcabdd71181160d267 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:33.685458 29601 tablet_bootstrap.cc:654] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.686148 29315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ce1e737440642bcabdd71181160d267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.688179 29226 catalog_manager.cc:5697] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.677724 29542 tablet_service.cc:1511] Processing CreateTablet for tablet 19f5075a32114023bc747cfd4d99a934 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:33.694298 29542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f5075a32114023bc747cfd4d99a934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.694957 29389 tablet_service.cc:1511] Processing CreateTablet for tablet d607df4f38c04c9190803085b2b1b842 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:33.696300 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d607df4f38c04c9190803085b2b1b842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.698642 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 19f5075a32114023bc747cfd4d99a934 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:33.700060 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f5075a32114023bc747cfd4d99a934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.701145 29462 tablet_service.cc:1511] Processing CreateTablet for tablet d607df4f38c04c9190803085b2b1b842 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:33.702478 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d607df4f38c04c9190803085b2b1b842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.727523 29600 tablet_bootstrap.cc:654] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.745481 29610 raft_consensus.cc:493] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.746217 29610 raft_consensus.cc:515] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.748553 29610 leader_election.cc:290] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:33.751281 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:33.749977 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:33.752892 29369 leader_election.cc:343] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:33.753399 29370 leader_election.cc:343] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.753759 29599 tablet_bootstrap.cc:654] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.753925 29370 leader_election.cc:304] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:33.749094 29602 tablet_bootstrap.cc:654] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.755147 29610 raft_consensus.cc:2749] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:33.759320 29215 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 53477.4us
I20260709 13:09:33.762754 29539 tablet_service.cc:1511] Processing CreateTablet for tablet d607df4f38c04c9190803085b2b1b842 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:33.764139 29539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d607df4f38c04c9190803085b2b1b842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.765470 29396 tablet_service.cc:1511] Processing CreateTablet for tablet 082807e3cf274d8c96c0332b98c67b3f (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:33.766881 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082807e3cf274d8c96c0332b98c67b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.767373 29470 tablet_service.cc:1511] Processing CreateTablet for tablet 082807e3cf274d8c96c0332b98c67b3f (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:33.768752 29470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082807e3cf274d8c96c0332b98c67b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.776714 29601 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:33.777310 29601 ts_tablet_manager.cc:1403] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.175s	user 0.006s	sys 0.007s
I20260709 13:09:33.777227 29320 tablet_service.cc:1511] Processing CreateTablet for tablet 129c6dc7c28b457b872000878f181772 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:33.778831 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129c6dc7c28b457b872000878f181772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.778474 29394 tablet_service.cc:1511] Processing CreateTablet for tablet 129c6dc7c28b457b872000878f181772 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:33.780287 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129c6dc7c28b457b872000878f181772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.780823 29601 raft_consensus.cc:359] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:33.781700 29601 raft_consensus.cc:385] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.782011 29601 raft_consensus.cc:740] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.783082 29601 consensus_queue.cc:260] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:33.783994 29610 raft_consensus.cc:493] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.784507 29610 raft_consensus.cc:515] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:33.789476 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:33.791111 29369 leader_election.cc:343] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.792307 29610 leader_election.cc:290] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:33.793952 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:33.796053 29370 leader_election.cc:343] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.796761 29370 leader_election.cc:304] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:33.797322 29601 ts_tablet_manager.cc:1434] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:09:33.798516 29601 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:33.805550 29610 raft_consensus.cc:2749] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.806278 29317 tablet_service.cc:1511] Processing CreateTablet for tablet 082807e3cf274d8c96c0332b98c67b3f (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:33.807756 29317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082807e3cf274d8c96c0332b98c67b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.815475 29538 tablet_service.cc:1511] Processing CreateTablet for tablet 129c6dc7c28b457b872000878f181772 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:33.816906 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 129c6dc7c28b457b872000878f181772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.829542 29467 tablet_service.cc:1511] Processing CreateTablet for tablet f97afae1ea704b1da66dcdd1a25acce4 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:33.831015 29467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97afae1ea704b1da66dcdd1a25acce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.838053 29316 tablet_service.cc:1511] Processing CreateTablet for tablet f97afae1ea704b1da66dcdd1a25acce4 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:33.839864 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97afae1ea704b1da66dcdd1a25acce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.856511 29544 tablet_service.cc:1511] Processing CreateTablet for tablet f97afae1ea704b1da66dcdd1a25acce4 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:33.858253 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97afae1ea704b1da66dcdd1a25acce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.856935 29599 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:33.868345 29600 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:33.869041 29600 ts_tablet_manager.cc:1403] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.226s	user 0.010s	sys 0.009s
I20260709 13:09:33.872084 29608 consensus_queue.cc:1048] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.877539 29601 tablet_bootstrap.cc:654] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.878695 29391 tablet_service.cc:1511] Processing CreateTablet for tablet f97fa8cf984a4161b829432f9ecf4264 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:33.880430 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97fa8cf984a4161b829432f9ecf4264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.885936 29465 tablet_service.cc:1511] Processing CreateTablet for tablet f97fa8cf984a4161b829432f9ecf4264 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:33.887316 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97fa8cf984a4161b829432f9ecf4264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.892829 29541 tablet_service.cc:1511] Processing CreateTablet for tablet f97fa8cf984a4161b829432f9ecf4264 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:33.894639 29541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97fa8cf984a4161b829432f9ecf4264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.894753 29599 ts_tablet_manager.cc:1403] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.260s	user 0.026s	sys 0.025s
I20260709 13:09:33.896811 29318 tablet_service.cc:1511] Processing CreateTablet for tablet 45d78702effa4fe58b63767c5805a8af (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:33.898233 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d78702effa4fe58b63767c5805a8af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.899063 29599 raft_consensus.cc:359] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.900118 29599 raft_consensus.cc:385] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.900493 29599 raft_consensus.cc:740] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.872165 29600 raft_consensus.cc:359] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.936256 29599 consensus_queue.cc:260] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.938730 29599 ts_tablet_manager.cc:1434] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 13:09:33.939783 29599 tablet_bootstrap.cc:492] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:33.932384 29600 raft_consensus.cc:385] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.943683 29600 raft_consensus.cc:740] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.964143 29466 tablet_service.cc:1511] Processing CreateTablet for tablet 45d78702effa4fe58b63767c5805a8af (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:33.965644 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d78702effa4fe58b63767c5805a8af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.967308 29396 tablet_service.cc:1511] Processing CreateTablet for tablet 45d78702effa4fe58b63767c5805a8af (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:33.966408 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf1de53534642b28b9b16f82438c57c (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:33.969584 29320 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf1de53534642b28b9b16f82438c57c (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:33.973829 29599 tablet_bootstrap.cc:654] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.974476 29542 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf1de53534642b28b9b16f82438c57c (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:33.989100 29542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf1de53534642b28b9b16f82438c57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.989382 29470 tablet_service.cc:1511] Processing CreateTablet for tablet 078e833dff54448e9a5a55e83660ff35 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:33.976016 29600 consensus_queue.cc:260] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:33.983332 29602 tablet_bootstrap.cc:492] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:33.992411 29602 ts_tablet_manager.cc:1403] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.313s	user 0.049s	sys 0.058s
I20260709 13:09:33.992923 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf1de53534642b28b9b16f82438c57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.987049 29601 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:33.999958 29611 raft_consensus.cc:493] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.007736 29611 raft_consensus.cc:515] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.008935 29600 ts_tablet_manager.cc:1434] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.140s	user 0.011s	sys 0.002s
I20260709 13:09:34.009083 29544 tablet_service.cc:1511] Processing CreateTablet for tablet 078e833dff54448e9a5a55e83660ff35 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:34.010111 29600 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:34.010412 29611 leader_election.cc:290] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:34.002038 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d78702effa4fe58b63767c5805a8af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.011368 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf1de53534642b28b9b16f82438c57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.990775 29470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078e833dff54448e9a5a55e83660ff35. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:33.993688 29294 consensus_peers.cc:597] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.010581 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078e833dff54448e9a5a55e83660ff35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:33.998993 29602 raft_consensus.cc:359] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.020634 29316 tablet_service.cc:1511] Processing CreateTablet for tablet 078e833dff54448e9a5a55e83660ff35 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:34.028937 29602 raft_consensus.cc:385] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.031570 29601 ts_tablet_manager.cc:1403] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.233s	user 0.011s	sys 0.009s
I20260709 13:09:34.052047 29539 tablet_service.cc:1511] Processing CreateTablet for tablet 94f844d53679454696bf4c09f6eaa88a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:34.053531 29539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f844d53679454696bf4c09f6eaa88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.045879 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
W20260709 13:09:34.055291 29445 leader_election.cc:343] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.058773 29600 tablet_bootstrap.cc:654] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.061684 29389 tablet_service.cc:1511] Processing CreateTablet for tablet 806a266f2f6a474293cb069696090159 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:34.063042 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 806a266f2f6a474293cb069696090159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.041706 29602 raft_consensus.cc:740] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.065915 29467 tablet_service.cc:1511] Processing CreateTablet for tablet 980b900980f24f1d8afef6fda8d06023 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:34.067438 29467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980b900980f24f1d8afef6fda8d06023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.053143 29465 tablet_service.cc:1511] Processing CreateTablet for tablet 806a266f2f6a474293cb069696090159 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:34.062503 29317 tablet_service.cc:1511] Processing CreateTablet for tablet 980b900980f24f1d8afef6fda8d06023 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:34.068590 29465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 806a266f2f6a474293cb069696090159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.072844 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078e833dff54448e9a5a55e83660ff35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.074640 29394 tablet_service.cc:1511] Processing CreateTablet for tablet 94f844d53679454696bf4c09f6eaa88a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:34.075564 29541 tablet_service.cc:1511] Processing CreateTablet for tablet 806a266f2f6a474293cb069696090159 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:34.076040 29394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f844d53679454696bf4c09f6eaa88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.076520 29317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980b900980f24f1d8afef6fda8d06023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.076908 29541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 806a266f2f6a474293cb069696090159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.077716 29391 tablet_service.cc:1511] Processing CreateTablet for tablet 980b900980f24f1d8afef6fda8d06023 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:34.079010 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980b900980f24f1d8afef6fda8d06023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.082270 29318 tablet_service.cc:1511] Processing CreateTablet for tablet 94f844d53679454696bf4c09f6eaa88a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:34.083679 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f844d53679454696bf4c09f6eaa88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.091543 29463 tablet_service.cc:1511] Processing CreateTablet for tablet e4ae44c83a2a422eb794cba0bfb917e1 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:34.100497 29651 raft_consensus.cc:493] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.101121 29651 raft_consensus.cc:515] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.101895 29463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ae44c83a2a422eb794cba0bfb917e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.103416 29651 leader_election.cc:290] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:34.096441 29607 raft_consensus.cc:493] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.104331 29607 raft_consensus.cc:515] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.106022 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:34.106422 29607 leader_election.cc:290] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:34.110862 29315 tablet_service.cc:1511] Processing CreateTablet for tablet e4ae44c83a2a422eb794cba0bfb917e1 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:34.112372 29315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ae44c83a2a422eb794cba0bfb917e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.113022 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:34.111075 29538 tablet_service.cc:1511] Processing CreateTablet for tablet e4ae44c83a2a422eb794cba0bfb917e1 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:09:34.116644 29518 leader_election.cc:343] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.117194 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ae44c83a2a422eb794cba0bfb917e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.115458 29651 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.124486 29651 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.114748 29602 consensus_queue.cc:260] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
W20260709 13:09:34.151871 29294 leader_election.cc:343] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.152277 29611 raft_consensus.cc:493] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.152926 29611 raft_consensus.cc:515] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.157258 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
W20260709 13:09:34.159003 29445 leader_election.cc:343] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.159674 29611 leader_election.cc:290] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:34.152411 29602 ts_tablet_manager.cc:1434] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.160s	user 0.006s	sys 0.002s
I20260709 13:09:34.161118 29602 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:34.170572 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:34.171270 29404 raft_consensus.cc:2468] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:34.177021 29462 tablet_service.cc:1511] Processing CreateTablet for tablet 20b7f988005d4faeaaa356919ab5a9f3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:34.178763 29651 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:34.179837 29617 consensus_queue.cc:1048] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.180168 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:34.181114 29406 raft_consensus.cc:2468] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:34.182505 29294 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:34.183503 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b7f988005d4faeaaa356919ab5a9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.207721 29599 tablet_bootstrap.cc:492] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:34.208710 29651 raft_consensus.cc:2804] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.212450 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:34.212747 29443 leader_election.cc:304] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:34.213552 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:34.228438 29387 tablet_service.cc:1511] Processing CreateTablet for tablet 20b7f988005d4faeaaa356919ab5a9f3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:34.229883 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b7f988005d4faeaaa356919ab5a9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.233448 29538 tablet_service.cc:1511] Processing CreateTablet for tablet 20b7f988005d4faeaaa356919ab5a9f3 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:34.234709 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b7f988005d4faeaaa356919ab5a9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.237007 29601 raft_consensus.cc:359] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.237859 29601 raft_consensus.cc:385] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.237926 29611 raft_consensus.cc:2804] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.238287 29601 raft_consensus.cc:740] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.238385 29611 raft_consensus.cc:493] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.238795 29611 raft_consensus.cc:3060] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.239144 29601 consensus_queue.cc:260] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.244066 29320 tablet_service.cc:1511] Processing CreateTablet for tablet d7de023ca3234343a50acdd1f0fddb6b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:34.245713 29320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7de023ca3234343a50acdd1f0fddb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.245615 29396 tablet_service.cc:1511] Processing CreateTablet for tablet d7de023ca3234343a50acdd1f0fddb6b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:34.247026 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7de023ca3234343a50acdd1f0fddb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.219199 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:34.249934 29517 leader_election.cc:343] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.250394 29517 leader_election.cc:304] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:34.251515 29607 raft_consensus.cc:2749] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.221210 29651 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.252933 29651 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.258172 29601 ts_tablet_manager.cc:1434] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.213s	user 0.004s	sys 0.003s
I20260709 13:09:34.259853 29552 raft_consensus.cc:2468] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
W20260709 13:09:34.237447 29443 consensus_peers.cc:597] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.225636 29602 tablet_bootstrap.cc:654] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.224148 29599 ts_tablet_manager.cc:1403] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.282s	user 0.034s	sys 0.027s
W20260709 13:09:34.278693 29295 leader_election.cc:343] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.281252 29295 leader_election.cc:304] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:34.283354 29659 raft_consensus.cc:2749] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.285640 29466 tablet_service.cc:1511] Processing CreateTablet for tablet d7de023ca3234343a50acdd1f0fddb6b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:34.287596 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7de023ca3234343a50acdd1f0fddb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.301013 29611 raft_consensus.cc:515] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.307752 29601 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:34.316506 29651 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.317052 29544 tablet_service.cc:1511] Processing CreateTablet for tablet 3b146e77806e403d90813507378d6bea (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:34.320802 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:34.323527 29553 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.327543 29611 leader_election.cc:290] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:34.328882 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:34.329612 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:34.330268 29406 raft_consensus.cc:3060] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.331245 29599 raft_consensus.cc:359] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
W20260709 13:09:34.331669 29445 leader_election.cc:343] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.332103 29599 raft_consensus.cc:385] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.336282 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b146e77806e403d90813507378d6bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.336884 29601 tablet_bootstrap.cc:654] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.345172 29553 raft_consensus.cc:2468] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:34.346693 29296 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:34.347193 29316 tablet_service.cc:1511] Processing CreateTablet for tablet 3b146e77806e403d90813507378d6bea (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:34.349217 29600 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:34.349768 29600 ts_tablet_manager.cc:1403] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.340s	user 0.033s	sys 0.025s
I20260709 13:09:34.352429 29659 raft_consensus.cc:2804] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.353228 29659 raft_consensus.cc:697] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:34.354418 29659 consensus_queue.cc:237] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.367272 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:34.378814 29404 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.361061 29600 raft_consensus.cc:359] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.381623 29600 raft_consensus.cc:385] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.382031 29600 raft_consensus.cc:740] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.383082 29600 consensus_queue.cc:260] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.388233 29600 ts_tablet_manager.cc:1434] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.005s
I20260709 13:09:34.365451 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b146e77806e403d90813507378d6bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.390566 29391 tablet_service.cc:1511] Processing CreateTablet for tablet 3b146e77806e403d90813507378d6bea (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:34.392004 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b146e77806e403d90813507378d6bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.394239 29404 raft_consensus.cc:2468] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:34.338742 29599 raft_consensus.cc:740] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.396827 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:34.397437 29600 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:34.401408 29462 tablet_service.cc:1511] Processing CreateTablet for tablet a150eab0c5544ffdb1289b03eb527a5b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:34.402222 29538 tablet_service.cc:1511] Processing CreateTablet for tablet a150eab0c5544ffdb1289b03eb527a5b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:34.404343 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a150eab0c5544ffdb1289b03eb527a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.405907 29228 catalog_manager.cc:5697] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.403497 29331 raft_consensus.cc:2468] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:34.409534 29443 leader_election.cc:304] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:34.410512 29602 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:34.358964 29651 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:34.418744 29602 ts_tablet_manager.cc:1403] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.258s	user 0.039s	sys 0.030s
I20260709 13:09:34.419123 29617 raft_consensus.cc:2804] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.419577 29617 raft_consensus.cc:493] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.413473 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a150eab0c5544ffdb1289b03eb527a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.415160 29406 raft_consensus.cc:2468] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:34.416029 29599 consensus_queue.cc:260] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.419922 29617 raft_consensus.cc:3060] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.434535 29599 ts_tablet_manager.cc:1434] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.000s
I20260709 13:09:34.435732 29443 leader_election.cc:304] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:34.437287 29599 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:34.426522 29601 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:34.426832 29318 tablet_service.cc:1511] Processing CreateTablet for tablet a150eab0c5544ffdb1289b03eb527a5b (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:34.448103 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a150eab0c5544ffdb1289b03eb527a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.446601 29617 raft_consensus.cc:515] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.452689 29617 leader_election.cc:290] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:34.453409 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
W20260709 13:09:34.454761 29445 leader_election.cc:343] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.457209 29611 raft_consensus.cc:2804] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.459086 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:34.459738 29331 raft_consensus.cc:3060] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.461786 29600 tablet_bootstrap.cc:654] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.462024 29602 raft_consensus.cc:359] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.462963 29602 raft_consensus.cc:385] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.463353 29602 raft_consensus.cc:740] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.464725 29611 raft_consensus.cc:697] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:34.465134 29391 tablet_service.cc:1511] Processing CreateTablet for tablet e043911685cb4c5889c1ea44573a0f80 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:34.465672 29611 consensus_queue.cc:237] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.466347 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e043911685cb4c5889c1ea44573a0f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.465162 29602 consensus_queue.cc:260] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.471903 29602 ts_tablet_manager.cc:1434] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.003s
I20260709 13:09:34.473593 29602 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:34.464051 29601 ts_tablet_manager.cc:1403] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.024s
I20260709 13:09:34.508842 29607 raft_consensus.cc:493] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.509632 29607 raft_consensus.cc:515] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.525334 29651 raft_consensus.cc:493] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.525511 29600 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:34.526548 29601 raft_consensus.cc:359] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.527379 29601 raft_consensus.cc:385] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.527400 29600 ts_tablet_manager.cc:1403] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.130s	user 0.023s	sys 0.035s
I20260709 13:09:34.525969 29651 raft_consensus.cc:515] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.529865 29651 leader_election.cc:290] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:34.530864 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:34.531479 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:34.532708 29610 raft_consensus.cc:493] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.533277 29610 raft_consensus.cc:515] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.531430 29600 raft_consensus.cc:359] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.534389 29600 raft_consensus.cc:385] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.534368 29466 tablet_service.cc:1511] Processing CreateTablet for tablet e043911685cb4c5889c1ea44573a0f80 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:34.535698 29610 leader_election.cc:290] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:34.536011 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e043911685cb4c5889c1ea44573a0f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.532382 29553 raft_consensus.cc:2468] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
W20260709 13:09:34.536665 29295 leader_election.cc:343] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.537119 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:34.537685 29602 tablet_bootstrap.cc:654] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.537899 29330 raft_consensus.cc:2468] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:34.539351 29369 leader_election.cc:304] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:34.539577 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:34.540318 29610 raft_consensus.cc:2804] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.540783 29610 raft_consensus.cc:493] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.541160 29610 raft_consensus.cc:3060] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:34.541272 29370 leader_election.cc:343] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.537592 29296 leader_election.cc:304] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:34.544194 29651 raft_consensus.cc:2804] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.544641 29651 raft_consensus.cc:493] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.545006 29651 raft_consensus.cc:3060] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.549194 29318 tablet_service.cc:1511] Processing CreateTablet for tablet f3460ebfc0d344b5b7ede68f74c3983a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:34.550451 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3460ebfc0d344b5b7ede68f74c3983a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.550163 29538 tablet_service.cc:1511] Processing CreateTablet for tablet e043911685cb4c5889c1ea44573a0f80 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:34.551376 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e043911685cb4c5889c1ea44573a0f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.534917 29600 raft_consensus.cc:740] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.551569 29331 raft_consensus.cc:2468] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:34.552975 29443 leader_election.cc:304] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:34.554003 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4628fa3c2c4dc29582dbdc8f25f8d1" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:34.555269 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4628fa3c2c4dc29582dbdc8f25f8d1" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:34.555917 29479 raft_consensus.cc:2468] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 0.
I20260709 13:09:34.557046 29518 leader_election.cc:304] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
W20260709 13:09:34.558884 29517 leader_election.cc:343] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:34.558522 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:34.559613 29617 raft_consensus.cc:2804] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.554196 29600 consensus_queue.cc:260] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.560181 29617 raft_consensus.cc:697] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:34.562839 29617 consensus_queue.cc:237] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.564750 29607 leader_election.cc:290] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:34.565946 29607 raft_consensus.cc:2804] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.567090 29607 raft_consensus.cc:493] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.567871 29607 raft_consensus.cc:3060] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.569555 29600 ts_tablet_manager.cc:1434] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 13:09:34.570812 29600 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:34.527741 29601 raft_consensus.cc:740] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.572901 29601 consensus_queue.cc:260] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.546813 29599 tablet_bootstrap.cc:654] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.578784 29396 tablet_service.cc:1511] Processing CreateTablet for tablet f3460ebfc0d344b5b7ede68f74c3983a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:34.580204 29396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3460ebfc0d344b5b7ede68f74c3983a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.580464 29651 raft_consensus.cc:515] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.588018 29600 tablet_bootstrap.cc:654] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.595063 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:34.596103 29651 leader_election.cc:290] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
W20260709 13:09:34.597312 29295 leader_election.cc:343] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.597748 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:34.598497 29553 raft_consensus.cc:3060] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.598709 29602 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:34.599279 29602 ts_tablet_manager.cc:1403] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.019s
I20260709 13:09:34.602422 29602 raft_consensus.cc:359] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.603011 29602 raft_consensus.cc:385] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.603262 29602 raft_consensus.cc:740] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.603152 29466 tablet_service.cc:1511] Processing CreateTablet for tablet f3460ebfc0d344b5b7ede68f74c3983a (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:34.604069 29602 consensus_queue.cc:260] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.585242 29610 raft_consensus.cc:515] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.606406 29553 raft_consensus.cc:2468] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:34.618803 29296 leader_election.cc:304] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:34.619227 29610 leader_election.cc:290] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:34.614087 29599 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:34.620173 29599 ts_tablet_manager.cc:1403] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.183s	user 0.016s	sys 0.000s
I20260709 13:09:34.620153 29651 raft_consensus.cc:2804] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.621295 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:34.621745 29651 raft_consensus.cc:697] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
W20260709 13:09:34.622947 29370 leader_election.cc:343] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.622685 29651 consensus_queue.cc:237] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.620368 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:34.623613 29599 raft_consensus.cc:359] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.624377 29599 raft_consensus.cc:385] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.624190 29331 raft_consensus.cc:3060] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.624859 29599 raft_consensus.cc:740] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.624046 29228 catalog_manager.cc:5697] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.625672 29599 consensus_queue.cc:260] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.628068 29599 ts_tablet_manager.cc:1434] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:34.629418 29599 tablet_bootstrap.cc:492] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:34.632954 29611 raft_consensus.cc:493] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.633715 29611 raft_consensus.cc:515] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.636194 29599 tablet_bootstrap.cc:654] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.640393 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df9a8d24a9d4474be608101a853cacb" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:34.644347 29226 catalog_manager.cc:5697] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.645462 29331 raft_consensus.cc:2468] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:34.647195 29369 leader_election.cc:304] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:34.648355 29610 raft_consensus.cc:2804] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.618592 29602 ts_tablet_manager.cc:1434] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:09:34.648928 29610 raft_consensus.cc:697] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:34.615772 29607 raft_consensus.cc:515] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
W20260709 13:09:34.649948 29445 leader_election.cc:343] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.650453 29610 consensus_queue.cc:237] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.652350 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4628fa3c2c4dc29582dbdc8f25f8d1" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:34.653865 29517 leader_election.cc:343] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.655573 29602 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:34.612983 29601 ts_tablet_manager.cc:1434] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.002s
I20260709 13:09:34.656363 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4628fa3c2c4dc29582dbdc8f25f8d1" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:34.659457 29479 raft_consensus.cc:3060] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.604476 29466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3460ebfc0d344b5b7ede68f74c3983a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.660681 29228 catalog_manager.cc:5697] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.667407 29544 tablet_service.cc:1511] Processing CreateTablet for tablet b4514facbaa1474a8481ce0b8849abeb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:34.668788 29544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4514facbaa1474a8481ce0b8849abeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.670708 29479 raft_consensus.cc:2468] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:34.672102 29518 leader_election.cc:304] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:34.672977 29671 raft_consensus.cc:2804] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.673816 29607 leader_election.cc:290] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:34.674543 29318 tablet_service.cc:1511] Processing CreateTablet for tablet b4514facbaa1474a8481ce0b8849abeb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:34.675851 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4514facbaa1474a8481ce0b8849abeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.682008 29599 tablet_bootstrap.cc:492] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:34.682624 29599 ts_tablet_manager.cc:1403] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.004s
I20260709 13:09:34.684481 29611 leader_election.cc:290] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:34.687254 29599 raft_consensus.cc:359] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.687718 29391 tablet_service.cc:1511] Processing CreateTablet for tablet b4514facbaa1474a8481ce0b8849abeb (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:34.688058 29599 raft_consensus.cc:385] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.688416 29599 raft_consensus.cc:740] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.689006 29391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4514facbaa1474a8481ce0b8849abeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.689524 29599 consensus_queue.cc:260] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.659693 29601 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:34.692207 29599 ts_tablet_manager.cc:1434] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:09:34.693317 29599 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:34.693428 29462 tablet_service.cc:1511] Processing CreateTablet for tablet d828a447d3f049c58c173033d6095611 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:34.694810 29462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d828a447d3f049c58c173033d6095611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.704368 29599 tablet_bootstrap.cc:654] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.710978 29601 tablet_bootstrap.cc:654] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.685784 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df9a8d24a9d4474be608101a853cacb" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:34.715116 29538 tablet_service.cc:1511] Processing CreateTablet for tablet d828a447d3f049c58c173033d6095611 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:09:34.715353 29443 leader_election.cc:343] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.715890 29443 leader_election.cc:304] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:34.717411 29611 raft_consensus.cc:2749] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.717908 29316 tablet_service.cc:1511] Processing CreateTablet for tablet d828a447d3f049c58c173033d6095611 (DEFAULT_TABLE table=test-workload [id=d4b8f6833c31416c877a1c4ccb0667d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:34.719120 29316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d828a447d3f049c58c173033d6095611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.719563 29538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d828a447d3f049c58c173033d6095611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:34.730727 29599 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:34.731264 29599 ts_tablet_manager.cc:1403] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.009s
I20260709 13:09:34.734184 29599 raft_consensus.cc:359] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.734841 29599 raft_consensus.cc:385] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.735143 29599 raft_consensus.cc:740] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.737353 29601 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:34.744279 29599 consensus_queue.cc:260] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.736577 29600 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:34.761775 29601 ts_tablet_manager.cc:1403] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.015s
I20260709 13:09:34.762055 29600 ts_tablet_manager.cc:1403] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.000s
I20260709 13:09:34.763451 29599 ts_tablet_manager.cc:1434] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.019s
I20260709 13:09:34.764669 29599 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:34.748037 29228 catalog_manager.cc:5697] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 0 to 1, leader changed from <none> to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.765703 29600 raft_consensus.cc:359] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.766557 29600 raft_consensus.cc:385] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.766902 29600 raft_consensus.cc:740] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.767800 29600 consensus_queue.cc:260] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.771886 29599 tablet_bootstrap.cc:654] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.778949 29600 ts_tablet_manager.cc:1434] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:34.787547 29599 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:34.795528 29599 ts_tablet_manager.cc:1403] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 13:09:34.797034 29600 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:34.787288 29601 raft_consensus.cc:359] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.798554 29601 raft_consensus.cc:385] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.799000 29601 raft_consensus.cc:740] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.798906 29599 raft_consensus.cc:359] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.799808 29599 raft_consensus.cc:385] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.800122 29599 raft_consensus.cc:740] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.800277 29601 consensus_queue.cc:260] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.801007 29599 consensus_queue.cc:260] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.788746 29671 raft_consensus.cc:697] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:34.803421 29599 ts_tablet_manager.cc:1434] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:34.803707 29671 consensus_queue.cc:237] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.804388 29599 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:34.804828 29600 tablet_bootstrap.cc:654] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.791846 29602 tablet_bootstrap.cc:654] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.811151 29599 tablet_bootstrap.cc:654] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.811255 29601 ts_tablet_manager.cc:1434] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 13:09:34.822810 29601 tablet_bootstrap.cc:492] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:34.824052 29229 catalog_manager.cc:5697] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 1 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.829314 29651 raft_consensus.cc:493] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.830127 29651 raft_consensus.cc:515] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.832556 29610 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.833361 29610 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.835040 29602 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:34.835582 29602 ts_tablet_manager.cc:1403] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.003s
I20260709 13:09:34.837428 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:34.847967 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:34.850497 29369 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:34.852100 29659 raft_consensus.cc:493] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.852880 29659 raft_consensus.cc:515] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.850719 29406 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.856464 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:34.859270 29651 leader_election.cc:290] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:34.860255 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:34.858598 29602 raft_consensus.cc:359] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.861014 29404 raft_consensus.cc:2468] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
W20260709 13:09:34.861159 29295 leader_election.cc:343] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.862449 29294 leader_election.cc:304] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:34.863003 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:34.863319 29651 raft_consensus.cc:2804] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.863888 29601 tablet_bootstrap.cc:654] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.863922 29651 raft_consensus.cc:493] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.863953 29610 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:34.864693 29651 raft_consensus.cc:3060] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.865576 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:34.866209 29404 raft_consensus.cc:2468] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:34.866951 29599 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:34.867421 29599 ts_tablet_manager.cc:1403] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.063s	user 0.037s	sys 0.014s
I20260709 13:09:34.867599 29294 leader_election.cc:304] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:34.868546 29611 raft_consensus.cc:493] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.868736 29658 raft_consensus.cc:2804] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.869125 29611 raft_consensus.cc:515] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.869398 29658 raft_consensus.cc:493] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.870031 29600 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:34.870126 29658 raft_consensus.cc:3060] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.870628 29600 ts_tablet_manager.cc:1403] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.034s
I20260709 13:09:34.871441 29611 leader_election.cc:290] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:34.873656 29600 raft_consensus.cc:359] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.873701 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:34.874382 29600 raft_consensus.cc:385] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.874775 29600 raft_consensus.cc:740] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.875002 29553 raft_consensus.cc:2393] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:34.875831 29600 consensus_queue.cc:260] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.877302 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:34.879513 29443 leader_election.cc:304] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:34.881119 29611 raft_consensus.cc:3060] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.874771 29599 raft_consensus.cc:359] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.883889 29599 raft_consensus.cc:385] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.864321 29659 leader_election.cc:290] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:34.884356 29599 raft_consensus.cc:740] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.861307 29602 raft_consensus.cc:385] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.885903 29599 consensus_queue.cc:260] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.890992 29602 raft_consensus.cc:740] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.892055 29602 consensus_queue.cc:260] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.893923 29599 ts_tablet_manager.cc:1434] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:09:34.893770 29658 raft_consensus.cc:515] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.895231 29599 tablet_bootstrap.cc:492] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:34.898651 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:34.894363 29602 ts_tablet_manager.cc:1434] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:09:34.901451 29600 ts_tablet_manager.cc:1434] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.030s	user 0.012s	sys 0.001s
W20260709 13:09:34.903349 29295 leader_election.cc:343] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.902536 29479 raft_consensus.cc:2468] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:34.904708 29671 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.906221 29600 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:34.906657 29658 leader_election.cc:290] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:34.907814 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:34.908423 29404 raft_consensus.cc:3060] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.908957 29599 tablet_bootstrap.cc:654] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.914666 29680 raft_consensus.cc:493] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.915385 29680 raft_consensus.cc:515] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.905207 29671 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.921478 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:34.922719 29405 raft_consensus.cc:2393] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 1: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:34.924647 29658 raft_consensus.cc:493] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.925202 29658 raft_consensus.cc:515] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:34.927039 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:34.927387 29671 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:34.927404 29658 leader_election.cc:290] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:34.929207 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:34.930809 29517 leader_election.cc:343] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.932089 29518 leader_election.cc:304] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:34.933051 29671 raft_consensus.cc:3060] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.934680 29611 raft_consensus.cc:2749] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.935417 29680 leader_election.cc:290] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:34.937026 29602 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:34.941453 29651 raft_consensus.cc:515] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:34.942533 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df9a8d24a9d4474be608101a853cacb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:34.943444 29553 raft_consensus.cc:2468] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:34.943706 29651 leader_election.cc:290] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:34.947340 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:34.948530 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df9a8d24a9d4474be608101a853cacb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:34.948865 29517 leader_election.cc:343] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.949162 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:34.949713 29602 tablet_bootstrap.cc:654] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.949326 29517 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:34.950135 29480 raft_consensus.cc:3060] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.950781 29680 raft_consensus.cc:2749] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.950908 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:34.955878 29405 raft_consensus.cc:3060] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.949206 29479 raft_consensus.cc:2468] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:34.964388 29553 raft_consensus.cc:3060] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.966871 29689 consensus_queue.cc:1048] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.969684 29671 raft_consensus.cc:2749] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.953663 29296 leader_election.cc:304] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:34.973867 29659 raft_consensus.cc:2804] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.974457 29659 raft_consensus.cc:493] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.974936 29659 raft_consensus.cc:3060] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.984405 29599 tablet_bootstrap.cc:492] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:34.985044 29599 ts_tablet_manager.cc:1403] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.090s	user 0.041s	sys 0.035s
I20260709 13:09:34.985487 29610 raft_consensus.cc:493] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.986258 29610 raft_consensus.cc:515] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:34.987958 29599 raft_consensus.cc:359] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.988722 29599 raft_consensus.cc:385] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.988997 29599 raft_consensus.cc:740] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.989892 29599 consensus_queue.cc:260] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:34.990520 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:34.991488 29554 raft_consensus.cc:2468] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:34.991995 29599 ts_tablet_manager.cc:1434] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:34.993057 29599 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:34.996625 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:34.997964 29404 raft_consensus.cc:2468] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:34.984392 29601 tablet_bootstrap.cc:492] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:35.001513 29601 ts_tablet_manager.cc:1403] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.179s	user 0.035s	sys 0.035s
I20260709 13:09:35.003178 29599 tablet_bootstrap.cc:654] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.005249 29371 leader_election.cc:304] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:35.011480 29294 leader_election.cc:304] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 81cf9a977cb447069d98dedbda0e4f06
W20260709 13:09:35.013136 29369 leader_election.cc:343] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.014348 29405 raft_consensus.cc:2468] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:35.015889 29294 leader_election.cc:304] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:35.016110 29651 raft_consensus.cc:2804] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.016783 29689 raft_consensus.cc:2804] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.016857 29651 raft_consensus.cc:697] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:35.006891 29610 leader_election.cc:290] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:35.031448 29658 consensus_queue.cc:1048] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:35.035198 29601 raft_consensus.cc:359] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:35.036460 29651 consensus_queue.cc:237] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.042969 29480 raft_consensus.cc:2468] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:35.045167 29611 consensus_queue.cc:1048] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.046015 29600 tablet_bootstrap.cc:654] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.042969 29658 consensus_queue.cc:1048] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.047842 29601 raft_consensus.cc:385] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.048388 29601 raft_consensus.cc:740] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.043529 29610 raft_consensus.cc:2804] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.055579 29689 raft_consensus.cc:697] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:35.059902 29601 consensus_queue.cc:260] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:35.063109 29659 raft_consensus.cc:515] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.064165 29602 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:35.065243 29602 ts_tablet_manager.cc:1403] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.128s	user 0.026s	sys 0.018s
I20260709 13:09:35.072227 29601 ts_tablet_manager.cc:1434] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.001s
I20260709 13:09:35.065129 29611 consensus_queue.cc:1048] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:35.060843 29610 raft_consensus.cc:493] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:35.060932 29371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 53934us
I20260709 13:09:35.076282 29610 raft_consensus.cc:3060] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.086715 29672 raft_consensus.cc:2749] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.084884 29602 raft_consensus.cc:359] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.088398 29602 raft_consensus.cc:385] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.088686 29602 raft_consensus.cc:740] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.089315 29602 consensus_queue.cc:260] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.095453 29599 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:35.096261 29599 ts_tablet_manager.cc:1403] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.016s
I20260709 13:09:35.090572 29689 consensus_queue.cc:237] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.105278 29659 leader_election.cc:290] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:35.090929 29617 consensus_queue.cc:1048] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:35.106617 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df9a8d24a9d4474be608101a853cacb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:35.107316 29552 raft_consensus.cc:3060] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.112282 29611 consensus_queue.cc:1048] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.112433 29599 raft_consensus.cc:359] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.114583 29599 raft_consensus.cc:385] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.115326 29599 raft_consensus.cc:740] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.119716 29599 consensus_queue.cc:260] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.129915 29599 ts_tablet_manager.cc:1434] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.003s
I20260709 13:09:35.132555 29599 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:35.123119 29680 raft_consensus.cc:493] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.135234 29602 ts_tablet_manager.cc:1434] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.070s	user 0.020s	sys 0.016s
I20260709 13:09:35.136656 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df9a8d24a9d4474be608101a853cacb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:35.138273 29602 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:35.145118 29479 raft_consensus.cc:3060] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.169822 29600 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:35.170348 29600 ts_tablet_manager.cc:1403] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.265s	user 0.011s	sys 0.007s
I20260709 13:09:35.187615 29610 raft_consensus.cc:515] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.189738 29602 tablet_bootstrap.cc:654] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.192821 29552 raft_consensus.cc:2468] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:35.200881 29296 leader_election.cc:304] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:35.138010 29680 raft_consensus.cc:515] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.214337 29696 raft_consensus.cc:2804] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.214979 29696 raft_consensus.cc:697] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:35.219528 29696 consensus_queue.cc:237] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.221583 29600 raft_consensus.cc:359] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.222692 29600 raft_consensus.cc:385] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.223093 29600 raft_consensus.cc:740] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
W20260709 13:09:35.228919 29370 consensus_peers.cc:597] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:35.243235 29479 raft_consensus.cc:2468] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:35.245736 29601 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:35.252930 29600 consensus_queue.cc:260] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.265031 29602 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:35.265862 29602 ts_tablet_manager.cc:1403] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.128s	user 0.032s	sys 0.030s
I20260709 13:09:35.273238 29697 consensus_queue.cc:1048] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.279752 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:35.280490 29552 raft_consensus.cc:3060] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.287783 29607 consensus_queue.cc:1048] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.289302 29693 consensus_queue.cc:1048] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.291018 29680 leader_election.cc:290] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:35.292189 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1940d3c343814440a73d53c937f06f56" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:35.294631 29329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1940d3c343814440a73d53c937f06f56" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:35.294826 29518 leader_election.cc:343] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:35.296808 29517 leader_election.cc:343] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.297501 29517 leader_election.cc:304] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:35.302569 29599 tablet_bootstrap.cc:654] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.304150 29610 leader_election.cc:290] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:35.317643 29600 ts_tablet_manager.cc:1434] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.147s	user 0.006s	sys 0.004s
I20260709 13:09:35.319202 29600 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:35.318077 29680 raft_consensus.cc:2749] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.330034 29329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:35.338589 29601 tablet_bootstrap.cc:654] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.345325 29680 raft_consensus.cc:493] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.362107 29680 raft_consensus.cc:515] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:35.368069 29680 leader_election.cc:290] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:35.369664 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b26d5bb9645bfaa8468e215b4b65d" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:35.371270 29517 leader_election.cc:343] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.373878 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b26d5bb9645bfaa8468e215b4b65d" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:35.376722 29602 raft_consensus.cc:359] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.377869 29602 raft_consensus.cc:385] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.378214 29602 raft_consensus.cc:740] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.380225 29602 consensus_queue.cc:260] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:35.385442 29518 leader_election.cc:343] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.391337 29518 leader_election.cc:304] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:35.389397 29602 ts_tablet_manager.cc:1434] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.000s
I20260709 13:09:35.398245 29602 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:35.395848 29680 raft_consensus.cc:2749] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.395962 29552 raft_consensus.cc:2468] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:35.433079 29600 tablet_bootstrap.cc:654] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.436075 29599 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
W20260709 13:09:35.447357 29721 log.cc:927] Time spent T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:09:35.562811 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:35.568250 29697 raft_consensus.cc:493] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.568922 29697 raft_consensus.cc:515] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.571806 29697 leader_election.cc:290] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:35.588083 29703 raft_consensus.cc:493] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.588778 29703 raft_consensus.cc:515] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.590904 29703 leader_election.cc:290] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:35.629087 29697 consensus_queue.cc:1048] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.629907 29651 consensus_queue.cc:1048] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.652081 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:35.652742 29402 raft_consensus.cc:3060] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.654089 29611 raft_consensus.cc:493] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.654660 29611 raft_consensus.cc:515] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.656387 29611 leader_election.cc:290] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:35.666045 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:35.657127 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0651fb124d44bf80d91e28c36d58d3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:35.670506 29295 leader_election.cc:343] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.670841 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0651fb124d44bf80d91e28c36d58d3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:35.672765 29659 consensus_queue.cc:1048] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:35.674818 29294 leader_election.cc:343] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.675294 29294 leader_election.cc:304] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:35.676934 29658 raft_consensus.cc:2749] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:35.678093 29369 leader_election.cc:343] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:35.687162 29517 consensus_peers.cc:597] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:35.657696 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:35.658403 29479 raft_consensus.cc:3060] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.693197 29599 ts_tablet_manager.cc:1403] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.562s	user 0.016s	sys 0.027s
I20260709 13:09:35.697089 29443 leader_election.cc:304] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:35.696171 29599 raft_consensus.cc:359] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.699034 29703 raft_consensus.cc:2749] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.699280 29599 raft_consensus.cc:385] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.699604 29599 raft_consensus.cc:740] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.700287 29599 consensus_queue.cc:260] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.701867 29599 ts_tablet_manager.cc:1434] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:35.702837 29599 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:35.703305 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:35.704767 29443 leader_election.cc:304] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:35.710145 29371 leader_election.cc:304] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:35.711512 29478 raft_consensus.cc:3060] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.713444 29599 tablet_bootstrap.cc:654] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.714406 29672 raft_consensus.cc:2804] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.714953 29672 raft_consensus.cc:697] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:35.715811 29672 consensus_queue.cc:237] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.737481 29600 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:35.738112 29600 ts_tablet_manager.cc:1403] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.419s	user 0.018s	sys 0.001s
I20260709 13:09:35.741099 29600 raft_consensus.cc:359] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.741839 29600 raft_consensus.cc:385] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.742448 29703 raft_consensus.cc:2749] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.746443 29602 tablet_bootstrap.cc:654] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.742122 29600 raft_consensus.cc:740] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.751073 29600 consensus_queue.cc:260] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.753235 29658 consensus_queue.cc:1048] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.754285 29689 consensus_queue.cc:1048] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.755970 29600 ts_tablet_manager.cc:1434] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:09:35.757055 29600 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:35.757826 29697 raft_consensus.cc:493] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.758358 29697 raft_consensus.cc:515] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.760569 29697 leader_election.cc:290] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:35.762547 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:35.723364 29229 catalog_manager.cc:5697] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.775355 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:35.776575 29551 raft_consensus.cc:2393] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 1: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:35.778213 29296 leader_election.cc:304] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:35.778905 29600 tablet_bootstrap.cc:654] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.779475 29697 raft_consensus.cc:3060] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.794901 29600 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:35.795536 29600 ts_tablet_manager.cc:1403] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:09:35.796797 29229 catalog_manager.cc:5697] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.802929 29600 raft_consensus.cc:359] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.803733 29600 raft_consensus.cc:385] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.804090 29600 raft_consensus.cc:740] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.809036 29600 consensus_queue.cc:260] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.813055 29600 ts_tablet_manager.cc:1434] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:09:35.814119 29600 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:35.820281 29697 raft_consensus.cc:2749] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.837993 29607 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.838768 29607 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.839823 29689 consensus_queue.cc:1048] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.841995 29607 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:35.844310 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:35.845239 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:35.845928 29517 leader_election.cc:343] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:35.846704 29517 leader_election.cc:343] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.847163 29517 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:35.848409 29607 raft_consensus.cc:2749] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.851781 29600 tablet_bootstrap.cc:654] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.863680 29602 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:35.864637 29602 ts_tablet_manager.cc:1403] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.467s	user 0.012s	sys 0.008s
I20260709 13:09:35.874790 29601 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:35.875633 29601 ts_tablet_manager.cc:1403] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.642s	user 0.026s	sys 0.003s
I20260709 13:09:35.883302 29602 raft_consensus.cc:359] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.885561 29601 raft_consensus.cc:359] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.897287 29697 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.925043 29602 raft_consensus.cc:385] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.925204 29601 raft_consensus.cc:385] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.925432 29602 raft_consensus.cc:740] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.925519 29601 raft_consensus.cc:740] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.926261 29601 consensus_queue.cc:260] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.926261 29602 consensus_queue.cc:260] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.928750 29601 ts_tablet_manager.cc:1434] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 13:09:35.929749 29601 tablet_bootstrap.cc:492] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:35.930847 29602 ts_tablet_manager.cc:1434] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:09:35.931326 29697 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.937605 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:35.938148 29602 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:35.938630 29550 raft_consensus.cc:2468] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:35.940825 29697 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:35.941169 29599 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:35.941697 29599 ts_tablet_manager.cc:1403] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.239s	user 0.047s	sys 0.054s
I20260709 13:09:35.940279 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:35.941892 29296 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:35.943065 29697 raft_consensus.cc:2804] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.943835 29697 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:35.943992 29294 leader_election.cc:343] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.944232 29697 raft_consensus.cc:3060] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.944550 29599 raft_consensus.cc:359] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.945405 29599 raft_consensus.cc:385] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.947037 29600 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:35.947566 29600 ts_tablet_manager.cc:1403] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.134s	user 0.023s	sys 0.021s
I20260709 13:09:35.945705 29599 raft_consensus.cc:740] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.949000 29602 tablet_bootstrap.cc:654] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.949653 29599 consensus_queue.cc:260] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.950033 29600 raft_consensus.cc:359] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.950683 29600 raft_consensus.cc:385] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.950963 29600 raft_consensus.cc:740] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.951730 29600 consensus_queue.cc:260] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:35.952284 29599 ts_tablet_manager.cc:1434] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:09:35.952930 29601 tablet_bootstrap.cc:654] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.953518 29599 tablet_bootstrap.cc:492] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:35.954245 29600 ts_tablet_manager.cc:1434] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:35.962221 29601 tablet_bootstrap.cc:492] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:35.962778 29601 ts_tablet_manager.cc:1403] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.002s
I20260709 13:09:35.963188 29600 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:35.951884 29697 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:35.964625 29226 catalog_manager.cc:5697] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 0 to 1, leader changed from <none> to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.967238 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:35.967900 29550 raft_consensus.cc:3060] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.968995 29599 tablet_bootstrap.cc:654] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.969939 29600 tablet_bootstrap.cc:654] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.973337 29602 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:35.973819 29602 ts_tablet_manager.cc:1403] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.003s
I20260709 13:09:35.977032 29602 raft_consensus.cc:359] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.977756 29602 raft_consensus.cc:385] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.978065 29602 raft_consensus.cc:740] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.960777 29228 catalog_manager.cc:5697] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } }
I20260709 13:09:35.978780 29602 consensus_queue.cc:260] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:35.981020 29602 ts_tablet_manager.cc:1434] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:09:35.982126 29602 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:35.986970 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:35.988396 29602 tablet_bootstrap.cc:654] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:35.989213 29294 leader_election.cc:343] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.990077 29697 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:36.006188 29607 raft_consensus.cc:493] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.007012 29607 raft_consensus.cc:515] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.010979 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:36.012635 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:36.015223 29518 leader_election.cc:343] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:36.016422 29517 leader_election.cc:343] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.017078 29517 leader_election.cc:304] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:36.018301 29680 raft_consensus.cc:2749] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.019675 29607 leader_election.cc:290] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.006114 29601 raft_consensus.cc:359] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.022131 29601 raft_consensus.cc:385] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.022596 29601 raft_consensus.cc:740] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.996954 29550 raft_consensus.cc:2468] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:36.025274 29296 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:36.027010 29697 raft_consensus.cc:2804] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.027959 29697 raft_consensus.cc:697] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:36.029225 29697 consensus_queue.cc:237] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.034706 29600 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:36.035249 29600 ts_tablet_manager.cc:1403] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.001s
I20260709 13:09:36.038254 29600 raft_consensus.cc:359] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.038933 29600 raft_consensus.cc:385] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.039201 29600 raft_consensus.cc:740] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.032836 29601 consensus_queue.cc:260] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.039935 29600 consensus_queue.cc:260] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.047176 29601 ts_tablet_manager.cc:1434] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:09:36.048339 29600 ts_tablet_manager.cc:1434] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:09:36.048571 29601 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:36.049424 29600 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:36.059325 29600 tablet_bootstrap.cc:654] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.063676 29402 raft_consensus.cc:3060] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.070891 29600 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:36.071578 29600 ts_tablet_manager.cc:1403] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 13:09:36.073989 29601 tablet_bootstrap.cc:654] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.077420 29599 tablet_bootstrap.cc:492] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:36.078015 29599 ts_tablet_manager.cc:1403] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.125s	user 0.036s	sys 0.069s
I20260709 13:09:36.077618 29600 raft_consensus.cc:359] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.078431 29600 raft_consensus.cc:385] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.078758 29600 raft_consensus.cc:740] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.083462 29600 consensus_queue.cc:260] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.090644 29599 raft_consensus.cc:359] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.091753 29599 raft_consensus.cc:385] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.092013 29599 raft_consensus.cc:740] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.092397 29600 ts_tablet_manager.cc:1434] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:09:36.092964 29599 consensus_queue.cc:260] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.094494 29600 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:36.096371 29704 raft_consensus.cc:493] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.096933 29599 ts_tablet_manager.cc:1434] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:09:36.096968 29704 raft_consensus.cc:515] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.098230 29599 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:36.099558 29602 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:36.100067 29602 ts_tablet_manager.cc:1403] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.118s	user 0.045s	sys 0.024s
I20260709 13:09:36.100487 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.101231 29328 raft_consensus.cc:2468] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:36.102573 29443 leader_election.cc:304] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:36.103456 29703 raft_consensus.cc:2804] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.103840 29703 raft_consensus.cc:493] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.104197 29703 raft_consensus.cc:3060] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.105944 29599 tablet_bootstrap.cc:654] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.107388 29602 raft_consensus.cc:359] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.108139 29602 raft_consensus.cc:385] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.108408 29602 raft_consensus.cc:740] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.109359 29602 consensus_queue.cc:260] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.112666 29602 ts_tablet_manager.cc:1434] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:09:36.113780 29704 leader_election.cc:290] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:36.113963 29602 tablet_bootstrap.cc:492] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:36.116328 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:36.105944 29600 tablet_bootstrap.cc:654] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:36.118031 29443 leader_election.cc:343] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.125131 29672 consensus_queue.cc:1048] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.127079 29602 tablet_bootstrap.cc:654] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.131574 29703 raft_consensus.cc:515] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.134431 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:36.135094 29328 raft_consensus.cc:3060] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.124948 29226 catalog_manager.cc:5697] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.146261 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:36.148228 29443 leader_election.cc:343] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.142907 29328 raft_consensus.cc:2468] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:36.149806 29443 leader_election.cc:304] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:36.154506 29704 raft_consensus.cc:2804] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.155952 29704 raft_consensus.cc:697] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:36.156869 29704 consensus_queue.cc:237] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.161501 29703 leader_election.cc:290] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:36.169660 29672 consensus_queue.cc:1048] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.185148 29229 catalog_manager.cc:5697] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.198328 29659 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.199146 29659 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.204440 29659 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:36.204758 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:36.208366 29294 leader_election.cc:343] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.209940 29599 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:36.210546 29599 ts_tablet_manager.cc:1403] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.113s	user 0.041s	sys 0.026s
I20260709 13:09:36.211410 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:36.212504 29550 raft_consensus.cc:2468] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:36.213316 29599 raft_consensus.cc:359] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.214033 29599 raft_consensus.cc:385] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.214300 29599 raft_consensus.cc:740] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.214246 29296 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:36.215428 29599 consensus_queue.cc:260] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.216418 29659 raft_consensus.cc:2804] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.217075 29659 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.217545 29659 raft_consensus.cc:3060] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.218371 29599 ts_tablet_manager.cc:1434] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:09:36.228076 29599 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:36.231032 29601 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:36.231681 29601 ts_tablet_manager.cc:1403] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.183s	user 0.033s	sys 0.022s
I20260709 13:09:36.234629 29601 raft_consensus.cc:359] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.235407 29601 raft_consensus.cc:385] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.235751 29601 raft_consensus.cc:740] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.236671 29601 consensus_queue.cc:260] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.241209 29599 tablet_bootstrap.cc:654] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.241803 29600 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:36.242372 29600 ts_tablet_manager.cc:1403] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.148s	user 0.024s	sys 0.039s
I20260709 13:09:36.243644 29601 ts_tablet_manager.cc:1434] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:36.244796 29601 tablet_bootstrap.cc:492] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:36.245764 29600 raft_consensus.cc:359] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.246779 29600 raft_consensus.cc:385] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.247135 29600 raft_consensus.cc:740] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.248014 29600 consensus_queue.cc:260] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.251582 29602 tablet_bootstrap.cc:492] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:36.252177 29607 raft_consensus.cc:493] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.252276 29602 ts_tablet_manager.cc:1403] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.139s	user 0.024s	sys 0.035s
I20260709 13:09:36.252812 29607 raft_consensus.cc:515] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.255025 29607 leader_election.cc:290] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:36.257371 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:36.257804 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:36.259224 29517 leader_election.cc:343] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:36.259749 29518 leader_election.cc:343] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.259927 29602 raft_consensus.cc:359] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.260239 29518 leader_election.cc:304] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:36.260766 29602 raft_consensus.cc:385] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.261124 29602 raft_consensus.cc:740] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.261691 29607 raft_consensus.cc:2749] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.265017 29600 ts_tablet_manager.cc:1434] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:09:36.266080 29600 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:36.270233 29601 tablet_bootstrap.cc:654] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.262775 29602 consensus_queue.cc:260] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.274436 29602 ts_tablet_manager.cc:1434] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:09:36.277578 29602 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:36.275379 29693 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.289191 29693 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.292652 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:36.293817 29550 raft_consensus.cc:2393] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:36.293891 29693 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.292812 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.296299 29369 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:36.282021 29659 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.298898 29659 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:36.299682 29693 raft_consensus.cc:3060] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.300307 29703 raft_consensus.cc:493] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.301254 29703 raft_consensus.cc:515] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.304015 29600 tablet_bootstrap.cc:654] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.305748 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1940d3c343814440a73d53c937f06f56" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:36.306254 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:36.306514 29554 raft_consensus.cc:2468] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
W20260709 13:09:36.307804 29294 leader_election.cc:343] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.311645 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1940d3c343814440a73d53c937f06f56" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.317124 29328 raft_consensus.cc:2468] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:36.315976 29445 leader_election.cc:304] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:36.312453 29703 leader_election.cc:290] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.316187 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:36.318301 29704 raft_consensus.cc:2804] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.318804 29704 raft_consensus.cc:493] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.319233 29704 raft_consensus.cc:3060] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.321449 29599 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:36.321969 29599 ts_tablet_manager.cc:1403] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.015s
I20260709 13:09:36.325237 29599 raft_consensus.cc:359] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.325909 29599 raft_consensus.cc:385] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.318812 29550 raft_consensus.cc:3060] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.326169 29599 raft_consensus.cc:740] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.326987 29599 consensus_queue.cc:260] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.329389 29599 ts_tablet_manager.cc:1434] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:36.330386 29599 tablet_bootstrap.cc:492] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:36.332536 29601 tablet_bootstrap.cc:492] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:36.333808 29601 ts_tablet_manager.cc:1403] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.021s
I20260709 13:09:36.321957 29602 tablet_bootstrap.cc:654] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.329416 29693 raft_consensus.cc:2749] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.338886 29601 raft_consensus.cc:359] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.341059 29599 tablet_bootstrap.cc:654] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.351366 29550 raft_consensus.cc:2468] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:36.352821 29296 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:36.347795 29601 raft_consensus.cc:385] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.354351 29689 raft_consensus.cc:2804] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.357560 29689 raft_consensus.cc:697] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:36.358354 29689 consensus_queue.cc:237] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.359781 29602 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:36.359815 29600 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:36.344179 29693 raft_consensus.cc:493] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.360070 29599 tablet_bootstrap.cc:492] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:36.350061 29704 raft_consensus.cc:515] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.360939 29599 ts_tablet_manager.cc:1403] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.002s
I20260709 13:09:36.360766 29693 raft_consensus.cc:515] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.362725 29704 leader_election.cc:290] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.363075 29693 leader_election.cc:290] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:36.363951 29601 raft_consensus.cc:740] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.360308 29602 ts_tablet_manager.cc:1403] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.001s
I20260709 13:09:36.364511 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0651fb124d44bf80d91e28c36d58d3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:36.365265 29478 raft_consensus.cc:2468] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:36.364848 29601 consensus_queue.cc:260] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.366374 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1940d3c343814440a73d53c937f06f56" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:36.366659 29370 leader_election.cc:304] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:36.366997 29550 raft_consensus.cc:3060] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.368929 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1940d3c343814440a73d53c937f06f56" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:36.364046 29599 raft_consensus.cc:359] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.369228 29693 raft_consensus.cc:2804] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.369571 29328 raft_consensus.cc:3060] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.369660 29693 raft_consensus.cc:493] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.370261 29693 raft_consensus.cc:3060] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.370924 29601 ts_tablet_manager.cc:1434] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:09:36.371711 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0651fb124d44bf80d91e28c36d58d3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.372002 29601 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:36.372403 29330 raft_consensus.cc:2468] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:36.379071 29601 tablet_bootstrap.cc:654] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.378912 29328 raft_consensus.cc:2468] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:36.368733 29602 raft_consensus.cc:359] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.379935 29602 raft_consensus.cc:385] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.380285 29602 raft_consensus.cc:740] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.381057 29602 consensus_queue.cc:260] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.369570 29599 raft_consensus.cc:385] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.382232 29600 ts_tablet_manager.cc:1403] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.027s
I20260709 13:09:36.382407 29599 raft_consensus.cc:740] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.385578 29600 raft_consensus.cc:359] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.386327 29600 raft_consensus.cc:385] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.386710 29600 raft_consensus.cc:740] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.387481 29600 consensus_queue.cc:260] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.381975 29550 raft_consensus.cc:2468] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:36.387945 29693 raft_consensus.cc:515] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.390472 29445 leader_election.cc:304] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:36.390973 29602 ts_tablet_manager.cc:1434] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:09:36.391497 29704 raft_consensus.cc:2804] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.392115 29704 raft_consensus.cc:697] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:36.383728 29599 consensus_queue.cc:260] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.393052 29704 consensus_queue.cc:237] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.395627 29599 ts_tablet_manager.cc:1434] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:09:36.392400 29602 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:36.403396 29599 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:36.403934 29600 ts_tablet_manager.cc:1434] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:09:36.406499 29600 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:36.412882 29693 leader_election.cc:290] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:36.457623 29599 tablet_bootstrap.cc:654] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.457901 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0651fb124d44bf80d91e28c36d58d3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:36.459623 29478 raft_consensus.cc:3060] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.465533 29602 tablet_bootstrap.cc:654] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.467096 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0651fb124d44bf80d91e28c36d58d3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
W20260709 13:09:36.469542 29260 debug-util.cc:398] Leaking SignalData structure 0x7b08000478c0 after lost signal to thread 20759
I20260709 13:09:36.469730 29672 raft_consensus.cc:493] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.471881 29260 debug-util.cc:398] Leaking SignalData structure 0x7b08001562c0 after lost signal to thread 29263
I20260709 13:09:36.471143 29672 raft_consensus.cc:515] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.473042 29696 raft_consensus.cc:493] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.474066 29696 raft_consensus.cc:515] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.468394 29328 raft_consensus.cc:3060] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.488317 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b26d5bb9645bfaa8468e215b4b65d" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:36.489552 29479 raft_consensus.cc:2468] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:36.490572 29601 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:36.491742 29601 ts_tablet_manager.cc:1403] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.120s	user 0.023s	sys 0.020s
I20260709 13:09:36.491842 29680 raft_consensus.cc:493] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.500721 29370 leader_election.cc:304] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:36.494313 29680 raft_consensus.cc:515] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.505065 29610 raft_consensus.cc:2804] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.505719 29610 raft_consensus.cc:493] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.506081 29610 raft_consensus.cc:3060] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.506274 29680 leader_election.cc:290] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:36.511062 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787fe78a1da34fb38a66dc8e8e4a416d" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:36.513546 29518 leader_election.cc:343] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.516801 29696 leader_election.cc:290] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:36.519455 29478 raft_consensus.cc:2468] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
W20260709 13:09:36.521875 29260 debug-util.cc:398] Leaking SignalData structure 0x7b0800275ee0 after lost signal to thread 29355
I20260709 13:09:36.523586 29703 raft_consensus.cc:493] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.524803 29703 raft_consensus.cc:515] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.528982 29672 leader_election.cc:290] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:36.532404 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b26d5bb9645bfaa8468e215b4b65d" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:36.533519 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787fe78a1da34fb38a66dc8e8e4a416d" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:36.533944 29554 raft_consensus.cc:2468] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:36.537562 29370 leader_election.cc:304] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
W20260709 13:09:36.539378 29517 leader_election.cc:343] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.540069 29517 leader_election.cc:304] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:36.541412 29607 raft_consensus.cc:2749] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.547401 29697 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.509977 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:36.549824 29479 raft_consensus.cc:2468] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:36.550868 29703 leader_election.cc:290] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.551947 29693 raft_consensus.cc:2804] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.553151 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.552342 29295 leader_election.cc:304] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:36.556290 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:36.561271 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:36.548295 29697 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.562541 29607 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.571344 29607 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.573475 29551 raft_consensus.cc:2468] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:36.567293 29693 raft_consensus.cc:697] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:36.576457 29693 consensus_queue.cc:237] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.569133 29330 raft_consensus.cc:2468] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:36.575054 29599 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:36.584532 29445 leader_election.cc:304] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:36.585664 29703 raft_consensus.cc:2804] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.585479 29697 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:36.586488 29659 raft_consensus.cc:2804] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.587826 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:36.589875 29599 ts_tablet_manager.cc:1403] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.187s	user 0.009s	sys 0.012s
W20260709 13:09:36.589090 29260 debug-util.cc:398] Leaking SignalData structure 0x7b08001402e0 after lost signal to thread 29430
W20260709 13:09:36.590714 29295 leader_election.cc:343] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.593472 29607 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:09:36.596002 29260 debug-util.cc:398] Leaking SignalData structure 0x7b0800142440 after lost signal to thread 29504
I20260709 13:09:36.597694 29610 raft_consensus.cc:515] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.604794 29599 raft_consensus.cc:359] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.606055 29599 raft_consensus.cc:385] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.581578 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:36.628309 29599 raft_consensus.cc:740] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.606279 29601 raft_consensus.cc:359] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.610224 29696 consensus_queue.cc:1048] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.629405 29601 raft_consensus.cc:385] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.629755 29601 raft_consensus.cc:740] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.629634 29599 consensus_queue.cc:260] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.613627 29600 tablet_bootstrap.cc:654] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:36.631698 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:36.634670 29601 consensus_queue.cc:260] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:09:36.598495 29260 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9b00 after lost signal to thread 29578
W20260709 13:09:36.614014 29443 consensus_peers.cc:597] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:36.586094 29703 raft_consensus.cc:493] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.639590 29703 raft_consensus.cc:3060] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.644735 29601 ts_tablet_manager.cc:1434] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.152s	user 0.014s	sys 0.005s
I20260709 13:09:36.647715 29599 ts_tablet_manager.cc:1434] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:09:36.646740 29601 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:36.615779 29328 raft_consensus.cc:2468] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:36.617144 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.619171 29228 catalog_manager.cc:5697] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.621989 29550 raft_consensus.cc:2468] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:36.626248 29226 catalog_manager.cc:5697] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.612564 29659 raft_consensus.cc:493] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.615650 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:36.653263 29704 consensus_queue.cc:1048] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.654210 29599 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:36.702903 29551 raft_consensus.cc:2468] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:36.697839 29659 raft_consensus.cc:3060] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.710827 29602 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:36.711624 29602 ts_tablet_manager.cc:1403] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.319s	user 0.026s	sys 0.051s
I20260709 13:09:36.711894 29610 leader_election.cc:290] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:36.712153 29607 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.693480 29370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 90870.9us
I20260709 13:09:36.718870 29696 consensus_queue.cc:1048] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:36.721009 29518 leader_election.cc:343] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.714413 29703 raft_consensus.cc:515] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.721500 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b26d5bb9645bfaa8468e215b4b65d" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:36.722280 29479 raft_consensus.cc:3060] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.725492 29296 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:36.713191 29607 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.730652 29607 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:36.731107 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
W20260709 13:09:36.731472 29371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 107954us
I20260709 13:09:36.731876 29550 raft_consensus.cc:3060] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.735435 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.698544 29330 raft_consensus.cc:2468] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 0.
I20260709 13:09:36.737227 29696 raft_consensus.cc:2804] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:36.738283 29517 leader_election.cc:343] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.740068 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b26d5bb9645bfaa8468e215b4b65d" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:36.740885 29551 raft_consensus.cc:3060] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.742579 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:36.743347 29599 tablet_bootstrap.cc:654] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.732913 29693 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.744155 29693 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.747963 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:36.749145 29553 raft_consensus.cc:2393] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:36.750605 29607 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.750939 29703 leader_election.cc:290] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.751324 29607 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.753008 29517 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:36.740329 29602 raft_consensus.cc:359] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.755043 29602 raft_consensus.cc:385] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.755409 29602 raft_consensus.cc:740] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.756027 29680 raft_consensus.cc:2804] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:36.756443 29680 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.756963 29693 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.756559 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:36.756882 29680 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:36.758599 29518 leader_election.cc:343] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.756574 29602 consensus_queue.cc:260] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.761247 29479 raft_consensus.cc:2468] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:36.763514 29550 raft_consensus.cc:2468] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:36.765744 29445 leader_election.cc:304] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:36.762550 29602 ts_tablet_manager.cc:1434] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 13:09:36.766708 29703 raft_consensus.cc:2804] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.767683 29703 raft_consensus.cc:697] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:36.768502 29602 tablet_bootstrap.cc:492] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:36.768879 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.770043 29703 consensus_queue.cc:237] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:36.770887 29517 leader_election.cc:343] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.771579 29517 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:36.773898 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:36.754506 29607 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.776249 29607 raft_consensus.cc:2749] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.779328 29659 raft_consensus.cc:515] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.780504 29602 tablet_bootstrap.cc:654] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.779847 29601 tablet_bootstrap.cc:654] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:36.801096 29328 raft_consensus.cc:2393] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
W20260709 13:09:36.801877 29517 leader_election.cc:343] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.802389 29517 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:36.813862 29777 raft_consensus.cc:2749] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.821895 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:36.825103 29369 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:36.826934 29370 leader_election.cc:304] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:36.829766 29769 raft_consensus.cc:2804] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:36.830001 29659 leader_election.cc:290] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:36.830142 29696 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.830325 29769 raft_consensus.cc:697] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:36.830842 29696 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.830696 29659 consensus_queue.cc:1048] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.831615 29769 consensus_queue.cc:237] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:36.835213 29672 raft_consensus.cc:3060] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.836169 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:36.819648 29680 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:36.853215 29600 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:36.853909 29600 ts_tablet_manager.cc:1403] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.448s	user 0.031s	sys 0.018s
I20260709 13:09:36.853873 29680 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:36.849287 29551 raft_consensus.cc:2468] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:36.864567 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1dcaf42e0d4b14a3f96b090c1ae07e" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:36.874401 29550 raft_consensus.cc:2393] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 1: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:36.887665 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:36.889293 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:36.926913 29672 raft_consensus.cc:2749] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:36.940629 29518 leader_election.cc:343] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:36.943960 29599 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:36.944404 29599 ts_tablet_manager.cc:1403] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.291s	user 0.017s	sys 0.041s
I20260709 13:09:36.933815 29296 leader_election.cc:304] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:36.954984 29601 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:36.955574 29601 ts_tablet_manager.cc:1403] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.309s	user 0.015s	sys 0.021s
I20260709 13:09:36.957114 29697 raft_consensus.cc:2749] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:36.941336 29600 raft_consensus.cc:359] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:36.963632 29600 raft_consensus.cc:385] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.964077 29600 raft_consensus.cc:740] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.961318 29599 raft_consensus.cc:359] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.965107 29599 raft_consensus.cc:385] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.965407 29599 raft_consensus.cc:740] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.967800 29599 consensus_queue.cc:260] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:36.969805 29611 consensus_queue.cc:1048] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:36.969512 29599 ts_tablet_manager.cc:1434] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:09:36.971577 29599 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:36.971066 29659 consensus_queue.cc:1048] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:37.018937 29600 consensus_queue.cc:260] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.029183 29601 raft_consensus.cc:359] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.030097 29601 raft_consensus.cc:385] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.030407 29601 raft_consensus.cc:740] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.017076 29680 raft_consensus.cc:493] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.031980 29680 raft_consensus.cc:515] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.031134 29601 consensus_queue.cc:260] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.034698 29680 leader_election.cc:290] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:37.035437 29600 ts_tablet_manager.cc:1434] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.179s	user 0.006s	sys 0.005s
I20260709 13:09:37.036263 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:37.036655 29601 ts_tablet_manager.cc:1434] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.001s
I20260709 13:09:37.038000 29601 tablet_bootstrap.cc:492] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:37.039331 29599 tablet_bootstrap.cc:654] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.040820 29696 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.043282 29696 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:37.044512 29600 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:37.044528 29328 raft_consensus.cc:2393] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:37.054069 29601 tablet_bootstrap.cc:654] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:37.055137 29517 leader_election.cc:343] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.071301 29602 tablet_bootstrap.cc:492] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:37.071751 29602 ts_tablet_manager.cc:1403] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.304s	user 0.013s	sys 0.018s
I20260709 13:09:37.068842 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:37.069075 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:37.074858 29611 consensus_queue.cc:1048] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:09:37.093132 29403 raft_consensus.cc:3060] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.079447 29672 consensus_queue.cc:1048] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:09:37.103889 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:37.105422 29551 raft_consensus.cc:2393] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 1: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:37.105165 29517 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:37.107452 29680 raft_consensus.cc:2749] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.113535 29611 raft_consensus.cc:493] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.114262 29611 raft_consensus.cc:515] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:37.117094 29295 leader_election.cc:343] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.119266 29611 leader_election.cc:290] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:09:37.130385 29296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 63404.8us
I20260709 13:09:37.139317 29599 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:37.139850 29229 catalog_manager.cc:5697] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 0 to 1, leader changed from <none> to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.142128 29599 ts_tablet_manager.cc:1403] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.171s	user 0.010s	sys 0.006s
I20260709 13:09:37.148584 29602 raft_consensus.cc:359] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.149765 29602 raft_consensus.cc:385] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.150132 29602 raft_consensus.cc:740] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.153697 29296 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:37.164393 29770 consensus_queue.cc:1048] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:37.171435 29601 tablet_bootstrap.cc:492] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:37.172009 29601 ts_tablet_manager.cc:1403] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.134s	user 0.017s	sys 0.008s
I20260709 13:09:37.173138 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e7b55465b4831a7f942c64dc80ef7" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:37.175132 29601 raft_consensus.cc:359] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.175889 29601 raft_consensus.cc:385] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:37.167354 29517 leader_election.cc:343] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.136679 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e7b55465b4831a7f942c64dc80ef7" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:37.176172 29601 raft_consensus.cc:740] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.178369 29602 consensus_queue.cc:260] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.180785 29601 consensus_queue.cc:260] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.182153 29602 ts_tablet_manager.cc:1434] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 13:09:37.185714 29601 ts_tablet_manager.cc:1434] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:09:37.187417 29602 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:37.179778 29517 leader_election.cc:304] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:37.189318 29777 raft_consensus.cc:2749] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.194249 29793 raft_consensus.cc:2749] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:09:37.195664 29443 leader_election.cc:343] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.196468 29443 leader_election.cc:343] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.196921 29443 leader_election.cc:304] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:37.195953 29601 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:37.212651 29600 tablet_bootstrap.cc:654] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.213914 29602 tablet_bootstrap.cc:654] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.206890 29704 raft_consensus.cc:2749] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.248932 29599 raft_consensus.cc:359] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.251075 29599 raft_consensus.cc:385] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.263790 29602 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:37.269069 29602 ts_tablet_manager.cc:1403] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.010s
I20260709 13:09:37.272400 29602 raft_consensus.cc:359] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.273864 29602 raft_consensus.cc:385] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.274237 29602 raft_consensus.cc:740] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.274930 29602 consensus_queue.cc:260] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.276351 29601 tablet_bootstrap.cc:654] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.274492 29704 consensus_queue.cc:1048] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.281754 29602 ts_tablet_manager.cc:1434] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:37.283067 29602 tablet_bootstrap.cc:492] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:37.251364 29599 raft_consensus.cc:740] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.299458 29611 raft_consensus.cc:493] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.300060 29611 raft_consensus.cc:515] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.301568 29601 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:37.302188 29601 ts_tablet_manager.cc:1403] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.107s	user 0.016s	sys 0.004s
I20260709 13:09:37.303421 29611 leader_election.cc:290] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:37.304765 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:37.305567 29554 raft_consensus.cc:2468] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:37.306846 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:37.307505 29403 raft_consensus.cc:2468] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:37.309502 29445 leader_election.cc:304] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:37.310338 29611 raft_consensus.cc:2804] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.310714 29611 raft_consensus.cc:493] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.311050 29611 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.318471 29795 raft_consensus.cc:493] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.319133 29795 raft_consensus.cc:515] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.321777 29795 leader_election.cc:290] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:37.323659 29704 consensus_queue.cc:1048] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:37.323820 29770 consensus_queue.cc:1048] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.326297 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a22b4c6b24ef8b19f1a79234febac" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:37.327667 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a22b4c6b24ef8b19f1a79234febac" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:37.332845 29599 consensus_queue.cc:260] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:37.334961 29294 leader_election.cc:343] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.336370 29599 ts_tablet_manager.cc:1434] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.194s	user 0.004s	sys 0.004s
I20260709 13:09:37.337790 29599 tablet_bootstrap.cc:492] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:37.339781 29602 tablet_bootstrap.cc:654] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.342864 29601 raft_consensus.cc:359] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:37.354413 29295 leader_election.cc:343] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.354969 29295 leader_election.cc:304] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:37.355576 29600 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:37.355767 29795 raft_consensus.cc:2749] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.356133 29600 ts_tablet_manager.cc:1403] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.320s	user 0.028s	sys 0.015s
I20260709 13:09:37.357266 29599 tablet_bootstrap.cc:654] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.352952 29601 raft_consensus.cc:385] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.359143 29601 raft_consensus.cc:740] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.359305 29600 raft_consensus.cc:359] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.360046 29600 raft_consensus.cc:385] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.359911 29601 consensus_queue.cc:260] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.360348 29600 raft_consensus.cc:740] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.361291 29600 consensus_queue.cc:260] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.375398 29601 ts_tablet_manager.cc:1434] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 13:09:37.378073 29611 raft_consensus.cc:515] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.382885 29602 tablet_bootstrap.cc:492] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:37.383498 29602 ts_tablet_manager.cc:1403] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.002s
I20260709 13:09:37.384262 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:37.385020 29403 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.379794 29600 ts_tablet_manager.cc:1434] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:09:37.389817 29600 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:37.390211 29611 leader_election.cc:290] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:37.391868 29601 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:37.392664 29602 raft_consensus.cc:359] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.397773 29602 raft_consensus.cc:385] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.398089 29602 raft_consensus.cc:740] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.396401 29229 catalog_manager.cc:5697] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 0 to 1, leader changed from <none> to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.399659 29602 consensus_queue.cc:260] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.399000 29403 raft_consensus.cc:2468] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:37.404258 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:37.404937 29553 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.409898 29443 leader_election.cc:304] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:37.410822 29611 raft_consensus.cc:2804] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.412360 29602 ts_tablet_manager.cc:1434] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:09:37.415298 29602 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:37.417178 29553 raft_consensus.cc:2468] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:37.415149 29611 raft_consensus.cc:697] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:37.422091 29693 consensus_queue.cc:1048] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.423403 29611 consensus_queue.cc:237] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.418771 29226 catalog_manager.cc:5697] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.441452 29599 tablet_bootstrap.cc:492] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:37.442052 29599 ts_tablet_manager.cc:1403] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.005s
I20260709 13:09:37.445094 29599 raft_consensus.cc:359] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.446206 29600 tablet_bootstrap.cc:654] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.446373 29602 tablet_bootstrap.cc:654] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.445796 29599 raft_consensus.cc:385] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.447671 29599 raft_consensus.cc:740] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.449452 29599 consensus_queue.cc:260] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.453472 29599 ts_tablet_manager.cc:1434] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:37.454738 29599 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:37.457850 29680 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.458456 29680 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.462179 29680 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:37.464217 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:37.466269 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:37.476688 29517 leader_election.cc:343] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.479187 29693 raft_consensus.cc:493] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.480754 29518 leader_election.cc:343] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.480748 29693 raft_consensus.cc:515] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.493568 29518 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:37.493717 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e7b55465b4831a7f942c64dc80ef7" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:37.494465 29328 raft_consensus.cc:2468] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:37.495860 29369 leader_election.cc:304] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:37.496771 29610 raft_consensus.cc:2804] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.497313 29610 raft_consensus.cc:493] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.497699 29610 raft_consensus.cc:3060] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.496680 29680 raft_consensus.cc:2749] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.500654 29601 tablet_bootstrap.cc:654] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.505739 29229 catalog_manager.cc:5697] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.506749 29693 leader_election.cc:290] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:37.509126 29600 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:37.509693 29600 ts_tablet_manager.cc:1403] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.006s
I20260709 13:09:37.512256 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e7b55465b4831a7f942c64dc80ef7" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:37.512709 29599 tablet_bootstrap.cc:654] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.513088 29478 raft_consensus.cc:2468] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:37.513933 29680 raft_consensus.cc:493] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.514436 29680 raft_consensus.cc:515] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.517343 29600 raft_consensus.cc:359] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.518175 29600 raft_consensus.cc:385] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.518467 29600 raft_consensus.cc:740] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.519304 29600 consensus_queue.cc:260] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.520329 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:37.522059 29517 leader_election.cc:343] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.521896 29600 ts_tablet_manager.cc:1434] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:37.523342 29680 leader_election.cc:290] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:37.524039 29600 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:37.525156 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:37.527092 29518 leader_election.cc:343] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.527683 29518 leader_election.cc:304] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:37.532752 29680 raft_consensus.cc:2749] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.530676 29602 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:37.531492 29610 raft_consensus.cc:515] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.536113 29611 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.536914 29611 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.540514 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e7b55465b4831a7f942c64dc80ef7" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:37.541612 29328 raft_consensus.cc:3060] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.552066 29610 leader_election.cc:290] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:37.553610 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7e7b55465b4831a7f942c64dc80ef7" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:37.559165 29478 raft_consensus.cc:3060] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.563454 29602 ts_tablet_manager.cc:1403] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.020s
I20260709 13:09:37.566146 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:37.566532 29602 raft_consensus.cc:359] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.567045 29553 raft_consensus.cc:2393] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:37.567323 29602 raft_consensus.cc:385] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.567669 29602 raft_consensus.cc:740] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.568099 29478 raft_consensus.cc:2468] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:37.568413 29602 consensus_queue.cc:260] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.570328 29370 leader_election.cc:304] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:37.571115 29610 raft_consensus.cc:2804] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.571847 29610 raft_consensus.cc:697] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:37.572012 29600 tablet_bootstrap.cc:654] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.572801 29610 consensus_queue.cc:237] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.577749 29599 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:37.578320 29599 ts_tablet_manager.cc:1403] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.004s
I20260709 13:09:37.579471 29602 ts_tablet_manager.cc:1434] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:37.580451 29602 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:37.581437 29599 raft_consensus.cc:359] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.582175 29599 raft_consensus.cc:385] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.582432 29599 raft_consensus.cc:740] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.583122 29599 consensus_queue.cc:260] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.578254 29601 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:37.583688 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:37.584379 29601 ts_tablet_manager.cc:1403] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.193s	user 0.021s	sys 0.013s
I20260709 13:09:37.584667 29330 raft_consensus.cc:2393] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:37.587214 29601 raft_consensus.cc:359] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.587924 29602 tablet_bootstrap.cc:654] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.587947 29601 raft_consensus.cc:385] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.588793 29601 raft_consensus.cc:740] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.589361 29443 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:37.589600 29601 consensus_queue.cc:260] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.590296 29704 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.599418 29599 ts_tablet_manager.cc:1434] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:09:37.601333 29601 ts_tablet_manager.cc:1434] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:37.602995 29601 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:37.607299 29704 raft_consensus.cc:2749] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.611158 29611 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:37.610452 29226 catalog_manager.cc:5697] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 0 to 1, leader changed from <none> to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.617945 29328 raft_consensus.cc:2468] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:37.627245 29599 tablet_bootstrap.cc:492] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:37.621500 29601 tablet_bootstrap.cc:654] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.634545 29600 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:37.635856 29602 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:37.636405 29602 ts_tablet_manager.cc:1403] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.021s
I20260709 13:09:37.639369 29602 raft_consensus.cc:359] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.640090 29602 raft_consensus.cc:385] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.640383 29602 raft_consensus.cc:740] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.641255 29602 consensus_queue.cc:260] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.641656 29599 tablet_bootstrap.cc:654] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.643532 29602 ts_tablet_manager.cc:1434] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:37.646347 29680 raft_consensus.cc:493] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.658468 29680 raft_consensus.cc:515] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.654560 29602 tablet_bootstrap.cc:492] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:37.656903 29600 ts_tablet_manager.cc:1403] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.005s
I20260709 13:09:37.661803 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:37.663378 29517 leader_election.cc:343] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.665330 29600 raft_consensus.cc:359] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.666169 29600 raft_consensus.cc:385] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.666450 29600 raft_consensus.cc:740] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.667181 29600 consensus_queue.cc:260] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.668169 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:37.668715 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:37.670874 29600 ts_tablet_manager.cc:1434] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:09:37.668751 29680 leader_election.cc:290] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:09:37.672891 29517 leader_election.cc:343] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.673218 29600 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:37.673434 29517 leader_election.cc:304] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:37.674747 29680 raft_consensus.cc:2749] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.679234 29602 tablet_bootstrap.cc:654] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.684504 29601 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:37.685134 29601 ts_tablet_manager.cc:1403] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.013s
I20260709 13:09:37.687984 29601 raft_consensus.cc:359] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.696993 29610 raft_consensus.cc:493] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.699128 29599 tablet_bootstrap.cc:492] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:37.700294 29599 ts_tablet_manager.cc:1403] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.005s
I20260709 13:09:37.700088 29610 raft_consensus.cc:515] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.702188 29602 tablet_bootstrap.cc:492] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:37.702512 29610 leader_election.cc:290] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:37.702705 29602 ts_tablet_manager.cc:1403] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.004s
I20260709 13:09:37.703182 29601 raft_consensus.cc:385] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.704064 29601 raft_consensus.cc:740] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.703364 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a22b4c6b24ef8b19f1a79234febac" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:37.699515 29600 tablet_bootstrap.cc:654] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.707265 29328 raft_consensus.cc:2468] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:37.707433 29601 consensus_queue.cc:260] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.708268 29602 raft_consensus.cc:359] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.709072 29602 raft_consensus.cc:385] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.709367 29602 raft_consensus.cc:740] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.709838 29599 raft_consensus.cc:359] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.710081 29602 consensus_queue.cc:260] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.710599 29599 raft_consensus.cc:385] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.710927 29599 raft_consensus.cc:740] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.708799 29369 leader_election.cc:304] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:37.712469 29602 ts_tablet_manager.cc:1434] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:09:37.713712 29602 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:37.714185 29601 ts_tablet_manager.cc:1434] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:09:37.715322 29601 tablet_bootstrap.cc:492] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:37.717275 29610 raft_consensus.cc:2804] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.717722 29610 raft_consensus.cc:493] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.718058 29610 raft_consensus.cc:3060] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.719283 29689 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.719777 29689 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.721953 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a22b4c6b24ef8b19f1a79234febac" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:37.722298 29602 tablet_bootstrap.cc:654] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.722680 29478 raft_consensus.cc:2468] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:37.723235 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:37.723667 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:37.723892 29403 raft_consensus.cc:2468] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:37.724414 29553 raft_consensus.cc:2468] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:37.725726 29296 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:37.727746 29659 raft_consensus.cc:2804] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.728164 29659 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.728338 29611 raft_consensus.cc:493] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.728530 29659 raft_consensus.cc:3060] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.726539 29599 consensus_queue.cc:260] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.722110 29689 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:37.728899 29611 raft_consensus.cc:515] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.735484 29601 tablet_bootstrap.cc:654] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.735644 29611 leader_election.cc:290] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:37.737488 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787fe78a1da34fb38a66dc8e8e4a416d" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:37.737690 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787fe78a1da34fb38a66dc8e8e4a416d" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:37.738245 29553 raft_consensus.cc:2468] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
W20260709 13:09:37.739248 29443 leader_election.cc:343] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.739939 29445 leader_election.cc:304] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:37.740293 29600 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:37.740952 29600 ts_tablet_manager.cc:1403] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.006s
I20260709 13:09:37.743412 29599 ts_tablet_manager.cc:1434] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:09:37.744083 29600 raft_consensus.cc:359] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.743989 29659 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.744940 29600 raft_consensus.cc:385] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.745258 29600 raft_consensus.cc:740] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.745932 29600 consensus_queue.cc:260] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.747967 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:37.748302 29600 ts_tablet_manager.cc:1434] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:37.748639 29553 raft_consensus.cc:3060] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.753113 29611 raft_consensus.cc:2804] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.753664 29611 raft_consensus.cc:493] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.754091 29611 raft_consensus.cc:3060] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.755616 29600 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:37.761806 29599 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:37.764863 29610 raft_consensus.cc:515] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.770756 29600 tablet_bootstrap.cc:654] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.768759 29659 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:37.774118 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:37.774799 29403 raft_consensus.cc:3060] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.776901 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a22b4c6b24ef8b19f1a79234febac" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:37.777587 29328 raft_consensus.cc:3060] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.777309 29553 raft_consensus.cc:2468] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:37.779412 29296 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:37.780707 29659 raft_consensus.cc:2804] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.781675 29659 raft_consensus.cc:697] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:37.782871 29659 consensus_queue.cc:237] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.785460 29611 raft_consensus.cc:515] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.788833 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787fe78a1da34fb38a66dc8e8e4a416d" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:37.790252 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787fe78a1da34fb38a66dc8e8e4a416d" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
W20260709 13:09:37.790365 29443 leader_election.cc:343] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.791576 29553 raft_consensus.cc:3060] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.794380 29610 leader_election.cc:290] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:37.792214 29611 leader_election.cc:290] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:37.799192 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6a22b4c6b24ef8b19f1a79234febac" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:37.799897 29478 raft_consensus.cc:3060] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.798205 29403 raft_consensus.cc:2468] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:37.803042 29599 tablet_bootstrap.cc:654] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.806069 29226 catalog_manager.cc:5697] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.807252 29601 tablet_bootstrap.cc:492] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:37.809856 29601 ts_tablet_manager.cc:1403] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.005s
I20260709 13:09:37.810668 29328 raft_consensus.cc:2468] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:37.812043 29680 raft_consensus.cc:493] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.812572 29601 raft_consensus.cc:359] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.812636 29680 raft_consensus.cc:515] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.813541 29601 raft_consensus.cc:385] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.813876 29601 raft_consensus.cc:740] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.814473 29369 leader_election.cc:304] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:37.816354 29600 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:37.808305 29553 raft_consensus.cc:2468] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:37.816721 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:37.814510 29601 consensus_queue.cc:260] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.817286 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:37.818271 29518 leader_election.cc:343] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:37.819046 29517 leader_election.cc:343] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:37.816874 29600 ts_tablet_manager.cc:1403] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.002s
I20260709 13:09:37.816839 29680 leader_election.cc:290] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:37.819967 29693 raft_consensus.cc:2804] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.819543 29517 leader_election.cc:304] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:37.820675 29693 raft_consensus.cc:697] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:37.821234 29680 raft_consensus.cc:2749] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:37.821535 29693 consensus_queue.cc:237] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.822721 29600 raft_consensus.cc:359] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.823349 29600 raft_consensus.cc:385] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.823586 29600 raft_consensus.cc:740] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.823683 29602 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:37.824177 29602 ts_tablet_manager.cc:1403] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.022s
I20260709 13:09:37.827366 29704 raft_consensus.cc:493] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.827419 29478 raft_consensus.cc:2468] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:37.827961 29704 raft_consensus.cc:515] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.830147 29704 leader_election.cc:290] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:37.824301 29600 consensus_queue.cc:260] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:37.831037 29445 leader_election.cc:304] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:37.831945 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:37.832718 29403 raft_consensus.cc:2468] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:37.832973 29704 raft_consensus.cc:2804] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.833948 29443 leader_election.cc:304] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:37.833141 29600 ts_tablet_manager.cc:1434] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:37.835281 29617 raft_consensus.cc:2804] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:37.835660 29617 raft_consensus.cc:493] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.835886 29600 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:37.835990 29617 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.843030 29601 ts_tablet_manager.cc:1434] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:09:37.846702 29601 tablet_bootstrap.cc:492] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:37.848065 29704 raft_consensus.cc:697] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:37.852135 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:37.852926 29553 raft_consensus.cc:2468] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:37.852646 29704 consensus_queue.cc:237] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.854727 29602 raft_consensus.cc:359] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.855726 29602 raft_consensus.cc:385] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.858506 29600 tablet_bootstrap.cc:654] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.855944 29602 raft_consensus.cc:740] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.861925 29602 consensus_queue.cc:260] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:37.867470 29617 raft_consensus.cc:515] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.870517 29617 leader_election.cc:290] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:37.873863 29602 ts_tablet_manager.cc:1434] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
I20260709 13:09:37.874367 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:37.875065 29403 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.875450 29602 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:37.890410 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:37.891026 29600 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:37.891572 29600 ts_tablet_manager.cc:1403] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.003s
I20260709 13:09:37.892207 29403 raft_consensus.cc:2468] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:37.893520 29229 catalog_manager.cc:5697] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.891021 29553 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:37.897313 29600 raft_consensus.cc:359] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.898087 29600 raft_consensus.cc:385] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.898361 29600 raft_consensus.cc:740] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.899106 29600 consensus_queue.cc:260] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.895888 29443 leader_election.cc:304] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:37.901409 29600 ts_tablet_manager.cc:1434] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:37.895669 29226 catalog_manager.cc:5697] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 0 to 1, leader changed from <none> to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.902700 29600 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:37.901413 29617 raft_consensus.cc:2804] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:37.903638 29617 raft_consensus.cc:697] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:37.904459 29617 consensus_queue.cc:237] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:37.896401 29703 consensus_queue.cc:1048] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.910063 29600 tablet_bootstrap.cc:654] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.909950 29704 consensus_queue.cc:1048] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.916877 29602 tablet_bootstrap.cc:654] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.912271 29553 raft_consensus.cc:2468] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:37.925922 29599 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:37.926446 29599 ts_tablet_manager.cc:1403] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.165s	user 0.019s	sys 0.008s
I20260709 13:09:37.936869 29599 raft_consensus.cc:359] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.950480 29599 raft_consensus.cc:385] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:37.954051 29599 raft_consensus.cc:740] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.955407 29599 consensus_queue.cc:260] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:37.947996 29601 tablet_bootstrap.cc:654] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:37.967541 29599 ts_tablet_manager.cc:1434] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:09:37.975497 29599 tablet_bootstrap.cc:492] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:37.986019 29601 tablet_bootstrap.cc:492] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:37.987481 29601 ts_tablet_manager.cc:1403] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.004s
I20260709 13:09:37.988428 29226 catalog_manager.cc:5697] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.990527 29600 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:37.994073 29600 ts_tablet_manager.cc:1403] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.023s
I20260709 13:09:37.995329 29693 consensus_queue.cc:1048] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:37.996390 29602 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:37.996966 29602 ts_tablet_manager.cc:1403] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.009s
I20260709 13:09:37.998164 29600 raft_consensus.cc:359] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.000423 29600 raft_consensus.cc:385] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.001581 29600 raft_consensus.cc:740] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:37.990522 29601 raft_consensus.cc:359] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.002996 29601 raft_consensus.cc:385] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.003398 29601 raft_consensus.cc:740] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.003569 29600 consensus_queue.cc:260] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.010130 29600 ts_tablet_manager.cc:1434] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:38.004925 29602 raft_consensus.cc:359] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.011756 29600 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:38.015163 29601 consensus_queue.cc:260] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.023380 29601 ts_tablet_manager.cc:1434] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:09:38.025038 29602 raft_consensus.cc:385] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.025396 29602 raft_consensus.cc:740] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.025539 29601 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:38.026093 29602 consensus_queue.cc:260] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.028206 29602 ts_tablet_manager.cc:1434] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.000s
I20260709 13:09:38.037988 29602 tablet_bootstrap.cc:492] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:38.032145 29601 tablet_bootstrap.cc:654] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.040323 29693 consensus_queue.cc:1048] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.034087 29600 tablet_bootstrap.cc:654] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.051792 29659 raft_consensus.cc:493] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.052716 29659 raft_consensus.cc:515] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.056891 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:38.058014 29553 raft_consensus.cc:2468] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:38.058465 29680 raft_consensus.cc:493] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.059211 29795 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.059978 29795 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.062132 29602 tablet_bootstrap.cc:654] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.063819 29795 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.059120 29680 raft_consensus.cc:515] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.065574 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:38.066287 29478 raft_consensus.cc:2468] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:38.067024 29680 leader_election.cc:290] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.067677 29295 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.069520 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:38.069738 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:38.069928 29600 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:38.070235 29552 raft_consensus.cc:2468] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:38.070495 29600 ts_tablet_manager.cc:1403] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260709 13:09:38.072999 29795 raft_consensus.cc:2804] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.073453 29795 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.071839 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:38.073794 29795 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.073698 29600 raft_consensus.cc:359] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.074668 29600 raft_consensus.cc:385] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.074980 29600 raft_consensus.cc:740] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
W20260709 13:09:38.074981 29517 leader_election.cc:343] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.075917 29600 consensus_queue.cc:260] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:38.077319 29517 leader_election.cc:343] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.051985 29599 tablet_bootstrap.cc:654] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.077993 29517 leader_election.cc:304] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.085024 29600 ts_tablet_manager.cc:1434] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:38.084342 29296 leader_election.cc:304] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:38.085813 29689 raft_consensus.cc:2804] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.082088 29680 raft_consensus.cc:2749] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.086278 29689 raft_consensus.cc:493] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.086774 29689 raft_consensus.cc:3060] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.099371 29600 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:38.099774 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:38.104812 29602 tablet_bootstrap.cc:492] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:38.101738 29659 leader_election.cc:290] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:09:38.105185 29294 leader_election.cc:343] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.106096 29602 ts_tablet_manager.cc:1403] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.007s
I20260709 13:09:38.121698 29703 raft_consensus.cc:493] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.112615 29659 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.122506 29703 raft_consensus.cc:515] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.122656 29659 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.126370 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:38.127118 29478 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:38.128700 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:38.129452 29330 raft_consensus.cc:2468] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:38.129937 29659 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.133270 29443 leader_election.cc:304] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.134284 29617 raft_consensus.cc:2804] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.134689 29617 raft_consensus.cc:493] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.135008 29617 raft_consensus.cc:3060] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.137152 29295 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.138926 29852 raft_consensus.cc:2804] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.139384 29852 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.096380 29689 raft_consensus.cc:515] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.139760 29852 raft_consensus.cc:3060] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.142663 29689 leader_election.cc:290] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.142557 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:38.143429 29552 raft_consensus.cc:3060] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.148583 29703 leader_election.cc:290] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.150274 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:38.150688 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:38.152777 29443 leader_election.cc:343] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:38.154639 29294 leader_election.cc:343] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.128765 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:38.157605 29600 tablet_bootstrap.cc:654] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.157533 29553 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:38.163457 29795 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.165096 29552 raft_consensus.cc:2468] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:38.136943 29602 raft_consensus.cc:359] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.165942 29602 raft_consensus.cc:385] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.166524 29602 raft_consensus.cc:740] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.168305 29602 consensus_queue.cc:260] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.165382 29617 raft_consensus.cc:515] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.171733 29296 leader_election.cc:304] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.172883 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:38.173522 29478 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.174868 29853 raft_consensus.cc:2804] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.175472 29853 raft_consensus.cc:697] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:38.176550 29853 consensus_queue.cc:237] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.179859 29852 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.187952 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:38.188637 29553 raft_consensus.cc:3060] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.189810 29601 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:38.190317 29601 ts_tablet_manager.cc:1403] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.165s	user 0.037s	sys 0.037s
I20260709 13:09:38.192075 29602 ts_tablet_manager.cc:1434] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:09:38.189102 29852 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.193500 29599 tablet_bootstrap.cc:492] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:38.193979 29599 ts_tablet_manager.cc:1403] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.219s	user 0.007s	sys 0.009s
I20260709 13:09:38.196576 29599 raft_consensus.cc:359] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.197965 29599 raft_consensus.cc:385] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.198218 29599 raft_consensus.cc:740] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.198731 29599 consensus_queue.cc:260] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.201710 29478 raft_consensus.cc:2468] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:38.206686 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:38.207403 29480 raft_consensus.cc:3060] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.213479 29795 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.213841 29617 leader_election.cc:290] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.222030 29295 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.222527 29553 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:38.223172 29851 raft_consensus.cc:493] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.223739 29851 raft_consensus.cc:515] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.223960 29296 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:38.220996 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:38.225699 29552 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.225169 29225 catalog_manager.cc:5697] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.227382 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa47941789a4465bfdfbd693ad766ba" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:38.228410 29689 raft_consensus.cc:2804] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.220731 29599 ts_tablet_manager.cc:1434] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:09:38.224967 29850 raft_consensus.cc:2804] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.229012 29689 raft_consensus.cc:697] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:38.229357 29850 raft_consensus.cc:697] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:38.229828 29599 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:38.230000 29689 consensus_queue.cc:237] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.230293 29850 consensus_queue.cc:237] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:38.232972 29294 leader_election.cc:343] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.233505 29610 raft_consensus.cc:493] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.233886 29601 raft_consensus.cc:359] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.234006 29610 raft_consensus.cc:515] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.234409 29851 leader_election.cc:290] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:38.238186 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787fe78a1da34fb38a66dc8e8e4a416d" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:38.238863 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:38.239159 29554 raft_consensus.cc:2393] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 1: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:38.240681 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:38.241350 29328 raft_consensus.cc:3060] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.234658 29601 raft_consensus.cc:385] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.217473 29602 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:38.244465 29601 raft_consensus.cc:740] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.222347 29600 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:38.247447 29600 ts_tablet_manager.cc:1403] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.007s
I20260709 13:09:38.245500 29601 consensus_queue.cc:260] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.250064 29601 ts_tablet_manager.cc:1434] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:09:38.250952 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787fe78a1da34fb38a66dc8e8e4a416d" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:38.220270 29480 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:38.253057 29370 leader_election.cc:304] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:38.254261 29693 raft_consensus.cc:3060] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.236433 29610 leader_election.cc:290] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.269044 29599 tablet_bootstrap.cc:654] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.277304 29693 raft_consensus.cc:2749] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:38.284204 29443 leader_election.cc:343] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.285400 29703 consensus_queue.cc:1048] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.291221 29600 raft_consensus.cc:359] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.292089 29600 raft_consensus.cc:385] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.293078 29600 raft_consensus.cc:740] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.292543 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa47941789a4465bfdfbd693ad766ba" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:38.295951 29600 consensus_queue.cc:260] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.302214 29601 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:38.309814 29600 ts_tablet_manager.cc:1434] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.002s
I20260709 13:09:38.304900 29689 raft_consensus.cc:493] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.303788 29295 leader_election.cc:343] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.316493 29600 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:38.314090 29689 raft_consensus.cc:515] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.319617 29689 leader_election.cc:290] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.310503 29852 consensus_queue.cc:1048] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:38.321462 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:38.323726 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:38.324198 29552 raft_consensus.cc:2468] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:38.324491 29554 raft_consensus.cc:2468] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:38.326434 29296 leader_election.cc:304] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:38.329784 29852 raft_consensus.cc:2804] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:38.329845 29294 leader_election.cc:343] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.330281 29852 raft_consensus.cc:493] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.330703 29852 raft_consensus.cc:3060] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.315019 29295 leader_election.cc:304] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.334625 29795 raft_consensus.cc:2749] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.339421 29610 consensus_queue.cc:1048] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.340122 29599 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:38.341058 29599 ts_tablet_manager.cc:1403] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.111s	user 0.030s	sys 0.004s
I20260709 13:09:38.346784 29601 tablet_bootstrap.cc:654] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.349144 29795 consensus_queue.cc:1048] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.349833 29599 raft_consensus.cc:359] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.350697 29599 raft_consensus.cc:385] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.350968 29599 raft_consensus.cc:740] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.351737 29599 consensus_queue.cc:260] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.353313 29328 raft_consensus.cc:2468] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:38.354938 29443 leader_election.cc:304] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.356079 29617 raft_consensus.cc:2804] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.356585 29617 raft_consensus.cc:697] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:38.358528 29693 consensus_queue.cc:1048] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.361557 29602 tablet_bootstrap.cc:654] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.357448 29617 consensus_queue.cc:237] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.375013 29599 ts_tablet_manager.cc:1434] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:09:38.376346 29599 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:38.363507 29611 consensus_queue.cc:1048] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.386996 29703 raft_consensus.cc:493] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.387632 29703 raft_consensus.cc:515] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.389860 29703 leader_election.cc:290] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.391779 29852 raft_consensus.cc:515] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.395718 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:38.397226 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:38.397413 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
W20260709 13:09:38.397550 29294 leader_election.cc:343] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.398229 29553 raft_consensus.cc:3060] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.398887 29852 leader_election.cc:290] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:09:38.399277 29443 leader_election.cc:343] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.408910 29599 tablet_bootstrap.cc:654] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.413869 29600 tablet_bootstrap.cc:654] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.423911 29553 raft_consensus.cc:2468] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:38.437588 29857 raft_consensus.cc:493] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.438135 29296 leader_election.cc:304] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.438230 29857 raft_consensus.cc:515] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.445674 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce1e737440642bcabdd71181160d267" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:38.446090 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce1e737440642bcabdd71181160d267" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:38.447237 29689 raft_consensus.cc:2804] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.447801 29689 raft_consensus.cc:697] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
W20260709 13:09:38.447891 29518 leader_election.cc:343] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:38.449168 29517 leader_election.cc:343] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.448783 29689 consensus_queue.cc:237] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.449673 29517 leader_election.cc:304] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:38.450598 29680 raft_consensus.cc:2749] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.445075 29857 leader_election.cc:290] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:09:38.435431 29445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 72962.4us
I20260709 13:09:38.462612 29601 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:38.463204 29601 ts_tablet_manager.cc:1403] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.164s	user 0.018s	sys 0.005s
I20260709 13:09:38.480916 29672 raft_consensus.cc:493] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.481520 29672 raft_consensus.cc:515] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.485934 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:38.483475 29672 leader_election.cc:290] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:38.487740 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:38.488493 29554 raft_consensus.cc:2468] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:38.493403 29602 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:38.493980 29602 ts_tablet_manager.cc:1403] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.277s	user 0.017s	sys 0.006s
I20260709 13:09:38.486361 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:38.497618 29553 raft_consensus.cc:2393] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:38.497040 29602 raft_consensus.cc:359] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.510248 29371 leader_election.cc:304] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:38.501362 29229 catalog_manager.cc:5697] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.511469 29610 raft_consensus.cc:3060] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.498715 29445 leader_election.cc:304] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.512404 29601 raft_consensus.cc:359] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.513181 29865 raft_consensus.cc:2804] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.513599 29865 raft_consensus.cc:493] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.514003 29865 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.514968 29611 consensus_queue.cc:1048] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.518623 29599 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:38.519187 29599 ts_tablet_manager.cc:1403] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.005s
I20260709 13:09:38.507710 29228 catalog_manager.cc:5697] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.525146 29599 raft_consensus.cc:359] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.513177 29601 raft_consensus.cc:385] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.525947 29599 raft_consensus.cc:385] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.526988 29611 consensus_queue.cc:1048] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:38.534171 29599 raft_consensus.cc:740] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.525713 29228 catalog_manager.cc:5697] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.523939 29865 raft_consensus.cc:515] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.509352 29602 raft_consensus.cc:385] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.540843 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:38.541083 29602 raft_consensus.cc:740] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.535183 29599 consensus_queue.cc:260] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.542001 29602 consensus_queue.cc:260] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:38.542621 29443 leader_election.cc:343] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.544971 29599 ts_tablet_manager.cc:1434] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:09:38.546942 29602 ts_tablet_manager.cc:1434] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 13:09:38.549639 29602 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:38.549935 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:38.547650 29865 leader_election.cc:290] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.550516 29601 raft_consensus.cc:740] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.551192 29857 raft_consensus.cc:493] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.558925 29857 raft_consensus.cc:515] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.560863 29599 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:38.561193 29857 leader_election.cc:290] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:38.564069 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04c7be6ae194d58a25d56e4c5628b4a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:38.566365 29518 leader_election.cc:343] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.567425 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04c7be6ae194d58a25d56e4c5628b4a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:38.568540 29602 tablet_bootstrap.cc:654] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:38.569188 29517 leader_election.cc:343] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.569723 29517 leader_election.cc:304] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.571004 29857 raft_consensus.cc:2749] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.574275 29689 consensus_queue.cc:1048] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.579253 29601 consensus_queue.cc:260] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.582233 29600 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:38.558089 29553 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.582828 29600 ts_tablet_manager.cc:1403] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.267s	user 0.016s	sys 0.000s
I20260709 13:09:38.588402 29601 ts_tablet_manager.cc:1434] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.000s
I20260709 13:09:38.536784 29610 raft_consensus.cc:2749] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:38.593978 29601 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:38.591274 29600 raft_consensus.cc:359] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.605449 29600 raft_consensus.cc:385] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.605780 29600 raft_consensus.cc:740] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.606417 29229 catalog_manager.cc:5697] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.610669 29602 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:38.611258 29602 ts_tablet_manager.cc:1403] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.062s	user 0.004s	sys 0.007s
I20260709 13:09:38.611515 29599 tablet_bootstrap.cc:654] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.617460 29853 consensus_queue.cc:1048] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.619015 29853 consensus_queue.cc:1048] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.614091 29602 raft_consensus.cc:359] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.625447 29602 raft_consensus.cc:385] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.626366 29602 raft_consensus.cc:740] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.632622 29553 raft_consensus.cc:2468] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:38.633738 29852 raft_consensus.cc:493] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.634305 29852 raft_consensus.cc:515] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.637470 29600 consensus_queue.cc:260] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.637833 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:38.641582 29480 raft_consensus.cc:2468] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:38.642424 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:38.643050 29295 leader_election.cc:304] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.640419 29445 leader_election.cc:304] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.636451 29852 leader_election.cc:290] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.644253 29852 raft_consensus.cc:2804] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.644299 29617 raft_consensus.cc:2804] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.644799 29852 raft_consensus.cc:493] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.645004 29617 raft_consensus.cc:697] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:38.645213 29852 raft_consensus.cc:3060] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.645972 29617 consensus_queue.cc:237] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.647632 29602 consensus_queue.cc:260] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.643182 29550 raft_consensus.cc:2468] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:38.651425 29602 ts_tablet_manager.cc:1434] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:09:38.652513 29602 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:38.655452 29600 ts_tablet_manager.cc:1434] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:09:38.658385 29601 tablet_bootstrap.cc:654] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.658469 29602 tablet_bootstrap.cc:654] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.687542 29602 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:38.688201 29602 ts_tablet_manager.cc:1403] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.011s
I20260709 13:09:38.689939 29225 catalog_manager.cc:5697] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.656548 29600 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:38.704387 29602 raft_consensus.cc:359] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.705145 29602 raft_consensus.cc:385] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.705422 29602 raft_consensus.cc:740] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.706070 29602 consensus_queue.cc:260] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.687585 29852 raft_consensus.cc:515] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.711475 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:38.712065 29480 raft_consensus.cc:3060] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.717586 29689 consensus_queue.cc:1048] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.718421 29600 tablet_bootstrap.cc:654] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.719578 29480 raft_consensus.cc:2468] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:38.720964 29295 leader_election.cc:304] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.722239 29850 raft_consensus.cc:2804] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.722741 29850 raft_consensus.cc:697] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:38.723659 29850 consensus_queue.cc:237] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.729667 29852 leader_election.cc:290] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:38.734867 29601 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:38.735567 29601 ts_tablet_manager.cc:1403] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.146s	user 0.005s	sys 0.010s
I20260709 13:09:38.736088 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:38.737051 29551 raft_consensus.cc:3060] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.738950 29601 raft_consensus.cc:359] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.739868 29601 raft_consensus.cc:385] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.740151 29601 raft_consensus.cc:740] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.744256 29602 ts_tablet_manager.cc:1434] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.001s
I20260709 13:09:38.745831 29602 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:38.747043 29851 consensus_queue.cc:1048] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.758841 29599 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:38.759406 29599 ts_tablet_manager.cc:1403] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.199s	user 0.020s	sys 0.003s
I20260709 13:09:38.761358 29551 raft_consensus.cc:2468] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:38.765149 29225 catalog_manager.cc:5697] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.772431 29851 consensus_queue.cc:1048] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:38.762735 29599 raft_consensus.cc:359] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.779608 29599 raft_consensus.cc:385] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.784955 29599 raft_consensus.cc:740] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.769084 29601 consensus_queue.cc:260] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.786198 29599 consensus_queue.cc:260] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.792830 29601 ts_tablet_manager.cc:1434] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:09:38.794186 29601 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:38.794716 29599 ts_tablet_manager.cc:1434] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.003s
I20260709 13:09:38.776650 29602 tablet_bootstrap.cc:654] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.782161 29600 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:38.798583 29600 ts_tablet_manager.cc:1403] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.142s	user 0.023s	sys 0.000s
I20260709 13:09:38.801743 29600 raft_consensus.cc:359] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.802501 29600 raft_consensus.cc:385] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.802771 29600 raft_consensus.cc:740] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.803433 29600 consensus_queue.cc:260] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.796419 29599 tablet_bootstrap.cc:492] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
W20260709 13:09:38.807025 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:38.811610 29600 ts_tablet_manager.cc:1434] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:09:38.812798 29600 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:38.814239 29857 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.814780 29857 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.817068 29857 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:38.817842 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:38.818563 29478 raft_consensus.cc:2468] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:38.821717 29518 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.824056 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:38.824779 29330 raft_consensus.cc:2468] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:38.826038 29857 raft_consensus.cc:2804] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:38.833945 29857 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.834475 29857 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.821712 29599 tablet_bootstrap.cc:654] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.847529 29601 tablet_bootstrap.cc:654] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.833261 29617 consensus_queue.cc:1048] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:38.850016 29600 tablet_bootstrap.cc:654] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.852974 29857 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.867167 29857 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:38.867913 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:38.868680 29328 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.869336 29617 raft_consensus.cc:493] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.870925 29617 raft_consensus.cc:515] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.871201 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:38.871840 29478 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.875336 29617 leader_election.cc:290] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.881150 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa47941789a4465bfdfbd693ad766ba" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:38.881886 29402 raft_consensus.cc:2468] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:38.884135 29403 raft_consensus.cc:3060] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.889055 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa47941789a4465bfdfbd693ad766ba" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:38.889947 29330 raft_consensus.cc:2468] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:38.892940 29443 leader_election.cc:304] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.896440 29703 raft_consensus.cc:2804] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.896987 29703 raft_consensus.cc:493] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.897351 29703 raft_consensus.cc:3060] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.897696 29328 raft_consensus.cc:2468] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:38.897961 29478 raft_consensus.cc:2468] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:38.891462 29857 raft_consensus.cc:493] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.898494 29602 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:38.899161 29602 ts_tablet_manager.cc:1403] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.014s
I20260709 13:09:38.898952 29857 raft_consensus.cc:515] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.899549 29518 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:38.900454 29680 raft_consensus.cc:2804] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.901989 29602 raft_consensus.cc:359] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.903195 29602 raft_consensus.cc:385] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.903465 29602 raft_consensus.cc:740] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.909271 29599 tablet_bootstrap.cc:492] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:38.909837 29599 ts_tablet_manager.cc:1403] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.114s	user 0.006s	sys 0.014s
I20260709 13:09:38.910107 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f5075a32114023bc747cfd4d99a934" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:38.913103 29599 raft_consensus.cc:359] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.914788 29599 raft_consensus.cc:385] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.915169 29599 raft_consensus.cc:740] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.904340 29602 consensus_queue.cc:260] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:38.917047 29517 leader_election.cc:343] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.918139 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f5075a32114023bc747cfd4d99a934" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:38.918845 29330 raft_consensus.cc:2468] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 0.
I20260709 13:09:38.903403 29857 leader_election.cc:290] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.928700 29599 consensus_queue.cc:260] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:38.931362 29517 leader_election.cc:304] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:38.931573 29703 raft_consensus.cc:515] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.932237 29894 raft_consensus.cc:2804] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:38.927222 29680 raft_consensus.cc:697] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:38.935174 29602 ts_tablet_manager.cc:1434] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:09:38.933036 29894 raft_consensus.cc:493] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.938671 29894 raft_consensus.cc:3060] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.939414 29602 tablet_bootstrap.cc:492] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:38.938892 29600 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:38.939783 29680 consensus_queue.cc:237] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:38.949684 29600 ts_tablet_manager.cc:1403] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.019s
I20260709 13:09:38.950085 29894 raft_consensus.cc:515] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.951610 29703 leader_election.cc:290] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.940999 29601 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:38.953773 29601 ts_tablet_manager.cc:1403] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.160s	user 0.009s	sys 0.017s
I20260709 13:09:38.954973 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa47941789a4465bfdfbd693ad766ba" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:38.955839 29402 raft_consensus.cc:3060] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.956090 29894 leader_election.cc:290] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:38.958196 29329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa47941789a4465bfdfbd693ad766ba" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:38.958995 29329 raft_consensus.cc:3060] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.959509 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f5075a32114023bc747cfd4d99a934" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:38.961144 29517 leader_election.cc:343] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:38.966277 29602 tablet_bootstrap.cc:654] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:38.967998 29600 raft_consensus.cc:359] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.968813 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f5075a32114023bc747cfd4d99a934" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:38.974387 29330 raft_consensus.cc:3060] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:38.973413 29672 raft_consensus.cc:493] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.974987 29672 raft_consensus.cc:515] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.976579 29703 consensus_queue.cc:1048] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:38.976748 29601 raft_consensus.cc:359] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.977675 29601 raft_consensus.cc:385] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.978000 29601 raft_consensus.cc:740] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.980238 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:38.971818 29294 consensus_peers.cc:597] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.981220 29672 leader_election.cc:290] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:38.982494 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:38.986033 29370 leader_election.cc:304] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:38.972398 29402 raft_consensus.cc:2468] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:38.988144 29443 leader_election.cc:304] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:38.989130 29703 raft_consensus.cc:2804] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:38.988893 29601 consensus_queue.cc:260] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:38.989660 29703 raft_consensus.cc:697] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:38.990554 29703 consensus_queue.cc:237] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.991436 29601 ts_tablet_manager.cc:1434] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:09:38.997417 29600 raft_consensus.cc:385] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:38.988118 29672 raft_consensus.cc:2749] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.001977 29600 raft_consensus.cc:740] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.998746 29329 raft_consensus.cc:2468] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:39.003155 29600 consensus_queue.cc:260] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:38.992581 29601 tablet_bootstrap.cc:492] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:39.057327 29852 raft_consensus.cc:493] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.057844 29601 tablet_bootstrap.cc:654] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.058183 29852 raft_consensus.cc:515] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:39.063753 29369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 57104.2us
I20260709 13:09:39.067214 29852 leader_election.cc:290] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:39.001260 29330 raft_consensus.cc:2468] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:39.068588 29600 ts_tablet_manager.cc:1434] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.118s	user 0.004s	sys 0.003s
I20260709 13:09:39.079084 29599 ts_tablet_manager.cc:1434] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.169s	user 0.018s	sys 0.011s
I20260709 13:09:39.081519 29228 catalog_manager.cc:5697] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.102757 29600 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
W20260709 13:09:39.076349 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 65547.4us
I20260709 13:09:39.108399 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1d7834cd644ccdb86354a7aca74628" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:39.112250 29599 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:39.118958 29602 tablet_bootstrap.cc:492] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:39.119765 29602 ts_tablet_manager.cc:1403] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.181s	user 0.026s	sys 0.002s
W20260709 13:09:39.122491 29294 leader_election.cc:343] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.129359 29517 leader_election.cc:304] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:39.130790 29680 raft_consensus.cc:2804] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.131100 29852 raft_consensus.cc:493] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.131325 29680 raft_consensus.cc:697] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:39.131640 29852 raft_consensus.cc:515] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:39.132236 29680 consensus_queue.cc:237] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:39.133862 29852 leader_election.cc:290] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:39.144752 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:39.145474 29551 raft_consensus.cc:2468] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:39.150221 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:39.150915 29405 raft_consensus.cc:2468] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:39.153115 29602 raft_consensus.cc:359] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.153582 29294 leader_election.cc:304] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:39.153947 29602 raft_consensus.cc:385] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.154376 29602 raft_consensus.cc:740] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.154448 29851 consensus_queue.cc:1048] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.155737 29602 consensus_queue.cc:260] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.156734 29689 raft_consensus.cc:2804] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.160849 29895 raft_consensus.cc:493] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.161090 29689 raft_consensus.cc:493] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.161567 29689 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.161458 29895 raft_consensus.cc:515] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.163856 29895 leader_election.cc:290] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:39.164747 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:39.165454 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:39.160755 29602 ts_tablet_manager.cc:1434] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:09:39.171934 29228 catalog_manager.cc:5697] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:39.173530 29517 leader_election.cc:343] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:39.174494 29518 leader_election.cc:343] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.175100 29518 leader_election.cc:304] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:39.179452 29852 consensus_queue.cc:1048] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.181001 29865 raft_consensus.cc:493] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.181329 29895 raft_consensus.cc:2749] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.181569 29865 raft_consensus.cc:515] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:39.187774 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce1e737440642bcabdd71181160d267" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:39.188390 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1d7834cd644ccdb86354a7aca74628" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:39.189226 29480 raft_consensus.cc:2468] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:39.188506 29552 raft_consensus.cc:2468] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:39.190019 29865 leader_election.cc:290] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:39.193470 29445 leader_election.cc:304] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:39.194674 29865 raft_consensus.cc:2804] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.195165 29865 raft_consensus.cc:493] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.195612 29865 raft_consensus.cc:3060] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.207396 29601 tablet_bootstrap.cc:492] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:39.208062 29601 ts_tablet_manager.cc:1403] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.216s	user 0.017s	sys 0.025s
W20260709 13:09:39.208246 29443 consensus_peers.cc:597] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:39.211015 29601 raft_consensus.cc:359] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.211787 29601 raft_consensus.cc:385] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.212069 29601 raft_consensus.cc:740] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.212975 29601 consensus_queue.cc:260] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.215945 29295 leader_election.cc:304] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:39.223367 29601 ts_tablet_manager.cc:1434] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 13:09:39.227109 29853 raft_consensus.cc:2804] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.227617 29853 raft_consensus.cc:493] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.227965 29853 raft_consensus.cc:3060] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.242509 29599 tablet_bootstrap.cc:654] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.243019 29601 tablet_bootstrap.cc:492] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:39.250319 29601 tablet_bootstrap.cc:654] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.257992 29602 tablet_bootstrap.cc:492] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:39.262698 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce1e737440642bcabdd71181160d267" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:39.256291 29865 raft_consensus.cc:515] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:39.265189 29853 raft_consensus.cc:515] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:39.268127 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1d7834cd644ccdb86354a7aca74628" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:39.269490 29294 leader_election.cc:343] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.275544 29227 catalog_manager.cc:5697] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 1 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.278151 29600 tablet_bootstrap.cc:654] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.278769 29865 leader_election.cc:290] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:09:39.279850 29443 leader_election.cc:343] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.271983 29689 raft_consensus.cc:515] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:39.288048 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce1e737440642bcabdd71181160d267" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:39.289458 29865 raft_consensus.cc:493] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.290206 29865 raft_consensus.cc:515] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.293762 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04c7be6ae194d58a25d56e4c5628b4a" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:39.294138 29443 leader_election.cc:343] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.295032 29852 consensus_queue.cc:1048] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:39.295486 29443 leader_election.cc:343] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.299007 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce1e737440642bcabdd71181160d267" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:39.299654 29550 raft_consensus.cc:3060] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.312086 29865 leader_election.cc:290] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:39.331269 29689 leader_election.cc:290] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:39.336894 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:39.337872 29405 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.341221 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04c7be6ae194d58a25d56e4c5628b4a" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:39.342206 29552 raft_consensus.cc:2468] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:39.357901 29599 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:39.358188 29853 leader_election.cc:290] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:39.358691 29599 ts_tablet_manager.cc:1403] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.254s	user 0.015s	sys 0.007s
I20260709 13:09:39.359331 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1d7834cd644ccdb86354a7aca74628" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:39.359982 29478 raft_consensus.cc:3060] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.361913 29599 raft_consensus.cc:359] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:39.362709 29599 raft_consensus.cc:385] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.363021 29599 raft_consensus.cc:740] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.363867 29599 consensus_queue.cc:260] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:39.364423 29550 raft_consensus.cc:2468] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:39.365479 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:39.366355 29553 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.368415 29478 raft_consensus.cc:2468] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:39.370520 29295 leader_election.cc:304] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:39.371697 29689 raft_consensus.cc:2804] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.372244 29689 raft_consensus.cc:697] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:39.372910 29553 raft_consensus.cc:2468] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:39.373224 29689 consensus_queue.cc:237] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:39.375553 29599 ts_tablet_manager.cc:1434] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:09:39.377975 29704 consensus_queue.cc:1048] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.378605 29601 tablet_bootstrap.cc:492] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:39.379092 29601 ts_tablet_manager.cc:1403] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.136s	user 0.038s	sys 0.029s
I20260709 13:09:39.380412 29445 leader_election.cc:304] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:39.381898 29601 raft_consensus.cc:359] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.382342 29704 raft_consensus.cc:2804] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.382612 29601 raft_consensus.cc:385] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.382791 29704 raft_consensus.cc:493] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.382982 29601 raft_consensus.cc:740] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.384054 29704 raft_consensus.cc:3060] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.366377 29602 tablet_bootstrap.cc:654] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.389390 29599 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:39.392932 29405 raft_consensus.cc:2468] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:39.394672 29294 leader_election.cc:304] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:39.395648 29853 raft_consensus.cc:2804] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.396375 29853 raft_consensus.cc:697] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:39.396878 29693 raft_consensus.cc:493] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.397482 29693 raft_consensus.cc:515] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.383762 29601 consensus_queue.cc:260] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.400808 29693 leader_election.cc:290] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:39.402726 29601 ts_tablet_manager.cc:1434] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:09:39.397328 29853 consensus_queue.cc:237] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:39.406152 29704 raft_consensus.cc:515] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.406069 29601 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:39.444375 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04c7be6ae194d58a25d56e4c5628b4a" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:39.445081 29405 raft_consensus.cc:3060] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.446916 29601 tablet_bootstrap.cc:654] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.421041 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:39.448376 29553 raft_consensus.cc:2393] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 1: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:39.448791 29704 leader_election.cc:290] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:39.451777 29602 tablet_bootstrap.cc:492] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:39.452476 29602 ts_tablet_manager.cc:1403] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.216s	user 0.014s	sys 0.016s
I20260709 13:09:39.454027 29228 catalog_manager.cc:5697] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.421801 29599 tablet_bootstrap.cc:654] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.438323 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:39.456449 29602 raft_consensus.cc:359] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.457532 29602 raft_consensus.cc:385] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.457929 29602 raft_consensus.cc:740] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.458616 29370 leader_election.cc:304] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:39.439570 29600 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:39.460239 29600 ts_tablet_manager.cc:1403] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.380s	user 0.012s	sys 0.001s
I20260709 13:09:39.463328 29600 raft_consensus.cc:359] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:39.464071 29600 raft_consensus.cc:385] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.464339 29600 raft_consensus.cc:740] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.465035 29600 consensus_queue.cc:260] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:39.469779 29478 raft_consensus.cc:1275] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:39.471524 29680 consensus_queue.cc:1048] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:39.474260 29704 consensus_queue.cc:1048] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.479566 29693 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.483443 29328 raft_consensus.cc:1275] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:39.486253 29599 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:39.485664 29680 consensus_queue.cc:1048] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.486533 29405 raft_consensus.cc:2468] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:39.486626 29445 leader_election.cc:304] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:39.486840 29599 ts_tablet_manager.cc:1403] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.002s
I20260709 13:09:39.488068 29865 raft_consensus.cc:2804] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.488758 29865 raft_consensus.cc:697] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:39.489594 29865 consensus_queue.cc:237] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:39.489931 29599 raft_consensus.cc:359] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:39.490475 29600 ts_tablet_manager.cc:1434] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:09:39.490567 29443 leader_election.cc:304] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:39.491732 29600 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:39.490664 29599 raft_consensus.cc:385] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.495810 29599 raft_consensus.cc:740] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.498315 29599 consensus_queue.cc:260] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:39.458928 29602 consensus_queue.cc:260] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.502501 29703 raft_consensus.cc:2804] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.503345 29703 raft_consensus.cc:697] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:39.507496 29602 ts_tablet_manager.cc:1434] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:09:39.507215 29703 consensus_queue.cc:237] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.508771 29602 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:39.516050 29680 raft_consensus.cc:493] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.516781 29680 raft_consensus.cc:515] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:39.520246 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:39.521790 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:39.522589 29518 leader_election.cc:343] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.534673 29600 tablet_bootstrap.cc:654] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.528461 29704 consensus_queue.cc:1048] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:39.530714 29228 catalog_manager.cc:5697] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.554638 29599 ts_tablet_manager.cc:1434] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.001s
I20260709 13:09:39.554924 29602 tablet_bootstrap.cc:654] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.556180 29599 tablet_bootstrap.cc:492] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
W20260709 13:09:39.557004 29517 leader_election.cc:343] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.557564 29517 leader_election.cc:304] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:39.520516 29680 leader_election.cc:290] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:39.558615 29895 raft_consensus.cc:2749] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.569880 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04c7be6ae194d58a25d56e4c5628b4a" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:39.582576 29551 raft_consensus.cc:3060] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.605607 29704 raft_consensus.cc:493] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.606319 29704 raft_consensus.cc:515] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.635874 29601 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:39.637195 29601 ts_tablet_manager.cc:1403] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.231s	user 0.034s	sys 0.027s
I20260709 13:09:39.638386 29693 raft_consensus.cc:2749] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.658866 29704 leader_election.cc:290] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:39.660446 29599 tablet_bootstrap.cc:654] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.677603 29600 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:39.678387 29600 ts_tablet_manager.cc:1403] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.187s	user 0.029s	sys 0.005s
I20260709 13:09:39.688985 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:39.694306 29850 raft_consensus.cc:493] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.695075 29850 raft_consensus.cc:515] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:39.697261 29443 leader_election.cc:343] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.701399 29850 leader_election.cc:290] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:39.704011 29600 raft_consensus.cc:359] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:09:39.706769 29915 log.cc:927] Time spent T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:09:39.710516 29916 log.cc:927] Time spent T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:09:39.713132 29895 raft_consensus.cc:493] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.722435 29895 raft_consensus.cc:515] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:39.724130 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce1e737440642bcabdd71181160d267" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:39.725078 29548 raft_consensus.cc:2393] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 1: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:39.725358 29895 leader_election.cc:290] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:39.714751 29551 raft_consensus.cc:2468] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:39.716462 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ce1e737440642bcabdd71181160d267" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:39.717432 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:39.728340 29895 consensus_queue.cc:1048] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:39.731757 29549 raft_consensus.cc:2468] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:39.732031 29600 raft_consensus.cc:385] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.713533 29601 raft_consensus.cc:359] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:39.733314 29601 raft_consensus.cc:385] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.733673 29601 raft_consensus.cc:740] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.732475 29600 raft_consensus.cc:740] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.735430 29226 catalog_manager.cc:5697] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.739403 29226 catalog_manager.cc:5697] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.734618 29601 consensus_queue.cc:260] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:39.743569 29600 consensus_queue.cc:260] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:39.759676 29600 ts_tablet_manager.cc:1434] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:09:39.766270 29601 ts_tablet_manager.cc:1434] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.001s
I20260709 13:09:39.772367 29602 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:39.773187 29602 ts_tablet_manager.cc:1403] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.265s	user 0.031s	sys 0.030s
I20260709 13:09:39.783998 29296 leader_election.cc:304] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:39.787098 29795 raft_consensus.cc:3060] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.816921 29601 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:39.819145 29445 leader_election.cc:304] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:39.821333 29704 raft_consensus.cc:2804] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:39.821846 29704 raft_consensus.cc:493] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.822271 29704 raft_consensus.cc:3060] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.803725 29602 raft_consensus.cc:359] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:39.852548 29602 raft_consensus.cc:385] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.852998 29602 raft_consensus.cc:740] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.858744 29600 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:39.860872 29602 consensus_queue.cc:260] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:39.851841 29517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 133431us
W20260709 13:09:39.875087 29296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 89392.9us
W20260709 13:09:39.903471 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 70088.1us
W20260709 13:09:39.877300 29294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 85824.9us
I20260709 13:09:39.910053 29704 raft_consensus.cc:515] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.914929 29704 leader_election.cc:290] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
W20260709 13:09:39.916582 29517 consensus_peers.cc:597] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:39.918650 29601 tablet_bootstrap.cc:654] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.920717 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129c6dc7c28b457b872000878f181772" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:39.934624 29600 tablet_bootstrap.cc:654] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:39.911062 29445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 88723.6us
I20260709 13:09:39.940724 29602 ts_tablet_manager.cc:1434] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.167s	user 0.014s	sys 0.011s
I20260709 13:09:39.932490 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129c6dc7c28b457b872000878f181772" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:39.958819 29599 tablet_bootstrap.cc:492] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:39.959617 29599 ts_tablet_manager.cc:1403] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.404s	user 0.022s	sys 0.000s
I20260709 13:09:39.966596 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:39.967406 29551 raft_consensus.cc:3060] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.950819 29795 raft_consensus.cc:2749] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:39.977205 29403 raft_consensus.cc:3060] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:39.978338 29517 leader_election.cc:343] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:39.947672 29330 raft_consensus.cc:2468] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 0.
I20260709 13:09:39.991282 29599 raft_consensus.cc:359] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:39.992096 29599 raft_consensus.cc:385] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.993379 29934 consensus_queue.cc:1048] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:39.993505 29850 consensus_queue.cc:1048] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.013899 29929 consensus_queue.cc:1048] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.010408 29551 raft_consensus.cc:2468] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:40.017040 29445 leader_election.cc:304] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:40.019220 29703 raft_consensus.cc:2804] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.019838 29703 raft_consensus.cc:697] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:40.020921 29703 consensus_queue.cc:237] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.017006 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:39.992389 29599 raft_consensus.cc:740] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
W20260709 13:09:40.030668 29296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 112484us
I20260709 13:09:40.031702 29599 consensus_queue.cc:260] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.033795 29599 ts_tablet_manager.cc:1434] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
W20260709 13:09:40.034754 29443 leader_election.cc:343] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.038373 29602 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
W20260709 13:09:40.049928 29295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 122584us
I20260709 13:09:40.052059 29517 leader_election.cc:304] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.053870 29928 raft_consensus.cc:2804] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.054297 29928 raft_consensus.cc:493] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.054621 29928 raft_consensus.cc:3060] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.034971 29599 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:40.068113 29895 raft_consensus.cc:493] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.068753 29895 raft_consensus.cc:515] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.071791 29895 leader_election.cc:290] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:40.073832 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:40.070672 29937 consensus_queue.cc:1048] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:40.086124 29227 catalog_manager.cc:5697] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:40.089903 29518 leader_election.cc:343] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.098482 29928 raft_consensus.cc:515] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.102216 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:40.104107 29517 leader_election.cc:343] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.104914 29517 leader_election.cc:304] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.105336 29600 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:40.105926 29600 ts_tablet_manager.cc:1403] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.009s
I20260709 13:09:40.106213 29895 raft_consensus.cc:2749] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.110952 29602 tablet_bootstrap.cc:654] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.111626 29929 consensus_queue.cc:1048] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.118301 29617 consensus_queue.cc:1048] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.119678 29934 consensus_queue.cc:1048] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.137481 29599 tablet_bootstrap.cc:654] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.139575 29600 raft_consensus.cc:359] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.140441 29600 raft_consensus.cc:385] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.140818 29600 raft_consensus.cc:740] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.142566 29600 consensus_queue.cc:260] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.145383 29600 ts_tablet_manager.cc:1434] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:09:40.146543 29600 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:40.146456 29934 consensus_queue.cc:1048] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:40.150000 29928 leader_election.cc:290] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:40.167826 29601 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:40.168395 29601 ts_tablet_manager.cc:1403] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.352s	user 0.014s	sys 0.006s
I20260709 13:09:40.185181 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129c6dc7c28b457b872000878f181772" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:40.195950 29601 raft_consensus.cc:359] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.206645 29601 raft_consensus.cc:385] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.209112 29601 raft_consensus.cc:740] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.210112 29601 consensus_queue.cc:260] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.213837 29601 ts_tablet_manager.cc:1434] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:40.218503 29601 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:40.212200 29600 tablet_bootstrap.cc:654] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:40.240337 29517 leader_election.cc:343] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.246593 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "129c6dc7c28b457b872000878f181772" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:40.247731 29331 raft_consensus.cc:3060] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.260931 29929 raft_consensus.cc:493] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.261536 29929 raft_consensus.cc:515] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.263782 29929 leader_election.cc:290] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:40.268832 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:40.276054 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:40.256140 29601 tablet_bootstrap.cc:654] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:40.304682 29295 leader_election.cc:343] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.309514 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:40.310738 29550 raft_consensus.cc:2468] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:40.331538 29601 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:40.332152 29601 ts_tablet_manager.cc:1403] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.004s
I20260709 13:09:40.344641 29601 raft_consensus.cc:359] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.345486 29601 raft_consensus.cc:385] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.345788 29601 raft_consensus.cc:740] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.346926 29599 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:40.347503 29599 ts_tablet_manager.cc:1403] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.313s	user 0.012s	sys 0.010s
I20260709 13:09:40.357227 29599 raft_consensus.cc:359] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.358022 29599 raft_consensus.cc:385] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.358345 29599 raft_consensus.cc:740] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.354454 29601 consensus_queue.cc:260] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.361013 29703 raft_consensus.cc:493] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.361241 29600 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:40.361867 29600 ts_tablet_manager.cc:1403] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.216s	user 0.008s	sys 0.007s
I20260709 13:09:40.361613 29703 raft_consensus.cc:515] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.363646 29601 ts_tablet_manager.cc:1434] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.003s
I20260709 13:09:40.365078 29601 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:40.365377 29703 leader_election.cc:290] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:40.365615 29600 raft_consensus.cc:359] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.366684 29600 raft_consensus.cc:385] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.367121 29600 raft_consensus.cc:740] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.368045 29600 consensus_queue.cc:260] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.370524 29600 ts_tablet_manager.cc:1434] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:40.371451 29599 consensus_queue.cc:260] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.372345 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:40.380306 29601 tablet_bootstrap.cc:654] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.420481 29600 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:40.420491 29599 ts_tablet_manager.cc:1434] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.004s
I20260709 13:09:40.422113 29599 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:40.404819 29296 leader_election.cc:304] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06
W20260709 13:09:40.425809 29443 leader_election.cc:343] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.427165 29939 raft_consensus.cc:2804] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.427670 29939 raft_consensus.cc:493] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.428043 29939 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.435505 29329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:40.436434 29329 raft_consensus.cc:2468] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:40.443025 29599 tablet_bootstrap.cc:654] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.412926 29602 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:40.446595 29602 ts_tablet_manager.cc:1403] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.408s	user 0.028s	sys 0.022s
I20260709 13:09:40.454844 29331 raft_consensus.cc:2468] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:40.460526 29443 leader_election.cc:304] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.463004 29938 raft_consensus.cc:2804] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.455983 29939 raft_consensus.cc:515] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.463330 29602 raft_consensus.cc:359] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.469632 29602 raft_consensus.cc:385] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.470007 29602 raft_consensus.cc:740] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.463608 29938 raft_consensus.cc:493] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.477850 29602 consensus_queue.cc:260] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.477248 29938 raft_consensus.cc:3060] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.484956 29693 raft_consensus.cc:493] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.485576 29693 raft_consensus.cc:515] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.487876 29693 leader_election.cc:290] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:40.490809 29602 ts_tablet_manager.cc:1434] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.005s
I20260709 13:09:40.482160 29517 leader_election.cc:304] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.496177 29680 raft_consensus.cc:2804] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.491189 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:40.498553 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:40.503139 29371 leader_election.cc:304] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:40.504792 29602 tablet_bootstrap.cc:492] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:40.497000 29680 raft_consensus.cc:697] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:40.505368 29610 raft_consensus.cc:2749] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.505944 29939 leader_election.cc:290] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:40.506125 29680 consensus_queue.cc:237] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.507228 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:40.507882 29478 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.511974 29602 tablet_bootstrap.cc:654] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.514854 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:40.514906 29865 consensus_queue.cc:1048] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:40.518064 29550 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.521884 29938 raft_consensus.cc:515] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.526173 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:40.528131 29600 tablet_bootstrap.cc:654] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:40.529171 29443 leader_election.cc:343] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.531248 29601 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:40.531777 29601 ts_tablet_manager.cc:1403] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.018s
I20260709 13:09:40.528719 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:40.533478 29331 raft_consensus.cc:3060] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.534942 29403 raft_consensus.cc:3060] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.535594 29601 raft_consensus.cc:359] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.539054 29599 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:40.539638 29599 ts_tablet_manager.cc:1403] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.118s	user 0.016s	sys 0.016s
I20260709 13:09:40.536388 29601 raft_consensus.cc:385] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.540793 29601 raft_consensus.cc:740] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.541769 29601 consensus_queue.cc:260] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.544096 29601 ts_tablet_manager.cc:1434] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:40.524488 29938 leader_election.cc:290] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:40.551098 29599 raft_consensus.cc:359] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.552083 29599 raft_consensus.cc:385] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.552448 29599 raft_consensus.cc:740] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.556087 29478 raft_consensus.cc:2468] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:40.557576 29295 leader_election.cc:304] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:40.559080 29689 raft_consensus.cc:2804] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.557572 29331 raft_consensus.cc:2468] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:40.563844 29689 raft_consensus.cc:697] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:40.565735 29689 consensus_queue.cc:237] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.571311 29443 leader_election.cc:304] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.572526 29602 tablet_bootstrap.cc:492] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:40.563346 29599 consensus_queue.cc:260] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.559510 29601 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:40.573247 29602 ts_tablet_manager.cc:1403] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.012s
I20260709 13:09:40.574290 29927 raft_consensus.cc:493] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.574872 29927 raft_consensus.cc:515] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.576802 29599 ts_tablet_manager.cc:1434] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.001s
I20260709 13:09:40.580099 29927 leader_election.cc:290] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:40.579995 29599 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:40.580909 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:40.580842 29617 raft_consensus.cc:2804] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:40.582679 29518 leader_election.cc:343] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.583324 29617 raft_consensus.cc:697] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:40.584270 29617 consensus_queue.cc:237] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.584728 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:40.586283 29517 leader_election.cc:343] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.586966 29517 leader_election.cc:304] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:40.588027 29927 raft_consensus.cc:2749] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.596686 29599 tablet_bootstrap.cc:654] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.604003 29602 raft_consensus.cc:359] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.605383 29602 raft_consensus.cc:385] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.605893 29602 raft_consensus.cc:740] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.579383 29550 raft_consensus.cc:2468] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:40.619340 29927 raft_consensus.cc:493] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.620211 29927 raft_consensus.cc:515] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.621620 29225 catalog_manager.cc:5697] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 1 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.623397 29927 leader_election.cc:290] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:40.625839 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:40.626744 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:40.627835 29517 leader_election.cc:343] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.627858 29602 consensus_queue.cc:260] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
W20260709 13:09:40.628835 29517 leader_election.cc:343] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.629407 29517 leader_election.cc:304] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.630558 29680 raft_consensus.cc:2749] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.631784 29601 tablet_bootstrap.cc:654] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.634577 29599 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:40.635114 29599 ts_tablet_manager.cc:1403] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.007s
I20260709 13:09:40.641126 29600 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:40.641731 29600 ts_tablet_manager.cc:1403] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.014s
I20260709 13:09:40.646450 29703 raft_consensus.cc:493] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.647066 29703 raft_consensus.cc:515] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.650014 29703 leader_election.cc:290] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:40.650970 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:40.651647 29550 raft_consensus.cc:2468] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:40.653538 29445 leader_election.cc:304] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:40.654693 29599 raft_consensus.cc:359] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.654872 29600 raft_consensus.cc:359] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.655450 29599 raft_consensus.cc:385] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.655622 29600 raft_consensus.cc:385] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.655975 29600 raft_consensus.cc:740] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.655797 29599 raft_consensus.cc:740] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.656782 29600 consensus_queue.cc:260] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.657727 29599 consensus_queue.cc:260] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.659389 29600 ts_tablet_manager.cc:1434] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:40.660429 29600 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:40.660837 29703 raft_consensus.cc:2804] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.661250 29703 raft_consensus.cc:493] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.661579 29703 raft_consensus.cc:3060] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.668092 29599 ts_tablet_manager.cc:1434] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 13:09:40.684114 29599 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:40.694383 29600 tablet_bootstrap.cc:654] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.694612 29610 raft_consensus.cc:493] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.695343 29610 raft_consensus.cc:515] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.695814 29680 raft_consensus.cc:493] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.696250 29599 tablet_bootstrap.cc:654] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.702800 29610 leader_election.cc:290] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:40.696398 29680 raft_consensus.cc:515] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:40.707037 29680 leader_election.cc:290] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:40.710091 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:40.714334 29518 leader_election.cc:343] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.715308 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:40.718598 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f5075a32114023bc747cfd4d99a934" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:40.719761 29517 leader_election.cc:343] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.720363 29517 leader_election.cc:304] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:40.721792 29680 raft_consensus.cc:2749] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.731040 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f5075a32114023bc747cfd4d99a934" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:40.733713 29371 leader_election.cc:304] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:40.735040 29610 raft_consensus.cc:2749] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.736038 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:40.745707 29599 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:40.746282 29599 ts_tablet_manager.cc:1403] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.012s
I20260709 13:09:40.749228 29599 raft_consensus.cc:359] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.749905 29599 raft_consensus.cc:385] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.750188 29599 raft_consensus.cc:740] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.752843 29599 consensus_queue.cc:260] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.755698 29599 ts_tablet_manager.cc:1434] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 13:09:40.756453 29443 consensus_peers.cc:597] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.759267 29443 leader_election.cc:343] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.761284 29599 tablet_bootstrap.cc:492] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:40.768050 29599 tablet_bootstrap.cc:654] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.772804 29600 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:40.774858 29600 ts_tablet_manager.cc:1403] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.002s
I20260709 13:09:40.779282 29599 tablet_bootstrap.cc:492] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:40.787958 29599 ts_tablet_manager.cc:1403] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.008s
I20260709 13:09:40.680258 29703 raft_consensus.cc:515] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.790305 29703 leader_election.cc:290] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:40.790427 29228 catalog_manager.cc:5697] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.791353 29599 raft_consensus.cc:359] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.792197 29599 raft_consensus.cc:385] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.792519 29599 raft_consensus.cc:740] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.792304 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:40.793444 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:40.793357 29599 consensus_queue.cc:260] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.794028 29553 raft_consensus.cc:3060] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.783948 29602 ts_tablet_manager.cc:1434] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.210s	user 0.010s	sys 0.011s
I20260709 13:09:40.795337 29602 tablet_bootstrap.cc:492] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:40.795770 29599 ts_tablet_manager.cc:1434] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:40.796886 29599 tablet_bootstrap.cc:492] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:40.786064 29601 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:40.771478 29227 catalog_manager.cc:5697] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.802409 29600 raft_consensus.cc:359] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.803231 29600 raft_consensus.cc:385] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.803511 29600 raft_consensus.cc:740] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.806095 29601 ts_tablet_manager.cc:1403] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.247s	user 0.010s	sys 0.004s
W20260709 13:09:40.810494 29443 leader_election.cc:343] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.814765 29599 tablet_bootstrap.cc:654] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.804143 29600 consensus_queue.cc:260] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.818001 29600 ts_tablet_manager.cc:1434] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:09:40.819458 29600 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:40.822147 29601 raft_consensus.cc:359] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.822901 29601 raft_consensus.cc:385] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.827251 29601 raft_consensus.cc:740] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.830920 29601 consensus_queue.cc:260] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.842830 29553 raft_consensus.cc:2468] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:40.846278 29601 ts_tablet_manager.cc:1434] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:09:40.847316 29445 leader_election.cc:304] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.848192 29703 raft_consensus.cc:2804] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.848690 29703 raft_consensus.cc:697] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:40.849439 29703 consensus_queue.cc:237] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.855794 29680 raft_consensus.cc:493] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.856371 29680 raft_consensus.cc:515] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.859355 29927 raft_consensus.cc:493] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.859938 29927 raft_consensus.cc:515] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.862002 29927 leader_election.cc:290] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:40.865517 29602 tablet_bootstrap.cc:654] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.865641 29680 leader_election.cc:290] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:40.865885 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:40.866266 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "806a266f2f6a474293cb069696090159" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:40.867552 29517 leader_election.cc:343] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:40.867956 29518 leader_election.cc:343] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.863188 29600 tablet_bootstrap.cc:654] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.877075 29850 raft_consensus.cc:493] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.877665 29850 raft_consensus.cc:515] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.878609 29599 tablet_bootstrap.cc:492] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:40.879129 29599 ts_tablet_manager.cc:1403] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.013s
I20260709 13:09:40.884004 29850 leader_election.cc:290] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:40.886313 29599 raft_consensus.cc:359] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:40.886817 29401 raft_consensus.cc:3060] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.887096 29599 raft_consensus.cc:385] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.888356 29600 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:40.888968 29600 ts_tablet_manager.cc:1403] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.004s
I20260709 13:09:40.893317 29600 raft_consensus.cc:359] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.893810 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:40.887382 29599 raft_consensus.cc:740] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.895001 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "806a266f2f6a474293cb069696090159" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:40.895095 29599 consensus_queue.cc:260] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
W20260709 13:09:40.898010 29517 leader_election.cc:343] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.898487 29517 leader_election.cc:304] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.899576 29680 raft_consensus.cc:2749] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:40.902040 29294 leader_election.cc:343] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.904001 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:40.907071 29517 leader_election.cc:343] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.907527 29517 leader_election.cc:304] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.908782 29680 raft_consensus.cc:2749] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.909740 29601 tablet_bootstrap.cc:492] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:40.909502 29225 catalog_manager.cc:5697] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.913923 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:40.894038 29600 raft_consensus.cc:385] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.914985 29600 raft_consensus.cc:740] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.915256 29599 ts_tablet_manager.cc:1434] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.004s
I20260709 13:09:40.915834 29600 consensus_queue.cc:260] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:40.923620 29600 ts_tablet_manager.cc:1434] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:09:40.925107 29600 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
W20260709 13:09:40.935451 29295 leader_election.cc:343] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.936084 29295 leader_election.cc:304] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:40.937264 29689 raft_consensus.cc:2749] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.932837 29600 tablet_bootstrap.cc:654] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.939881 29693 raft_consensus.cc:493] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.940446 29693 raft_consensus.cc:515] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:40.942545 29693 leader_election.cc:290] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:40.944634 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:40.946965 29331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:40.947840 29331 raft_consensus.cc:2393] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 1: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:40.957732 29369 leader_election.cc:304] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:40.958585 29610 raft_consensus.cc:3060] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.961114 29599 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:40.970690 29610 raft_consensus.cc:2749] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.977396 29599 tablet_bootstrap.cc:654] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.985791 29602 tablet_bootstrap.cc:492] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:40.986433 29602 ts_tablet_manager.cc:1403] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.191s	user 0.014s	sys 0.000s
I20260709 13:09:40.993150 29601 tablet_bootstrap.cc:654] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.997184 29599 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:40.997287 29934 consensus_queue.cc:1048] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:40.997738 29599 ts_tablet_manager.cc:1403] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:09:41.000104 29689 raft_consensus.cc:493] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.000741 29689 raft_consensus.cc:515] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:41.002907 29689 leader_election.cc:290] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:41.003954 29599 raft_consensus.cc:359] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:41.006086 29599 raft_consensus.cc:385] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.006520 29599 raft_consensus.cc:740] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.007072 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:41.004946 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:41.007650 29599 consensus_queue.cc:260] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:41.008256 29553 raft_consensus.cc:2468] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:41.009572 29296 leader_election.cc:304] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
W20260709 13:09:41.011070 29294 leader_election.cc:343] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.012189 29851 raft_consensus.cc:2804] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.012638 29851 raft_consensus.cc:493] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.013108 29851 raft_consensus.cc:3060] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.017542 29600 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:41.018134 29600 ts_tablet_manager.cc:1403] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.019s
I20260709 13:09:41.023821 29600 raft_consensus.cc:359] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.024452 29599 ts_tablet_manager.cc:1434] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 13:09:41.024577 29600 raft_consensus.cc:385] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.033440 29600 raft_consensus.cc:740] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.027984 29680 consensus_queue.cc:1048] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:41.035218 29600 consensus_queue.cc:260] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.039816 29601 tablet_bootstrap.cc:492] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:41.040247 29600 ts_tablet_manager.cc:1434] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:09:41.040416 29601 ts_tablet_manager.cc:1403] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.000s
I20260709 13:09:41.042742 29599 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:41.052008 29600 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:41.051457 29601 raft_consensus.cc:359] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.052825 29601 raft_consensus.cc:385] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.053138 29601 raft_consensus.cc:740] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.005311 29602 raft_consensus.cc:359] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.059612 29602 raft_consensus.cc:385] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.061115 29602 raft_consensus.cc:740] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.121055 29599 tablet_bootstrap.cc:654] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.121330 29602 consensus_queue.cc:260] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.122962 29602 ts_tablet_manager.cc:1434] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.000s
I20260709 13:09:41.124053 29602 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:41.062680 29401 raft_consensus.cc:3060] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.074023 29851 raft_consensus.cc:515] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:41.132571 29600 tablet_bootstrap.cc:654] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.101684 29601 consensus_queue.cc:260] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.136930 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:41.137583 29553 raft_consensus.cc:3060] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.133220 29851 leader_election.cc:290] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:41.141186 29601 ts_tablet_manager.cc:1434] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 13:09:41.081127 29689 consensus_queue.cc:1048] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260709 13:09:41.150699 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:41.152144 29294 leader_election.cc:343] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.139823 29850 raft_consensus.cc:493] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.153033 29850 raft_consensus.cc:515] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:41.155138 29850 leader_election.cc:290] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:41.060330 29934 consensus_queue.cc:1048] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.097s
I20260709 13:09:41.156680 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d78702effa4fe58b63767c5805a8af" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:41.158177 29294 leader_election.cc:343] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.163460 29553 raft_consensus.cc:2468] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:41.181658 29296 leader_election.cc:304] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:41.189085 29601 tablet_bootstrap.cc:492] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:41.191216 29985 raft_consensus.cc:493] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.193120 29985 raft_consensus.cc:515] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.183039 29927 consensus_queue.cc:1048] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:09:41.198374 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:41.201013 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d78702effa4fe58b63767c5805a8af" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:41.206805 29295 leader_election.cc:343] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:41.201570 29518 leader_election.cc:343] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.210368 29295 leader_election.cc:304] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:41.186249 29689 raft_consensus.cc:2804] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.192286 29600 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:41.229866 29600 ts_tablet_manager.cc:1403] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.183s	user 0.021s	sys 0.010s
I20260709 13:09:41.211416 29985 leader_election.cc:290] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:41.212400 29939 raft_consensus.cc:2749] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.325011 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:41.330211 29599 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:41.334506 29599 ts_tablet_manager.cc:1403] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.292s	user 0.036s	sys 0.050s
I20260709 13:09:41.353858 29610 raft_consensus.cc:493] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.354588 29610 raft_consensus.cc:515] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.369813 29610 leader_election.cc:290] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:41.379653 29689 raft_consensus.cc:697] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
W20260709 13:09:41.413305 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:41.399199 29517 leader_election.cc:343] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.415064 29517 leader_election.cc:304] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:41.417117 29927 raft_consensus.cc:2749] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.420790 29689 consensus_queue.cc:237] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:41.426592 29602 tablet_bootstrap.cc:654] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.435400 29599 raft_consensus.cc:359] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.446357 29601 tablet_bootstrap.cc:654] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.457721 29600 raft_consensus.cc:359] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:41.458550 29600 raft_consensus.cc:385] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.458855 29600 raft_consensus.cc:740] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.459488 29600 consensus_queue.cc:260] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:41.461181 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:41.464666 29600 ts_tablet_manager.cc:1434] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.234s	user 0.007s	sys 0.000s
I20260709 13:09:41.436415 29599 raft_consensus.cc:385] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.466390 29599 raft_consensus.cc:740] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.467588 29599 consensus_queue.cc:260] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.483402 29600 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:41.488865 29851 raft_consensus.cc:493] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.489468 29851 raft_consensus.cc:515] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.492117 29599 ts_tablet_manager.cc:1434] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.157s	user 0.007s	sys 0.002s
W20260709 13:09:41.499066 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 114155us
I20260709 13:09:41.496456 29851 leader_election.cc:290] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:41.529964 29599 tablet_bootstrap.cc:492] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:41.551566 29927 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.581342 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:41.573774 29995 consensus_queue.cc:1048] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:41.596565 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:41.600759 29295 leader_election.cc:343] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.567171 29927 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:41.608309 29601 tablet_bootstrap.cc:492] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:41.608911 29601 ts_tablet_manager.cc:1403] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.422s	user 0.029s	sys 0.000s
I20260709 13:09:41.608777 29370 leader_election.cc:304] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:41.591180 29967 raft_consensus.cc:493] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.610929 29967 raft_consensus.cc:515] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.610337 29693 raft_consensus.cc:2749] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.611969 29601 raft_consensus.cc:359] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.612737 29601 raft_consensus.cc:385] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.613016 29967 leader_election.cc:290] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:41.628413 29600 tablet_bootstrap.cc:654] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.631800 29927 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:41.613054 29601 raft_consensus.cc:740] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.679141 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:41.680009 29547 raft_consensus.cc:2468] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:41.680212 29599 tablet_bootstrap.cc:654] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.681744 29602 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:41.682436 29602 ts_tablet_manager.cc:1403] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.559s	user 0.037s	sys 0.034s
I20260709 13:09:41.681718 29601 consensus_queue.cc:260] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.685261 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:41.687284 29998 consensus_queue.cc:1048] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.689112 29601 ts_tablet_manager.cc:1434] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.001s
I20260709 13:09:41.694429 29689 raft_consensus.cc:493] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.694429 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "806a266f2f6a474293cb069696090159" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:41.695005 29689 raft_consensus.cc:515] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:41.695992 29554 raft_consensus.cc:2468] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:41.693430 29602 raft_consensus.cc:359] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:41.700906 29602 raft_consensus.cc:385] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.701221 29602 raft_consensus.cc:740] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.701930 29602 consensus_queue.cc:260] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:41.703204 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:41.703577 29602 ts_tablet_manager.cc:1434] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
W20260709 13:09:41.689208 29517 leader_election.cc:343] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.705227 29602 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:41.697811 29601 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:41.697815 29689 leader_election.cc:290] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:41.700290 29600 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:41.712860 29600 ts_tablet_manager.cc:1403] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.236s	user 0.020s	sys 0.000s
I20260709 13:09:41.715982 29600 raft_consensus.cc:359] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.716709 29600 raft_consensus.cc:385] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.716986 29600 raft_consensus.cc:740] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.717651 29600 consensus_queue.cc:260] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.731659 29927 raft_consensus.cc:493] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.732237 29927 raft_consensus.cc:515] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.735168 29445 leader_election.cc:304] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:41.737198 30001 raft_consensus.cc:2804] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.737634 30001 raft_consensus.cc:493] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.738061 30001 raft_consensus.cc:3060] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.741592 29600 ts_tablet_manager.cc:1434] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:09:41.742856 29927 leader_election.cc:290] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:41.748406 29602 tablet_bootstrap.cc:654] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.749083 29600 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:41.747066 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "806a266f2f6a474293cb069696090159" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:41.808293 29296 leader_election.cc:304] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:41.753603 29400 raft_consensus.cc:3060] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.752939 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:41.818240 29518 leader_election.cc:343] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:41.778445 29443 consensus_peers.cc:597] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.821403 30006 raft_consensus.cc:493] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.821997 30006 raft_consensus.cc:515] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.824235 30006 leader_election.cc:290] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:41.779623 29228 catalog_manager.cc:5697] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.820429 29600 tablet_bootstrap.cc:654] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.835150 29601 tablet_bootstrap.cc:654] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.785833 30001 raft_consensus.cc:515] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.841728 30001 leader_election.cc:290] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:41.844957 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
W20260709 13:09:41.787617 29517 leader_election.cc:343] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.851727 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "806a266f2f6a474293cb069696090159" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:41.855959 29551 raft_consensus.cc:3060] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.833133 29850 raft_consensus.cc:2804] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.865870 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:41.866613 29550 raft_consensus.cc:2468] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:41.875546 29599 tablet_bootstrap.cc:492] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:41.876101 29599 ts_tablet_manager.cc:1403] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.352s	user 0.008s	sys 0.007s
I20260709 13:09:41.873504 29296 leader_election.cc:304] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:41.878826 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7de023ca3234343a50acdd1f0fddb6b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:41.864987 29850 raft_consensus.cc:493] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.879616 29850 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.881489 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7de023ca3234343a50acdd1f0fddb6b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:41.858342 29517 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:41.882814 29689 raft_consensus.cc:2804] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.883121 29927 raft_consensus.cc:2749] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.883277 29689 raft_consensus.cc:493] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.883849 29689 raft_consensus.cc:3060] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:41.884718 29517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 97164.8us
W20260709 13:09:41.885973 29517 leader_election.cc:343] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.886150 29602 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:41.883875 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "806a266f2f6a474293cb069696090159" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:41.886503 29517 leader_election.cc:304] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:41.886807 29602 ts_tablet_manager.cc:1403] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.005s
I20260709 13:09:41.892190 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:41.894215 29443 leader_election.cc:343] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.888202 29927 raft_consensus.cc:2749] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:41.905357 29294 leader_election.cc:343] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:41.907156 29443 leader_election.cc:343] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:41.909832 29295 leader_election.cc:343] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.910292 29295 leader_election.cc:304] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:41.911592 29295 leader_election.cc:343] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.912511 30006 raft_consensus.cc:2749] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.912763 29599 raft_consensus.cc:359] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.913594 29599 raft_consensus.cc:385] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.911316 29602 raft_consensus.cc:359] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.916853 29850 raft_consensus.cc:515] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.922008 29602 raft_consensus.cc:385] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.921988 29599 raft_consensus.cc:740] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.923185 29602 raft_consensus.cc:740] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.922986 29689 raft_consensus.cc:515] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.923669 29599 consensus_queue.cc:260] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:41.927673 29602 consensus_queue.cc:260] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.929971 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
W20260709 13:09:41.931661 29295 leader_election.cc:343] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.932341 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:41.934669 29599 ts_tablet_manager.cc:1434] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.003s
I20260709 13:09:41.940315 29689 leader_election.cc:290] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:41.941419 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:41.942090 29548 raft_consensus.cc:3060] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.942221 29600 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:41.942732 29600 ts_tablet_manager.cc:1403] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.200s	user 0.018s	sys 0.010s
I20260709 13:09:41.937753 30010 raft_consensus.cc:493] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.952507 29548 raft_consensus.cc:2468] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:41.953032 30010 raft_consensus.cc:515] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.954057 29478 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.955248 30010 leader_election.cc:290] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:41.957262 29602 ts_tablet_manager.cc:1434] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.004s
I20260709 13:09:41.957630 29296 leader_election.cc:304] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:41.958352 29602 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:41.959012 30006 raft_consensus.cc:2804] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.959582 30006 raft_consensus.cc:697] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:41.960446 30006 consensus_queue.cc:237] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:41.953925 29850 leader_election.cc:290] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:41.973395 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:41.974375 29328 raft_consensus.cc:2393] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:41.977567 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:41.979223 29551 raft_consensus.cc:2468] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:41.982254 29550 raft_consensus.cc:2468] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:41.982913 29599 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:41.986131 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:41.992885 29548 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.997056 29445 leader_election.cc:304] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:41.999042 29445 leader_election.cc:304] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:42.000187 30008 raft_consensus.cc:2804] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.000721 30008 raft_consensus.cc:697] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:42.001577 30008 consensus_queue.cc:237] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.001573 29601 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:42.003048 29601 ts_tablet_manager.cc:1403] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.305s	user 0.008s	sys 0.008s
I20260709 13:09:42.007272 29548 raft_consensus.cc:2468] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:42.011819 29296 leader_election.cc:304] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:42.012683 29851 raft_consensus.cc:2804] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.013204 29851 raft_consensus.cc:697] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:41.988705 29602 tablet_bootstrap.cc:654] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:41.965054 29478 raft_consensus.cc:2468] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:42.014119 29851 consensus_queue.cc:237] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.016805 30001 raft_consensus.cc:2764] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:42.022869 29599 tablet_bootstrap.cc:654] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.023795 29406 raft_consensus.cc:3060] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.990104 29600 raft_consensus.cc:359] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.026207 29600 raft_consensus.cc:385] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.026738 29600 raft_consensus.cc:740] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.036128 29600 consensus_queue.cc:260] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.046765 29601 raft_consensus.cc:359] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.047859 29601 raft_consensus.cc:385] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.048233 29601 raft_consensus.cc:740] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.050091 29601 consensus_queue.cc:260] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.080632 29600 ts_tablet_manager.cc:1434] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.138s	user 0.009s	sys 0.000s
I20260709 13:09:42.089720 29601 ts_tablet_manager.cc:1434] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.002s
I20260709 13:09:42.094386 30008 raft_consensus.cc:493] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.099057 30008 raft_consensus.cc:515] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.103204 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d78702effa4fe58b63767c5805a8af" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:42.103989 29328 raft_consensus.cc:2468] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:42.105432 29443 leader_election.cc:304] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:42.107568 30001 raft_consensus.cc:2804] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.107999 30001 raft_consensus.cc:493] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.108315 30001 raft_consensus.cc:3060] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.115013 29294 consensus_peers.cc:597] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.116032 29600 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:42.116456 29689 consensus_queue.cc:1048] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.118191 29601 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:42.125630 29400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d78702effa4fe58b63767c5805a8af" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:42.126363 29400 raft_consensus.cc:2468] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:42.130167 29895 raft_consensus.cc:493] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.130720 29895 raft_consensus.cc:515] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.136790 29895 leader_election.cc:290] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:42.138700 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:42.140826 29518 leader_election.cc:343] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.143240 29400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:42.119079 30008 leader_election.cc:290] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:09:42.145349 29517 leader_election.cc:343] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.145995 29517 leader_election.cc:304] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:42.152763 29895 raft_consensus.cc:2749] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.145905 30001 raft_consensus.cc:515] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.160751 29227 catalog_manager.cc:5697] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.164139 29602 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:42.164683 29602 ts_tablet_manager.cc:1403] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.207s	user 0.025s	sys 0.015s
I20260709 13:09:42.168174 29601 tablet_bootstrap.cc:654] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.168720 29600 tablet_bootstrap.cc:654] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.176493 30001 leader_election.cc:290] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:42.177652 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d78702effa4fe58b63767c5805a8af" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:42.177737 29602 raft_consensus.cc:359] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.178426 29328 raft_consensus.cc:3060] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.178524 29602 raft_consensus.cc:385] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.178880 29602 raft_consensus.cc:740] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.179641 29602 consensus_queue.cc:260] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.180074 29599 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:42.180619 29599 ts_tablet_manager.cc:1403] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.209s	user 0.011s	sys 0.007s
I20260709 13:09:42.183349 29599 raft_consensus.cc:359] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.183998 29599 raft_consensus.cc:385] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.184270 29599 raft_consensus.cc:740] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.185374 29602 ts_tablet_manager.cc:1434] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:42.188684 29599 consensus_queue.cc:260] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.189349 29602 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:42.191331 29599 ts_tablet_manager.cc:1434] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:42.192272 29599 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8: Bootstrap starting.
I20260709 13:09:42.192553 29400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d78702effa4fe58b63767c5805a8af" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:42.193246 29400 raft_consensus.cc:3060] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.198284 29599 tablet_bootstrap.cc:654] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.199095 29602 tablet_bootstrap.cc:654] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.204440 29328 raft_consensus.cc:2468] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:42.216902 29443 leader_election.cc:304] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:42.218924 30007 raft_consensus.cc:2804] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.220001 30007 raft_consensus.cc:697] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:42.222101 29400 raft_consensus.cc:2468] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:42.222127 30007 consensus_queue.cc:237] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.254351 29601 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:42.254951 29601 ts_tablet_manager.cc:1403] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.012s
I20260709 13:09:42.255455 29600 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:42.256033 29600 ts_tablet_manager.cc:1403] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.007s
I20260709 13:09:42.256227 29599 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8: No bootstrap required, opened a new log
I20260709 13:09:42.256752 29599 ts_tablet_manager.cc:1403] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.025s
I20260709 13:09:42.259656 29600 raft_consensus.cc:359] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.261229 29600 raft_consensus.cc:385] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.260172 29601 raft_consensus.cc:359] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.261823 29601 raft_consensus.cc:385] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.261585 29599 raft_consensus.cc:359] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.262249 29601 raft_consensus.cc:740] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.262413 29599 raft_consensus.cc:385] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.262951 29599 raft_consensus.cc:740] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.263361 29601 consensus_queue.cc:260] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.261647 29600 raft_consensus.cc:740] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.268880 29600 consensus_queue.cc:260] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.266549 29602 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:42.267113 30007 raft_consensus.cc:493] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.272125 29602 ts_tablet_manager.cc:1403] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.000s
I20260709 13:09:42.273910 29600 ts_tablet_manager.cc:1434] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.006s
I20260709 13:09:42.275261 29602 raft_consensus.cc:359] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.279259 29602 raft_consensus.cc:385] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.279613 29602 raft_consensus.cc:740] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.285143 29602 consensus_queue.cc:260] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.287679 29602 ts_tablet_manager.cc:1434] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:42.272114 30007 raft_consensus.cc:515] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.291546 30007 leader_election.cc:290] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:42.275600 29600 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:42.293716 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:42.294569 29548 raft_consensus.cc:2393] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:42.297835 29602 tablet_bootstrap.cc:492] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:42.271440 29601 ts_tablet_manager.cc:1434] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:42.265511 29599 consensus_queue.cc:260] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.300194 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:42.301955 29599 ts_tablet_manager.cc:1434] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 13:09:42.301913 29443 leader_election.cc:304] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:42.303673 30001 raft_consensus.cc:3060] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.305130 29601 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:42.313414 29601 tablet_bootstrap.cc:654] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.313867 29602 tablet_bootstrap.cc:654] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.323953 29600 tablet_bootstrap.cc:654] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.329957 29995 raft_consensus.cc:493] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.330601 29995 raft_consensus.cc:515] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.331647 29602 tablet_bootstrap.cc:492] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:42.332201 29602 ts_tablet_manager.cc:1403] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.005s
I20260709 13:09:42.334065 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:42.335021 29602 raft_consensus.cc:359] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
W20260709 13:09:42.337869 29294 leader_election.cc:343] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.338169 29602 raft_consensus.cc:385] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.338506 29602 raft_consensus.cc:740] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.339445 29601 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:42.339201 29602 consensus_queue.cc:260] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.339936 29601 ts_tablet_manager.cc:1403] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.004s
I20260709 13:09:42.341802 29602 ts_tablet_manager.cc:1434] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:09:42.342945 29602 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:42.342940 29601 raft_consensus.cc:359] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.344008 29601 raft_consensus.cc:385] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.344338 29601 raft_consensus.cc:740] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.345245 29601 consensus_queue.cc:260] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.347735 29601 ts_tablet_manager.cc:1434] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:09:42.350121 29602 tablet_bootstrap.cc:654] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.349802 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:42.349788 29995 leader_election.cc:290] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:42.358973 30001 raft_consensus.cc:2749] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.354246 29548 raft_consensus.cc:2468] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:42.373929 29296 leader_election.cc:304] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:42.375438 29995 raft_consensus.cc:2804] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.375854 29995 raft_consensus.cc:493] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.376173 29995 raft_consensus.cc:3060] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.373980 29600 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:42.387719 29600 ts_tablet_manager.cc:1403] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.002s
I20260709 13:09:42.390597 29600 raft_consensus.cc:359] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.393150 29995 raft_consensus.cc:515] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.372627 29601 tablet_bootstrap.cc:492] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:42.394095 29600 raft_consensus.cc:385] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.398120 29600 raft_consensus.cc:740] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.398844 29600 consensus_queue.cc:260] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.401168 29995 leader_election.cc:290] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:42.401854 29927 raft_consensus.cc:493] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.403007 29601 tablet_bootstrap.cc:654] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.402607 29927 raft_consensus.cc:515] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.410524 29400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:42.411520 29400 raft_consensus.cc:3060] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.412844 30001 raft_consensus.cc:493] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.413516 30001 raft_consensus.cc:515] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.417088 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:42.415162 29927 leader_election.cc:290] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:09:42.419661 29517 leader_election.cc:343] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.421077 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:42.422999 29518 leader_election.cc:343] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.423619 29518 leader_election.cc:304] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:42.413110 29600 ts_tablet_manager.cc:1434] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:42.425242 29600 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:42.432077 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:42.432848 29547 raft_consensus.cc:2468] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:42.433776 30001 leader_election.cc:290] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:42.434629 29445 leader_election.cc:304] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:42.432848 29927 raft_consensus.cc:2749] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.437742 30001 raft_consensus.cc:2804] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.439045 30001 raft_consensus.cc:493] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.439965 30001 raft_consensus.cc:3060] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.445585 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:42.442549 29601 tablet_bootstrap.cc:492] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:42.446559 29548 raft_consensus.cc:3060] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.446729 29601 ts_tablet_manager.cc:1403] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.005s
I20260709 13:09:42.450049 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:42.452565 29600 tablet_bootstrap.cc:654] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.458938 30001 raft_consensus.cc:515] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.463493 30001 leader_election.cc:290] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:42.464332 29927 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.464967 29927 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.450042 29601 raft_consensus.cc:359] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.476686 29601 raft_consensus.cc:385] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.477054 29601 raft_consensus.cc:740] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
W20260709 13:09:42.477721 29443 leader_election.cc:343] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.493548 29689 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.494390 29689 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.507320 29927 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:42.510404 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:42.512028 29517 leader_election.cc:343] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.513645 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:42.522547 29601 consensus_queue.cc:260] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.526259 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:42.526389 30001 consensus_queue.cc:1048] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.523278 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:42.529949 29547 raft_consensus.cc:3060] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:42.530500 29443 leader_election.cc:343] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:42.531914 29517 leader_election.cc:343] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.532454 29517 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:42.533486 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:42.534996 29225 catalog_manager.cc:5697] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.537658 29895 raft_consensus.cc:2749] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.538435 30050 raft_consensus.cc:493] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.538528 29225 catalog_manager.cc:5697] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.539101 30050 raft_consensus.cc:515] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.541533 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:42.544591 29995 consensus_queue.cc:1048] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:42.539095 29689 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:42.548692 30050 leader_election.cc:290] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:42.546288 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:42.549829 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "806a266f2f6a474293cb069696090159" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
W20260709 13:09:42.546372 29294 leader_election.cc:343] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.550402 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "806a266f2f6a474293cb069696090159" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:42.549875 29551 raft_consensus.cc:2468] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:42.551998 29370 leader_election.cc:304] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:42.553956 29547 raft_consensus.cc:2468] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:42.554266 29296 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:42.555812 29445 leader_election.cc:304] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:42.556625 29600 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:42.556691 29851 raft_consensus.cc:2804] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:42.557243 29851 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.557332 30001 raft_consensus.cc:2804] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.557688 29851 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.557991 30001 raft_consensus.cc:697] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:42.559029 30050 raft_consensus.cc:2749] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.558938 30001 consensus_queue.cc:237] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:42.557299 29600 ts_tablet_manager.cc:1403] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.132s	user 0.031s	sys 0.018s
I20260709 13:09:42.571698 29406 raft_consensus.cc:3060] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.573421 29400 raft_consensus.cc:2468] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:42.574746 29294 leader_election.cc:304] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:42.577229 29600 raft_consensus.cc:359] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.577940 29600 raft_consensus.cc:385] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.579047 29689 raft_consensus.cc:2804] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.579744 29689 raft_consensus.cc:697] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:42.582314 29601 ts_tablet_manager.cc:1434] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260709 13:09:42.578214 29600 raft_consensus.cc:740] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.583290 29600 consensus_queue.cc:260] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.588732 29601 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:42.580749 29689 consensus_queue.cc:237] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.603541 29600 ts_tablet_manager.cc:1434] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.003s
I20260709 13:09:42.605414 29402 raft_consensus.cc:3060] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.610793 29995 consensus_queue.cc:1048] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.631987 29602 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:42.632573 29602 ts_tablet_manager.cc:1403] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.290s	user 0.084s	sys 0.106s
I20260709 13:09:42.643286 29600 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:42.644534 29548 raft_consensus.cc:2468] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:42.638113 29850 raft_consensus.cc:493] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.653059 29995 raft_consensus.cc:493] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.631390 29994 consensus_queue.cc:1048] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:09:42.653635 29995 raft_consensus.cc:515] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.655803 29995 leader_election.cc:290] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:42.652838 29850 raft_consensus.cc:515] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.650321 29851 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.661353 29850 leader_election.cc:290] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:42.663198 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:42.666008 29554 raft_consensus.cc:2468] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:42.666433 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:42.669044 29296 leader_election.cc:304] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:42.670264 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:42.671804 29294 leader_election.cc:343] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.672365 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3460ebfc0d344b5b7ede68f74c3983a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
W20260709 13:09:42.675258 29294 leader_election.cc:343] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.673729 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:42.676631 29553 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.697088 29602 raft_consensus.cc:359] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.697925 29602 raft_consensus.cc:385] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.671468 29850 raft_consensus.cc:2804] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:42.680156 29295 leader_election.cc:343] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.698256 29602 raft_consensus.cc:740] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.704555 29602 consensus_queue.cc:260] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.674697 29851 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:42.720918 29477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3460ebfc0d344b5b7ede68f74c3983a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:42.705665 29850 raft_consensus.cc:493] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.675401 29998 consensus_queue.cc:1048] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:09:42.741070 29600 tablet_bootstrap.cc:654] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.723193 29850 raft_consensus.cc:3060] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.741652 29602 ts_tablet_manager.cc:1434] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.109s	user 0.000s	sys 0.007s
I20260709 13:09:42.750602 29553 raft_consensus.cc:2468] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:42.752548 29296 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:42.753400 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 54924.1us
W20260709 13:09:42.754546 29295 leader_election.cc:343] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.755115 29295 leader_election.cc:304] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:42.756074 29601 tablet_bootstrap.cc:654] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.722712 29851 raft_consensus.cc:493] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.767793 30006 raft_consensus.cc:2749] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:42.765488 29851 raft_consensus.cc:515] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.761049 29995 raft_consensus.cc:2804] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.780109 29994 consensus_queue.cc:1048] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:42.776192 29851 leader_election.cc:290] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:42.786078 29995 raft_consensus.cc:697] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:42.806105 29995 consensus_queue.cc:237] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.805941 29998 raft_consensus.cc:493] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.814620 29998 raft_consensus.cc:515] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:42.848637 29294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 142838us
I20260709 13:09:42.849952 29226 catalog_manager.cc:5697] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.851181 29600 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:42.851682 29600 ts_tablet_manager.cc:1403] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.218s	user 0.009s	sys 0.018s
I20260709 13:09:42.851845 29400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:42.832238 29998 leader_election.cc:290] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:42.858402 29227 catalog_manager.cc:5697] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.864223 29602 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:42.870061 29850 raft_consensus.cc:515] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.874882 29850 leader_election.cc:290] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:42.897308 29600 raft_consensus.cc:359] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.898376 29600 raft_consensus.cc:385] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.898742 29600 raft_consensus.cc:740] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.903966 29600 consensus_queue.cc:260] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.912118 29600 ts_tablet_manager.cc:1434] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:09:42.921500 29600 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:42.912978 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:42.922127 29549 raft_consensus.cc:3060] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.913288 30060 raft_consensus.cc:493] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.922717 30060 raft_consensus.cc:515] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:42.912810 29295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 158314us
I20260709 13:09:42.924825 30060 leader_election.cc:290] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:42.910010 29602 tablet_bootstrap.cc:654] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:42.919426 29294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 56315.2us
W20260709 13:09:42.927428 29294 leader_election.cc:343] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:42.927511 29601 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:42.941325 29601 ts_tablet_manager.cc:1403] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.353s	user 0.027s	sys 0.008s
I20260709 13:09:42.936388 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:42.943710 29480 raft_consensus.cc:2468] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:42.944274 29601 raft_consensus.cc:359] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.953485 29601 raft_consensus.cc:385] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.953773 29601 raft_consensus.cc:740] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.954285 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:42.954433 29601 consensus_queue.cc:260] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:42.956028 29602 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:42.956578 29602 ts_tablet_manager.cc:1403] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.108s	user 0.024s	sys 0.011s
I20260709 13:09:42.957429 30050 raft_consensus.cc:493] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:42.939021 29549 raft_consensus.cc:2468] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:42.957958 30050 raft_consensus.cc:515] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:42.959241 29601 ts_tablet_manager.cc:1434] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:42.960283 29601 tablet_bootstrap.cc:492] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:42.959966 29602 raft_consensus.cc:359] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.960829 29602 raft_consensus.cc:385] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.961161 29602 raft_consensus.cc:740] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.961704 30050 leader_election.cc:290] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:42.961858 29602 consensus_queue.cc:260] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:42.962759 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:42.966936 29602 ts_tablet_manager.cc:1434] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:09:42.968052 29602 tablet_bootstrap.cc:492] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:42.970288 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:42.972162 29371 leader_election.cc:304] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:42.972893 29600 tablet_bootstrap.cc:654] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.976401 29602 tablet_bootstrap.cc:654] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.980868 30050 raft_consensus.cc:2749] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:42.985541 29296 leader_election.cc:304] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:42.992641 29601 tablet_bootstrap.cc:654] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.986974 29600 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: No bootstrap required, opened a new log
I20260709 13:09:43.005837 29600 ts_tablet_manager.cc:1403] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.003s
I20260709 13:09:43.017716 29850 raft_consensus.cc:2804] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.018350 29850 raft_consensus.cc:697] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:43.019200 29850 consensus_queue.cc:237] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:43.014889 29600 raft_consensus.cc:359] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.020675 29600 raft_consensus.cc:385] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.020955 29600 raft_consensus.cc:740] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.025820 29400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:43.026785 29400 raft_consensus.cc:2468] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:43.021742 29600 consensus_queue.cc:260] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.033517 29600 ts_tablet_manager.cc:1434] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:09:43.036144 30060 consensus_queue.cc:1048] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.046196 29601 tablet_bootstrap.cc:492] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:43.046780 29601 ts_tablet_manager.cc:1403] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.003s
I20260709 13:09:43.047605 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:43.048341 29330 raft_consensus.cc:2468] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:43.048476 29602 tablet_bootstrap.cc:492] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:43.049118 29602 ts_tablet_manager.cc:1403] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.029s
I20260709 13:09:43.050431 29601 raft_consensus.cc:359] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.051108 29601 raft_consensus.cc:385] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.051376 29601 raft_consensus.cc:740] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.051973 29601 consensus_queue.cc:260] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.053336 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7de023ca3234343a50acdd1f0fddb6b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:43.053233 29602 raft_consensus.cc:359] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.054122 29602 raft_consensus.cc:385] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.054479 29602 raft_consensus.cc:740] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.053921 29227 catalog_manager.cc:5697] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.055279 29602 consensus_queue.cc:260] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.057832 29602 ts_tablet_manager.cc:1434] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:43.059120 29602 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:43.062554 29850 consensus_queue.cc:1048] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.065331 29601 ts_tablet_manager.cc:1434] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:09:43.066179 30050 raft_consensus.cc:493] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.066720 30050 raft_consensus.cc:515] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.068028 29602 tablet_bootstrap.cc:654] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.068867 30050 leader_election.cc:290] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:43.070498 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:43.074573 29601 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:43.085047 29601 tablet_bootstrap.cc:654] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.075169 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:43.087688 29371 leader_election.cc:304] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:43.089000 30050 raft_consensus.cc:2749] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.100967 29601 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:43.101502 29601 ts_tablet_manager.cc:1403] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:09:43.105000 29601 raft_consensus.cc:359] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.105690 29601 raft_consensus.cc:385] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.105981 29601 raft_consensus.cc:740] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.115934 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7de023ca3234343a50acdd1f0fddb6b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:43.117023 29330 raft_consensus.cc:2468] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:43.119976 29601 consensus_queue.cc:260] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.124953 29601 ts_tablet_manager.cc:1434] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:09:43.126045 29601 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:43.129751 29225 catalog_manager.cc:5697] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.135389 29601 tablet_bootstrap.cc:654] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.154284 29226 catalog_manager.cc:5697] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.167029 29601 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:43.167618 29601 ts_tablet_manager.cc:1403] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.007s
I20260709 13:09:43.170608 29601 raft_consensus.cc:359] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.171288 29601 raft_consensus.cc:385] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.171567 29601 raft_consensus.cc:740] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.172307 29601 consensus_queue.cc:260] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.174736 29601 ts_tablet_manager.cc:1434] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:43.178362 30060 consensus_queue.cc:1048] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.178699 29601 tablet_bootstrap.cc:492] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:43.181507 29995 consensus_queue.cc:1048] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.184760 29996 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.185252 29996 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.187306 29996 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:43.191548 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:43.192232 29548 raft_consensus.cc:2468] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:43.190088 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:43.193292 29296 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
W20260709 13:09:43.194460 29294 leader_election.cc:343] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.194710 29995 raft_consensus.cc:2804] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.195128 29995 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.195487 29995 raft_consensus.cc:3060] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:43.197288 29295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 50513us
I20260709 13:09:43.198148 29295 leader_election.cc:304] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:43.199045 29851 raft_consensus.cc:2804] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:43.200204 29295 leader_election.cc:343] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.199409 29851 raft_consensus.cc:493] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.202097 30070 raft_consensus.cc:493] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.202499 29851 raft_consensus.cc:3060] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.202688 30070 raft_consensus.cc:515] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.207357 30070 leader_election.cc:290] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:43.208388 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7de023ca3234343a50acdd1f0fddb6b" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:43.209064 29478 raft_consensus.cc:2468] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:43.210201 29370 leader_election.cc:304] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:43.210752 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7de023ca3234343a50acdd1f0fddb6b" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:43.211431 29330 raft_consensus.cc:2468] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 0.
I20260709 13:09:43.214778 29995 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.219362 29601 tablet_bootstrap.cc:654] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.222441 29995 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:43.215090 30070 raft_consensus.cc:2804] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.223651 30070 raft_consensus.cc:493] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.224032 30070 raft_consensus.cc:3060] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.225437 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:43.226995 29549 raft_consensus.cc:3060] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.227049 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:43.228178 29602 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:43.228709 29602 ts_tablet_manager.cc:1403] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.170s	user 0.040s	sys 0.044s
W20260709 13:09:43.228843 29294 leader_election.cc:343] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.196836 29443 leader_election.cc:304] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:43.240690 30060 raft_consensus.cc:2804] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.241122 30060 raft_consensus.cc:493] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.241451 30060 raft_consensus.cc:3060] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:43.242936 29443 leader_election.cc:343] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.245903 29406 raft_consensus.cc:3060] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.262900 29549 raft_consensus.cc:2468] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:43.252568 29851 raft_consensus.cc:515] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.269194 29851 leader_election.cc:290] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:43.269510 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:43.270387 29404 raft_consensus.cc:3060] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.272921 29296 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:43.271665 30060 raft_consensus.cc:515] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.271530 29602 raft_consensus.cc:359] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.279032 29689 raft_consensus.cc:2804] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.279247 29602 raft_consensus.cc:385] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.279312 30070 raft_consensus.cc:515] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.279876 29602 raft_consensus.cc:740] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.281576 30070 leader_election.cc:290] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:43.279074 30060 leader_election.cc:290] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:43.283437 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7de023ca3234343a50acdd1f0fddb6b" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:43.284972 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7de023ca3234343a50acdd1f0fddb6b" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:43.289216 29480 raft_consensus.cc:3060] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.291304 29602 consensus_queue.cc:260] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.300392 29602 ts_tablet_manager.cc:1434] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.002s
I20260709 13:09:43.304466 29602 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06: Bootstrap starting.
I20260709 13:09:43.305706 29480 raft_consensus.cc:2468] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:43.306950 29370 leader_election.cc:304] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:43.307741 30070 raft_consensus.cc:2804] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.308212 30070 raft_consensus.cc:697] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:43.309015 30070 consensus_queue.cc:237] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.312542 29330 raft_consensus.cc:3060] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.302973 29404 raft_consensus.cc:2468] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:43.302472 29443 leader_election.cc:304] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:43.316862 29689 raft_consensus.cc:697] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:43.325162 29689 consensus_queue.cc:237] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.326442 29602 tablet_bootstrap.cc:654] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.327507 29402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:43.328374 29402 raft_consensus.cc:2393] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:43.333282 30060 consensus_queue.cc:1048] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.335088 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:43.335867 29328 raft_consensus.cc:2393] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:43.325033 30071 raft_consensus.cc:2764] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:43.351850 30071 consensus_queue.cc:1048] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.357838 29443 leader_election.cc:304] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:43.340622 29938 raft_consensus.cc:493] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.372952 29294 leader_election.cc:304] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:43.375049 29996 raft_consensus.cc:2804] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.377436 29996 raft_consensus.cc:697] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:43.378319 29996 consensus_queue.cc:237] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.373857 30050 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.382336 30050 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.385470 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:43.386269 29549 raft_consensus.cc:2393] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:43.392578 29330 raft_consensus.cc:2468] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:43.394415 30006 raft_consensus.cc:493] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.372807 30010 raft_consensus.cc:2749] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.394951 30006 raft_consensus.cc:515] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:43.412875 29602 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06: No bootstrap required, opened a new log
I20260709 13:09:43.413841 29602 ts_tablet_manager.cc:1403] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06: Time spent bootstrapping tablet: real 0.110s	user 0.019s	sys 0.002s
I20260709 13:09:43.417194 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:43.404080 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:43.410224 30050 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:43.374740 29938 raft_consensus.cc:515] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:43.418955 30010 raft_consensus.cc:493] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.436805 29601 tablet_bootstrap.cc:492] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:43.437366 29601 ts_tablet_manager.cc:1403] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.259s	user 0.043s	sys 0.034s
I20260709 13:09:43.431928 30006 leader_election.cc:290] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:43.438158 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:43.439502 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:43.440282 29547 raft_consensus.cc:2468] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:43.441148 29938 leader_election.cc:290] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:43.441323 29369 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:43.442420 30050 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.430303 30010 raft_consensus.cc:515] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.432129 29480 raft_consensus.cc:2393] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 1: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:43.444676 30010 leader_election.cc:290] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:43.448483 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3460ebfc0d344b5b7ede68f74c3983a" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:43.448338 29330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:43.455153 29326 raft_consensus.cc:2468] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:43.449692 29296 leader_election.cc:304] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:43.454296 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3460ebfc0d344b5b7ede68f74c3983a" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:43.462164 29851 raft_consensus.cc:2804] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.469555 29851 raft_consensus.cc:493] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.469995 29851 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.469900 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:43.479327 29549 raft_consensus.cc:2393] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 1: Already voted for candidate 23e24e0c40f44bc79274c2081c9fc002 in this term.
I20260709 13:09:43.479444 29229 catalog_manager.cc:5697] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.526443 29602 raft_consensus.cc:359] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:43.527694 29602 raft_consensus.cc:385] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.528122 29602 raft_consensus.cc:740] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.529223 29602 consensus_queue.cc:260] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:43.532305 29602 ts_tablet_manager.cc:1434] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06: Time spent starting tablet: real 0.118s	user 0.006s	sys 0.004s
I20260709 13:09:43.532477 29851 raft_consensus.cc:515] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:43.541126 29851 leader_election.cc:290] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:43.541345 30050 raft_consensus.cc:2749] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.547107 29226 catalog_manager.cc:5697] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 0 to 1, leader changed from <none> to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 1 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.554319 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:43.555135 29548 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.556025 29478 raft_consensus.cc:2468] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 0.
I20260709 13:09:43.558748 29998 raft_consensus.cc:493] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.559286 29998 raft_consensus.cc:515] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.561389 29998 leader_election.cc:290] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:43.565603 29548 raft_consensus.cc:2468] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:43.542362 29601 raft_consensus.cc:359] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.567345 29296 leader_election.cc:304] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:09:43.568782 30068 raft_consensus.cc:2804] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.569288 30068 raft_consensus.cc:697] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:09:43.570242 30068 consensus_queue.cc:237] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:43.573287 29443 leader_election.cc:343] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.591578 29225 catalog_manager.cc:5697] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.595686 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:43.596438 29547 raft_consensus.cc:2468] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:43.600183 29850 consensus_queue.cc:1048] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.603283 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:43.607666 29850 consensus_queue.cc:1048] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:43.566738 29601 raft_consensus.cc:385] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.611423 29601 raft_consensus.cc:740] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.613140 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:43.613837 29478 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.615111 29601 consensus_queue.cc:260] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.616477 29404 raft_consensus.cc:2468] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 0.
I20260709 13:09:43.619829 29445 leader_election.cc:304] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:43.620653 29998 raft_consensus.cc:2804] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.621141 29998 raft_consensus.cc:493] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.621549 29998 raft_consensus.cc:3060] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.623042 29601 ts_tablet_manager.cc:1434] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.178s	user 0.007s	sys 0.000s
I20260709 13:09:43.624063 29601 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:43.629901 29998 raft_consensus.cc:515] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
W20260709 13:09:43.632174 29276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:43.633656 29998 leader_election.cc:290] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:43.634943 29443 leader_election.cc:304] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:43.635383 29476 raft_consensus.cc:3060] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.636150 29443 leader_election.cc:304] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:43.637740 29938 raft_consensus.cc:2804] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.638127 29938 raft_consensus.cc:493] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.638478 29938 raft_consensus.cc:3060] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.639344 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:43.639972 29547 raft_consensus.cc:3060] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.648240 30066 raft_consensus.cc:2749] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.648669 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:43.649349 29404 raft_consensus.cc:3060] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.650393 29938 raft_consensus.cc:515] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.652518 29938 leader_election.cc:290] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:43.653591 29478 raft_consensus.cc:2468] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 1.
I20260709 13:09:43.657498 29404 raft_consensus.cc:2468] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:43.657855 29601 tablet_bootstrap.cc:654] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.660909 29443 leader_election.cc:304] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:43.661711 30010 raft_consensus.cc:2804] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.662300 30010 raft_consensus.cc:697] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:43.663017 29850 consensus_queue.cc:1048] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.663118 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3460ebfc0d344b5b7ede68f74c3983a" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:43.663268 30010 consensus_queue.cc:237] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:43.663944 29328 raft_consensus.cc:3060] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.670183 29328 raft_consensus.cc:2468] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:43.671834 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3460ebfc0d344b5b7ede68f74c3983a" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
W20260709 13:09:43.674316 29443 leader_election.cc:343] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.675007 29443 leader_election.cc:304] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:43.675755 29938 raft_consensus.cc:2804] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.676523 29938 raft_consensus.cc:697] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:43.677603 29938 consensus_queue.cc:237] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.696491 29225 catalog_manager.cc:5697] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.701100 29229 catalog_manager.cc:5697] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:43.765288 29296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 53116.8us
I20260709 13:09:43.768272 29851 consensus_queue.cc:1048] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.792335 29547 raft_consensus.cc:2468] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:43.818823 30050 consensus_queue.cc:1048] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.835109 29996 consensus_queue.cc:1048] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:43.838745 29996 consensus_queue.cc:1048] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:43.855700 29294 consensus_peers.cc:597] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.880189 29225 catalog_manager.cc:5697] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.884086 29601 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:43.885397 29601 ts_tablet_manager.cc:1403] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.262s	user 0.027s	sys 0.015s
I20260709 13:09:43.901046 29693 consensus_queue.cc:1048] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.946796 29601 raft_consensus.cc:359] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.947777 29601 raft_consensus.cc:385] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.948122 29601 raft_consensus.cc:740] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.948792 29601 consensus_queue.cc:260] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:43.958456 29601 ts_tablet_manager.cc:1434] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:09:43.959457 29601 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d: Bootstrap starting.
I20260709 13:09:43.968505 29851 consensus_queue.cc:1048] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:43.970283 29601 tablet_bootstrap.cc:654] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.985813 29601 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d: No bootstrap required, opened a new log
I20260709 13:09:43.986336 29601 ts_tablet_manager.cc:1403] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:09:43.989500 29601 raft_consensus.cc:359] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.990216 29601 raft_consensus.cc:385] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.990473 29601 raft_consensus.cc:740] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.991248 29601 consensus_queue.cc:260] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:43.993480 29601 ts_tablet_manager.cc:1434] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:44.062918 29693 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.063349 29693 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:44.065006 29693 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:44.065738 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:44.066555 29328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:44.068090 29369 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:44.068887 29693 raft_consensus.cc:2749] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.075122 29401 raft_consensus.cc:3060] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.088814 29938 consensus_queue.cc:1048] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.111188 30007 consensus_queue.cc:1048] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.115612 29850 consensus_queue.cc:1048] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:44.175222 29850 consensus_queue.cc:1048] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.175220 29938 consensus_queue.cc:1048] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:44.181519 29938 consensus_queue.cc:1048] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.245814 29401 raft_consensus.cc:3060] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.336032 20756 tablet_server.cc:179] TabletServer@127.20.69.1:0 shutting down...
W20260709 13:09:45.389081 29369 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:09:45.395404 29369 consensus_peers.cc:597] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.396940 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:45.398080 20756 tablet_replica.cc:333] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.399159 20756 raft_consensus.cc:2243] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.400198 20756 raft_consensus.cc:2272] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.402765 20756 tablet_replica.cc:333] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.403620 20756 raft_consensus.cc:2243] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.404666 20756 raft_consensus.cc:2272] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.407109 20756 tablet_replica.cc:333] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.407950 20756 raft_consensus.cc:2243] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.408540 20756 raft_consensus.cc:2272] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.410924 20756 tablet_replica.cc:333] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.411796 20756 raft_consensus.cc:2243] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.412829 20756 raft_consensus.cc:2272] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.415388 20756 tablet_replica.cc:333] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.416330 20756 raft_consensus.cc:2243] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.417364 20756 raft_consensus.cc:2272] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.419740 20756 tablet_replica.cc:333] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.420642 20756 raft_consensus.cc:2243] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.421178 20756 raft_consensus.cc:2272] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.423475 29443 consensus_peers.cc:597] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.423491 20756 tablet_replica.cc:333] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.424917 20756 raft_consensus.cc:2243] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.425405 20756 raft_consensus.cc:2272] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.428045 20756 tablet_replica.cc:333] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.428828 20756 raft_consensus.cc:2243] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.429312 20756 raft_consensus.cc:2272] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.432065 20756 tablet_replica.cc:333] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.432967 20756 raft_consensus.cc:2243] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.434234 20756 raft_consensus.cc:2272] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.436372 20756 tablet_replica.cc:333] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.437222 20756 raft_consensus.cc:2243] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.438222 20756 raft_consensus.cc:2272] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.440563 29443 consensus_peers.cc:597] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.440656 20756 tablet_replica.cc:333] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.441813 20756 raft_consensus.cc:2243] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.442644 20756 raft_consensus.cc:2272] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.444779 20756 tablet_replica.cc:333] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.445384 20756 raft_consensus.cc:2243] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.445827 20756 raft_consensus.cc:2272] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.448164 20756 tablet_replica.cc:333] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.448989 20756 raft_consensus.cc:2243] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.449980 20756 raft_consensus.cc:2272] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.452070 20756 tablet_replica.cc:333] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.452724 20756 raft_consensus.cc:2243] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.453125 20756 raft_consensus.cc:2272] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.454962 20756 tablet_replica.cc:333] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.455613 20756 raft_consensus.cc:2243] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.456094 20756 raft_consensus.cc:2272] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.458581 20756 tablet_replica.cc:333] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.460321 20756 raft_consensus.cc:2243] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.460830 20756 raft_consensus.cc:2272] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.462647 20756 tablet_replica.cc:333] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.463245 20756 raft_consensus.cc:2243] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.464074 20756 raft_consensus.cc:2272] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.465939 20756 tablet_replica.cc:333] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.466701 20756 raft_consensus.cc:2243] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.467222 20756 raft_consensus.cc:2272] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.469370 20756 tablet_replica.cc:333] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.470144 20756 raft_consensus.cc:2243] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.470762 20756 raft_consensus.cc:2272] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.473248 20756 tablet_replica.cc:333] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.474124 20756 raft_consensus.cc:2243] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.475008 20756 raft_consensus.cc:2272] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.477164 20756 tablet_replica.cc:333] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.477761 20756 raft_consensus.cc:2243] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.478518 20756 raft_consensus.cc:2272] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.481050 20756 tablet_replica.cc:333] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.481700 20756 raft_consensus.cc:2243] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.482137 20756 raft_consensus.cc:2272] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.484395 20756 tablet_replica.cc:333] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.485193 20756 raft_consensus.cc:2243] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.486085 20756 raft_consensus.cc:2272] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.488466 20756 tablet_replica.cc:333] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.489337 20756 raft_consensus.cc:2243] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.490376 20756 raft_consensus.cc:2272] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.490640 29517 consensus_peers.cc:597] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.493264 20756 tablet_replica.cc:333] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.494042 20756 raft_consensus.cc:2243] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.495002 20756 raft_consensus.cc:2272] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.497498 20756 tablet_replica.cc:333] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.498342 20756 raft_consensus.cc:2243] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.499323 20756 raft_consensus.cc:2272] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.502048 20756 tablet_replica.cc:333] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.503111 20756 raft_consensus.cc:2243] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:45.504002 29443 consensus_peers.cc:597] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.504087 20756 raft_consensus.cc:2272] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.507905 20756 tablet_replica.cc:333] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.508819 20756 raft_consensus.cc:2243] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.509469 20756 raft_consensus.cc:2272] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.511914 20756 tablet_replica.cc:333] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.512779 20756 raft_consensus.cc:2243] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.513280 20756 raft_consensus.cc:2272] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.516086 20756 tablet_replica.cc:333] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.516990 20756 raft_consensus.cc:2243] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.517977 20756 raft_consensus.cc:2272] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.520449 20756 tablet_replica.cc:333] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.521332 20756 raft_consensus.cc:2243] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.521814 20756 raft_consensus.cc:2272] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.524449 20756 tablet_replica.cc:333] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.525238 20756 raft_consensus.cc:2243] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:45.525856 29517 consensus_peers.cc:597] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.526284 20756 raft_consensus.cc:2272] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.528622 20756 tablet_replica.cc:333] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.529296 20756 raft_consensus.cc:2243] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.530212 20756 raft_consensus.cc:2272] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.532925 20756 tablet_replica.cc:333] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.533787 20756 raft_consensus.cc:2243] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:45.533989 29443 consensus_peers.cc:597] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.534843 20756 raft_consensus.cc:2272] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.537568 20756 tablet_replica.cc:333] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.538405 20756 raft_consensus.cc:2243] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.539425 20756 raft_consensus.cc:2272] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.539494 29443 consensus_peers.cc:597] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.541764 20756 tablet_replica.cc:333] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.542431 20756 raft_consensus.cc:2243] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.542948 20756 raft_consensus.cc:2272] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.545070 20756 tablet_replica.cc:333] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.545715 20756 raft_consensus.cc:2243] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.546231 20756 raft_consensus.cc:2272] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.548704 20756 tablet_replica.cc:333] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.549429 20756 raft_consensus.cc:2243] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.550271 20756 raft_consensus.cc:2272] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.552264 20756 tablet_replica.cc:333] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.552906 20756 raft_consensus.cc:2243] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.553936 20756 raft_consensus.cc:2272] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.556082 20756 tablet_replica.cc:333] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.556722 20756 raft_consensus.cc:2243] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.557179 20756 raft_consensus.cc:2272] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.559303 20756 tablet_replica.cc:333] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.559856 20756 raft_consensus.cc:2243] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.560714 20756 raft_consensus.cc:2272] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.562736 20756 tablet_replica.cc:333] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.563424 20756 raft_consensus.cc:2243] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.564416 20756 raft_consensus.cc:2272] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.566890 20756 tablet_replica.cc:333] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.567487 20756 raft_consensus.cc:2243] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.568400 20756 raft_consensus.cc:2272] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.570701 20756 tablet_replica.cc:333] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.571413 20756 raft_consensus.cc:2243] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.571990 20756 raft_consensus.cc:2272] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.574601 20756 tablet_replica.cc:333] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: stopping tablet replica
I20260709 13:09:45.575218 20756 raft_consensus.cc:2243] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:45.576277 20756 raft_consensus.cc:2272] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:45.598727 29443 consensus_peers.cc:597] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.613866 29517 consensus_peers.cc:597] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.630460 29369 consensus_peers.cc:597] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.638737 29369 consensus_peers.cc:597] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.657999 29369 consensus_peers.cc:597] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.667387 20756 tablet_server.cc:196] TabletServer@127.20.69.1:0 shutdown complete.
W20260709 13:09:45.697113 29369 consensus_peers.cc:597] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.716291 29443 consensus_peers.cc:597] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.729693 29369 consensus_peers.cc:597] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.753379 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:45.761433 30129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:45.765170 30130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:45.775789 30132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:45.777709 20756 server_base.cc:1061] running on GCE node
I20260709 13:09:45.783143 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:45.783499 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:45.783741 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602585783721 us; error 0 us; skew 500 ppm
I20260709 13:09:45.784551 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:09:45.792251 29443 consensus_peers.cc:597] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.802084 29443 consensus_peers.cc:597] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.804472 20756 webserver.cc:533] Webserver started at http://127.20.69.1:45471/ using document root <none> and password file <none>
I20260709 13:09:45.805337 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:45.805626 20756 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:45.811259 20756 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:45.824301 30137 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:45.825470 20756 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:09:45.826010 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "23e24e0c40f44bc79274c2081c9fc002"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-56lb"
I20260709 13:09:45.826678 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:09:45.845148 29443 consensus_peers.cc:597] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.857796 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:45.859440 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:45.861600 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:45.867609 30144 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:09:46.183394 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:46.183758 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.318s	user 0.006s	sys 0.004s
I20260709 13:09:46.184185 20756 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:46.192462 30144 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:46.214831 30144 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.222648 30144 tablet_bootstrap.cc:492] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:46.223484 30144 ts_tablet_manager.cc:1403] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.008s
I20260709 13:09:46.226567 30144 raft_consensus.cc:359] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.229936 30144 raft_consensus.cc:740] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.230764 30144 consensus_queue.cc:260] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.304854 30144 ts_tablet_manager.cc:1434] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.081s	user 0.021s	sys 0.012s
I20260709 13:09:46.305791 30144 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:46.338254 30144 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.339274 30144 tablet_bootstrap.cc:492] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:46.340001 30144 ts_tablet_manager.cc:1403] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.008s
I20260709 13:09:46.342896 30144 raft_consensus.cc:359] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.343734 30144 raft_consensus.cc:740] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.344520 30144 consensus_queue.cc:260] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.346640 30144 ts_tablet_manager.cc:1434] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:46.355896 30144 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:46.379105 30144 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.380033 30144 tablet_bootstrap.cc:492] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:46.380687 30144 ts_tablet_manager.cc:1403] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:09:46.382946 30144 raft_consensus.cc:359] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:46.383620 30144 raft_consensus.cc:740] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.384279 30144 consensus_queue.cc:260] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:46.386224 30144 ts_tablet_manager.cc:1434] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:46.386978 30144 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:46.401208 30144 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.402171 30144 tablet_bootstrap.cc:492] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:46.402779 30144 ts_tablet_manager.cc:1403] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:09:46.405287 30144 raft_consensus.cc:359] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.405938 30144 raft_consensus.cc:740] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.406687 30144 consensus_queue.cc:260] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.408726 30144 ts_tablet_manager.cc:1434] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:46.409510 30144 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:46.431546 30144 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.432725 30144 tablet_bootstrap.cc:492] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:46.433449 30144 ts_tablet_manager.cc:1403] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:09:46.436214 30144 raft_consensus.cc:359] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.437041 30144 raft_consensus.cc:740] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.438077 30144 consensus_queue.cc:260] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.441550 30144 ts_tablet_manager.cc:1434] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:46.442552 30144 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:46.452819 30146 raft_consensus.cc:493] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.453419 30146 raft_consensus.cc:515] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.455616 30146 leader_election.cc:290] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.460027 30148 raft_consensus.cc:493] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.460668 30148 raft_consensus.cc:515] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:46.462806 30148 leader_election.cc:290] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.465298 20756 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:46.465713 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.282s	user 0.274s	sys 0.002s
I20260709 13:09:46.474546 30000 raft_consensus.cc:493] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.475848 30000 raft_consensus.cc:515] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.478691 30000 leader_election.cc:290] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.479635 30145 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.480468 30145 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.483474 30145 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.485482 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.486442 29548 raft_consensus.cc:2468] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.489591 29371 leader_election.cc:304] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:46.489821 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:46.491407 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:46.492002 30126 raft_consensus.cc:2804] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:46.495419 30126 raft_consensus.cc:493] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.495854 30126 raft_consensus.cc:3060] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:46.492802 29369 leader_election.cc:336] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:46.511924 29443 leader_election.cc:336] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:46.514729 29517 leader_election.cc:336] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:46.518684 29517 leader_election.cc:336] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.519177 29517 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:46.519898 30146 raft_consensus.cc:2749] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.523291 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1d7834cd644ccdb86354a7aca74628" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:46.525202 30120 raft_consensus.cc:493] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.525846 30120 raft_consensus.cc:515] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.529099 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.529253 30120 leader_election.cc:290] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.541040 30146 raft_consensus.cc:493] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.541739 30146 raft_consensus.cc:515] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.543887 30146 leader_election.cc:290] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.545754 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:46.554045 29443 leader_election.cc:304] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:46.565912 30150 raft_consensus.cc:2749] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:46.572139 29517 leader_election.cc:336] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.572685 29517 leader_election.cc:304] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:46.576049 30146 raft_consensus.cc:2749] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.574770 30150 raft_consensus.cc:493] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.584324 30150 raft_consensus.cc:515] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.589668 30148 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.590324 30148 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.593619 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.592525 30148 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.538507 30126 raft_consensus.cc:515] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:09:46.573793 29443 leader_election.cc:336] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.600263 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.605332 29443 leader_election.cc:304] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:46.601506 30150 leader_election.cc:290] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.606338 29401 raft_consensus.cc:2393] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:46.608167 30126 leader_election.cc:290] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.606165 30148 raft_consensus.cc:2749] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.609129 30126 raft_consensus.cc:493] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.609699 30126 raft_consensus.cc:515] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.613276 30126 leader_election.cc:290] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.613972 30144 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:46.614970 30144 tablet_bootstrap.cc:492] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:46.615645 30144 ts_tablet_manager.cc:1403] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.173s	user 0.058s	sys 0.061s
W20260709 13:09:46.656961 29370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 143862us
I20260709 13:09:46.673141 30126 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.677606 30146 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.678474 30073 raft_consensus.cc:493] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.681228 30073 raft_consensus.cc:515] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.683465 30162 raft_consensus.cc:493] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.697469 30164 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.675123 30126 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.678844 30146 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.706667 30073 leader_election.cc:290] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.698858 30164 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.711798 30173 raft_consensus.cc:493] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.711674 30144 raft_consensus.cc:359] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:46.712869 30144 raft_consensus.cc:740] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.712244 30073 raft_consensus.cc:493] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.712893 30173 raft_consensus.cc:515] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.713798 30144 consensus_queue.cc:260] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:46.714015 30073 raft_consensus.cc:515] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.703554 30145 raft_consensus.cc:493] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.719976 30000 raft_consensus.cc:493] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.722771 30164 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.723865 30073 leader_election.cc:290] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.726369 30145 raft_consensus.cc:515] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.685307 30162 raft_consensus.cc:515] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:46.740388 30165 raft_consensus.cc:493] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.740826 30170 raft_consensus.cc:493] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.741008 30150 raft_consensus.cc:493] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.741564 30165 raft_consensus.cc:515] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.741842 30170 raft_consensus.cc:515] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.742348 30150 raft_consensus.cc:515] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.744776 30164 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.745723 30164 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.745596 30165 leader_election.cc:290] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.746366 30126 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.749432 30162 leader_election.cc:290] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:46.730420 30000 raft_consensus.cc:515] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.730415 30073 raft_consensus.cc:493] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.754004 30171 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.754657 30146 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.735988 30145 leader_election.cc:290] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.755028 30164 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.752370 30000 leader_election.cc:290] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:09:46.755142 29369 leader_election.cc:336] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.760339 30146 raft_consensus.cc:493] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.763638 30073 raft_consensus.cc:515] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.764622 30146 raft_consensus.cc:515] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.772630 29517 leader_election.cc:304] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:46.772825 29369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 47202.5us
W20260709 13:09:46.774191 29369 leader_election.cc:336] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.776938 30000 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.777894 30000 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.781476 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:46.782624 30000 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.783185 30144 ts_tablet_manager.cc:1434] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.167s	user 0.008s	sys 0.008s
I20260709 13:09:46.785174 30144 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:46.786166 30164 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.786936 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1d7834cd644ccdb86354a7aca74628" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:46.787046 30164 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.798930 30172 raft_consensus.cc:493] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.799993 30172 raft_consensus.cc:515] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.800302 30150 leader_election.cc:290] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.792503 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bf1de53534642b28b9b16f82438c57c" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:46.795998 29551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.803079 29547 raft_consensus.cc:3060] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.803659 29551 raft_consensus.cc:2468] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.800304 30164 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.791633 29370 leader_election.cc:304] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:46.792522 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.805593 30120 raft_consensus.cc:493] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.795285 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.796657 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.806629 30120 raft_consensus.cc:515] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:46.807605 29553 raft_consensus.cc:2468] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.793313 29479 raft_consensus.cc:2468] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.790096 30175 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.808785 30126 raft_consensus.cc:2749] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.789784 30170 leader_election.cc:290] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.809135 30175 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.811373 30146 leader_election.cc:290] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.807525 30164 raft_consensus.cc:493] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.813241 30172 leader_election.cc:290] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.813387 30146 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.813596 30164 raft_consensus.cc:515] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.814361 30146 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.812335 30175 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.815248 30120 leader_election.cc:290] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.815555 30175 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.816298 30164 leader_election.cc:290] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.816507 29370 leader_election.cc:304] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:46.817061 30175 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.807688 29554 raft_consensus.cc:2468] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.817876 30120 raft_consensus.cc:493] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
W20260709 13:09:46.817384 29443 leader_election.cc:336] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.818795 29443 leader_election.cc:304] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:46.799396 30171 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.820772 30148 raft_consensus.cc:2749] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.821094 30169 raft_consensus.cc:2804] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:46.822288 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.823405 29554 raft_consensus.cc:2468] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.821673 30169 raft_consensus.cc:493] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.824522 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.837146 29548 raft_consensus.cc:2468] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
W20260709 13:09:46.838138 29517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 65917.1us
I20260709 13:09:46.838382 30169 raft_consensus.cc:3060] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.836330 30173 leader_election.cc:290] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.826943 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:46.829916 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:46.840665 30171 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.841403 29479 raft_consensus.cc:2468] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:46.833444 30073 leader_election.cc:290] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.825625 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df9a8d24a9d4474be608101a853cacb" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:46.820782 30150 raft_consensus.cc:493] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.818789 30120 raft_consensus.cc:515] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.845435 30145 raft_consensus.cc:493] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.850891 30145 raft_consensus.cc:515] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.853148 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.854017 30145 leader_election.cc:290] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.854338 29548 raft_consensus.cc:2468] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.845331 29480 raft_consensus.cc:2468] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:46.845880 30150 raft_consensus.cc:515] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.859366 30150 leader_election.cc:290] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.846222 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.846114 30175 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.862617 30000 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.790028 30176 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.863899 30000 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.866479 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:46.867166 29406 raft_consensus.cc:2468] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:46.867360 29371 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:46.868695 29371 leader_election.cc:304] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:46.863811 30176 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.870970 29553 raft_consensus.cc:2468] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.871691 29371 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:46.871079 30165 raft_consensus.cc:2804] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:46.872437 30162 raft_consensus.cc:2804] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:46.872340 30165 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.872911 30162 raft_consensus.cc:493] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.873095 30165 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.873402 30162 raft_consensus.cc:3060] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.874907 30179 raft_consensus.cc:493] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.866540 30120 leader_election.cc:290] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.880697 30179 raft_consensus.cc:515] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:46.887907 29443 leader_election.cc:336] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.902608 30164 raft_consensus.cc:493] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.903479 30164 raft_consensus.cc:515] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:46.924937 29443 leader_election.cc:336] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.925628 29443 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:46.928854 30171 raft_consensus.cc:2749] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.936436 30126 raft_consensus.cc:2804] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:46.937047 30126 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.937525 30126 raft_consensus.cc:3060] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.938881 30179 leader_election.cc:290] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.939071 30173 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.945837 30173 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.948915 30173 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.949618 30173 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.942634 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:46.949815 30126 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.950773 29404 raft_consensus.cc:2468] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:46.944649 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:46.951603 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:46.952068 29406 raft_consensus.cc:2468] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:46.952381 29479 raft_consensus.cc:2468] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:46.949528 30120 raft_consensus.cc:493] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.941658 30000 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.940423 29518 leader_election.cc:304] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:46.956199 30146 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.955283 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:46.963179 30180 raft_consensus.cc:493] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.976989 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.977864 29552 raft_consensus.cc:2468] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:46.977797 30180 raft_consensus.cc:515] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:46.957206 30176 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:46.957541 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:46.960456 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:46.980309 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.980635 30180 leader_election.cc:290] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.981140 29554 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:46.968057 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.979390 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:46.982429 29548 raft_consensus.cc:2468] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:46.982589 29546 raft_consensus.cc:2468] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:46.965008 30175 raft_consensus.cc:2804] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:46.983640 30175 raft_consensus.cc:493] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.984127 30175 raft_consensus.cc:3060] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.953310 30120 raft_consensus.cc:515] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:46.980211 29404 raft_consensus.cc:2468] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:46.989293 29480 raft_consensus.cc:2468] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:46.976202 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
W20260709 13:09:46.990190 29517 leader_election.cc:336] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:46.991559 29370 leader_election.cc:304] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
W20260709 13:09:46.961428 29371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 89814.1us
I20260709 13:09:46.961807 29547 raft_consensus.cc:2468] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:46.964156 29518 leader_election.cc:304] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:46.960970 30000 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:46.997922 30000 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:46.998129 29518 leader_election.cc:304] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:46.999302 29371 leader_election.cc:304] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.000802 30176 raft_consensus.cc:2804] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.004849 30176 raft_consensus.cc:493] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.005049 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:47.001233 30146 raft_consensus.cc:2804] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.005578 30120 leader_election.cc:290] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:47.005888 29476 raft_consensus.cc:2468] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:46.954216 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:47.006978 29479 raft_consensus.cc:2468] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:47.000851 30174 raft_consensus.cc:2749] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.000473 30000 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:46.955307 30173 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.004053 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:47.010144 30174 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.010718 29480 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
W20260709 13:09:47.002334 29517 leader_election.cc:336] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.005998 30146 raft_consensus.cc:493] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.003840 30175 raft_consensus.cc:515] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.005427 30176 raft_consensus.cc:3060] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.952533 30126 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.012651 30146 raft_consensus.cc:3060] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.953711 30164 leader_election.cc:290] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:47.017112 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:47.014669 30144 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:47.021175 29517 leader_election.cc:336] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.010869 30174 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.010139 30173 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.026080 29517 leader_election.cc:304] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:47.027630 29546 raft_consensus.cc:2468] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:47.029706 29550 raft_consensus.cc:2393] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:47.030861 30175 leader_election.cc:290] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.031841 30126 raft_consensus.cc:493] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.032732 30126 raft_consensus.cc:515] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:47.034356 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:47.034516 29518 leader_election.cc:304] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.035172 29550 raft_consensus.cc:2468] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:47.038350 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ae44c83a2a422eb794cba0bfb917e1" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.039080 29479 raft_consensus.cc:3060] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.041260 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:47.042222 29480 raft_consensus.cc:2468] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:47.024183 30162 raft_consensus.cc:515] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.035501 29546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.036659 29518 leader_election.cc:304] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.046291 29406 raft_consensus.cc:2393] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:47.050045 30180 raft_consensus.cc:2804] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.050571 30180 raft_consensus.cc:493] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.051008 30180 raft_consensus.cc:3060] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.048384 29546 raft_consensus.cc:3060] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.054212 30174 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:47.055269 30145 raft_consensus.cc:2749] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:47.049072 29517 leader_election.cc:336] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.057040 29518 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.022847 30186 raft_consensus.cc:2804] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.043515 30165 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.063493 30073 raft_consensus.cc:2804] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.064769 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:47.065764 29445 leader_election.cc:304] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.060580 29517 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:47.072808 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:47.073293 30073 raft_consensus.cc:493] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.076957 30073 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.074514 29406 raft_consensus.cc:2468] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:47.081369 29445 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.081907 30120 raft_consensus.cc:2804] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.082526 29445 leader_election.cc:304] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:47.082959 29546 raft_consensus.cc:2468] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:47.082573 30120 raft_consensus.cc:493] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.083773 30120 raft_consensus.cc:3060] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.084040 29445 leader_election.cc:304] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.087883 29480 raft_consensus.cc:2468] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 1.
I20260709 13:09:47.093719 30150 raft_consensus.cc:2804] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.094390 30150 raft_consensus.cc:493] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.095028 30150 raft_consensus.cc:3060] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.094659 29370 leader_election.cc:304] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.097779 30148 raft_consensus.cc:2804] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.098191 30172 raft_consensus.cc:2804] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.098583 30148 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.098934 30172 raft_consensus.cc:493] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.099397 30148 raft_consensus.cc:3060] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.098222 30000 raft_consensus.cc:2804] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.100634 30000 raft_consensus.cc:493] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.101984 29517 leader_election.cc:304] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.101052 30000 raft_consensus.cc:3060] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.022320 30169 raft_consensus.cc:515] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:47.102136 29371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 102927us
I20260709 13:09:47.099587 30172 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.093101 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:47.102633 30165 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.109193 29406 raft_consensus.cc:2468] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:47.102013 30173 raft_consensus.cc:2804] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.107419 30175 raft_consensus.cc:2764] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:09:47.125245 30173 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.125799 30173 raft_consensus.cc:3060] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.125389 30146 raft_consensus.cc:515] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.127326 30120 raft_consensus.cc:515] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.128279 30146 leader_election.cc:290] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.130312 30180 raft_consensus.cc:515] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.132278 30180 leader_election.cc:290] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.119472 30176 raft_consensus.cc:515] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.134656 30176 leader_election.cc:290] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.135530 29445 leader_election.cc:304] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.136240 30120 leader_election.cc:290] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.136580 30001 raft_consensus.cc:2804] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.137041 30001 raft_consensus.cc:493] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.137291 30001 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.140542 30150 raft_consensus.cc:515] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:47.110929 29443 leader_election.cc:336] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.110026 29371 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.073928 30186 raft_consensus.cc:493] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.114095 30144 tablet_bootstrap.cc:492] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:47.113489 30145 raft_consensus.cc:2804] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.116015 29479 raft_consensus.cc:2468] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:47.118861 30126 leader_election.cc:290] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:47.121745 30162 leader_election.cc:290] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.122531 30073 raft_consensus.cc:515] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:47.150520 29517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 48607.7us
W20260709 13:09:47.144783 29443 leader_election.cc:336] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.146070 29371 leader_election.cc:304] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.145991 30001 raft_consensus.cc:515] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:47.113377 29518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 52060us
W20260709 13:09:47.151659 29443 leader_election.cc:336] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.151258 29517 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.152724 30144 ts_tablet_manager.cc:1403] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.368s	user 0.021s	sys 0.003s
I20260709 13:09:47.153124 29517 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.155243 30180 raft_consensus.cc:2804] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.148403 30145 raft_consensus.cc:493] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.155814 30180 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.156018 30145 raft_consensus.cc:3060] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.156354 30180 raft_consensus.cc:3060] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.157649 30073 leader_election.cc:290] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.158497 30144 raft_consensus.cc:359] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.159332 30144 raft_consensus.cc:740] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.161248 30176 raft_consensus.cc:2804] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.161769 30176 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.162184 30176 raft_consensus.cc:3060] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.147692 30186 raft_consensus.cc:3060] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.164592 29517 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.165609 30073 raft_consensus.cc:2804] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.166227 30073 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.166708 30169 leader_election.cc:290] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:47.166918 30180 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.165731 29517 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
W20260709 13:09:47.169025 29369 leader_election.cc:336] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.169585 29369 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
W20260709 13:09:47.165102 29443 leader_election.cc:336] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.171448 29517 leader_election.cc:336] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.168267 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1d7834cd644ccdb86354a7aca74628" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.160166 30144 consensus_queue.cc:260] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.170347 29371 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.148902 30165 raft_consensus.cc:2804] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:47.172276 29517 leader_election.cc:336] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.173703 29517 leader_election.cc:304] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:47.173754 30001 leader_election.cc:290] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:09:47.174698 29517 leader_election.cc:336] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.165735 29518 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.175225 29479 raft_consensus.cc:3060] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.175549 30175 raft_consensus.cc:3060] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.176112 29518 leader_election.cc:304] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.172077 30169 raft_consensus.cc:2804] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.178027 30169 raft_consensus.cc:493] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.178184 30174 raft_consensus.cc:2804] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.178411 30169 raft_consensus.cc:3060] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.178727 30174 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.179237 30174 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.179670 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:47.180352 29406 raft_consensus.cc:2468] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 1.
I20260709 13:09:47.183318 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895df96ea5c54121bb29dba7f08193a0" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.183224 30173 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.184242 29480 raft_consensus.cc:3060] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.172204 30146 raft_consensus.cc:2804] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.185001 30146 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.185242 29371 leader_election.cc:304] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:47.185456 30146 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.186198 30162 raft_consensus.cc:2804] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.186592 30162 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.186954 30162 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.188923 30126 raft_consensus.cc:2804] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.189281 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.189543 30126 raft_consensus.cc:697] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:47.190289 29476 raft_consensus.cc:2393] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 2: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
I20260709 13:09:47.166631 30073 raft_consensus.cc:3060] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.191040 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df9a8d24a9d4474be608101a853cacb" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.190639 30126 consensus_queue.cc:237] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.191715 29478 raft_consensus.cc:3060] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.193274 29371 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
W20260709 13:09:47.173496 29443 leader_election.cc:336] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.194931 29369 leader_election.cc:336] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.195806 29369 leader_election.cc:336] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.191560 30164 raft_consensus.cc:2749] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:47.196879 29369 leader_election.cc:336] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.194187 29371 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
W20260709 13:09:47.195174 29443 leader_election.cc:336] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.197772 29369 leader_election.cc:336] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.199542 30164 raft_consensus.cc:2804] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.199913 30164 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.200253 30164 raft_consensus.cc:3060] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.202023 30144 ts_tablet_manager.cc:1434] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:09:47.195379 30150 leader_election.cc:290] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.204559 30144 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:47.209251 30172 raft_consensus.cc:515] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.213487 30172 leader_election.cc:290] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.209847 30183 raft_consensus.cc:2804] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.214847 30183 raft_consensus.cc:493] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.215196 30183 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.194550 30165 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.216903 30165 raft_consensus.cc:3060] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.217151 30174 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:47.218216 29369 leader_election.cc:336] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.209830 30173 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.209347 30180 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:47.210095 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.205346 30145 raft_consensus.cc:515] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.206025 30162 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.223289 30189 raft_consensus.cc:2804] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.224097 29445 leader_election.cc:304] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:47.229949 29478 raft_consensus.cc:2468] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:47.233152 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:47.234526 29477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.234930 30175 raft_consensus.cc:2749] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.204169 30073 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.234982 29475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.236819 29480 raft_consensus.cc:2468] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:47.241117 30001 raft_consensus.cc:2749] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.241168 29518 leader_election.cc:304] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
W20260709 13:09:47.238744 29517 leader_election.cc:336] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.242157 29445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 105611us
I20260709 13:09:47.229435 29479 raft_consensus.cc:2468] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:47.238322 29476 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.227679 30176 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.249225 30189 raft_consensus.cc:697] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:47.250334 30189 consensus_queue.cc:237] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.250972 30176 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:47.216694 30164 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.252408 29406 raft_consensus.cc:2393] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:47.254971 30164 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.243209 29475 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.212941 30186 raft_consensus.cc:515] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:47.243677 30191 raft_consensus.cc:2804] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.244262 29518 leader_election.cc:304] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.245107 30073 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:47.245052 30148 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.245883 30145 leader_election.cc:290] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:09:47.242496 29517 leader_election.cc:336] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.289903 29517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 47448.6us
W20260709 13:09:47.290396 29517 leader_election.cc:336] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.291491 29517 leader_election.cc:336] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.292167 29517 leader_election.cc:336] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.246861 30162 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.239235 30174 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.264269 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.269311 29370 leader_election.cc:304] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.260308 30146 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.271876 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.273561 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.305371 29550 raft_consensus.cc:2393] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:47.274611 29545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.306288 29545 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.276320 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:47.277947 29476 raft_consensus.cc:2468] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:47.282461 30186 leader_election.cc:290] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:47.283144 30191 raft_consensus.cc:697] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:47.284533 30165 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.285382 30169 raft_consensus.cc:515] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.246383 30188 raft_consensus.cc:2804] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:47.293432 29517 leader_election.cc:336] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.300839 29477 raft_consensus.cc:2393] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 2: Already voted for candidate 81cf9a977cb447069d98dedbda0e4f06 in this term.
W20260709 13:09:47.315514 29517 leader_election.cc:336] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.301172 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.316962 29479 raft_consensus.cc:3060] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:47.317173 29517 leader_election.cc:336] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.317926 29517 leader_election.cc:336] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.318588 29517 leader_election.cc:336] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.301786 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:47.303208 30146 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:47.303685 29547 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.313688 30191 consensus_queue.cc:237] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.304632 29552 raft_consensus.cc:3060] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:47.293570 29443 leader_election.cc:336] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.288816 30173 raft_consensus.cc:2804] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.246440 30000 raft_consensus.cc:515] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:47.311488 29518 leader_election.cc:304] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.328006 29517 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:47.307124 30126 raft_consensus.cc:2804] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.313664 29475 raft_consensus.cc:2468] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:47.340368 30193 raft_consensus.cc:2804] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.340919 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:47.340975 30193 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.341639 29405 raft_consensus.cc:3060] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.341921 30193 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.342126 30000 leader_election.cc:290] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:47.343554 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:47.344491 29401 raft_consensus.cc:2393] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:47.333155 30176 raft_consensus.cc:2804] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.328995 30173 raft_consensus.cc:697] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:47.337445 30188 raft_consensus.cc:697] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:47.345431 30176 raft_consensus.cc:697] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:47.346052 30173 consensus_queue.cc:237] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.346489 30176 consensus_queue.cc:237] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.346061 30188 consensus_queue.cc:237] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.333658 29403 raft_consensus.cc:2468] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:47.352854 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.353719 29554 raft_consensus.cc:2393] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:47.340569 29404 raft_consensus.cc:2393] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81cf9a977cb447069d98dedbda0e4f06 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:47.356935 29477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980b900980f24f1d8afef6fda8d06023" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:09:47.357662 29477 raft_consensus.cc:3060] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.358522 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf053ddbc384257a33de229f027366e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:47.359297 29403 raft_consensus.cc:3060] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.361033 29404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:47.361939 29404 raft_consensus.cc:2393] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:47.362466 29547 raft_consensus.cc:2468] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 2.
W20260709 13:09:47.373664 29517 leader_election.cc:336] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.374392 29517 leader_election.cc:304] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:47.386198 29403 raft_consensus.cc:2468] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
W20260709 13:09:47.387352 29517 leader_election.cc:336] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.387913 30145 raft_consensus.cc:2749] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.355085 30126 raft_consensus.cc:697] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:47.389309 30153 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.389923 30153 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.390092 30126 consensus_queue.cc:237] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:47.394063 29517 leader_election.cc:336] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.394825 29517 leader_election.cc:336] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.397845 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:47.399555 29406 raft_consensus.cc:2393] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 470465ef54334dbc8be5230ca16dc1a8 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:47.400174 29445 leader_election.cc:304] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
W20260709 13:09:47.403209 29371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 209095us
I20260709 13:09:47.393568 29479 raft_consensus.cc:2468] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
W20260709 13:09:47.403160 29517 leader_election.cc:336] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.411561 29370 leader_election.cc:304] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.409997 29517 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:47.413786 29548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.393322 30148 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:09:47.414083 29517 leader_election.cc:336] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.419737 29517 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:47.417511 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.404662 30179 raft_consensus.cc:2804] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.338300 30183 raft_consensus.cc:515] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.421136 29548 raft_consensus.cc:2393] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:47.420439 29552 raft_consensus.cc:2468] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 2.
I20260709 13:09:47.414445 30145 raft_consensus.cc:2749] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.417814 30189 raft_consensus.cc:2804] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.426827 29517 leader_election.cc:304] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.430903 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.433633 29545 raft_consensus.cc:2468] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 2.
I20260709 13:09:47.434605 30169 leader_election.cc:290] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.434922 29477 raft_consensus.cc:2468] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:47.437229 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5216cf90df5f43a090fc0d60c20f0e23" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.425979 29547 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.438513 30193 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.439059 29445 leader_election.cc:304] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.423674 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:47.458860 30001 raft_consensus.cc:2804] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.459452 30001 raft_consensus.cc:697] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:47.458034 29445 leader_election.cc:304] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.461971 29370 leader_election.cc:304] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.463128 30201 raft_consensus.cc:2804] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.445683 29553 raft_consensus.cc:3060] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:47.445737 29443 leader_election.cc:336] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.447945 30165 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.425565 30153 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:47.448544 29549 raft_consensus.cc:2393] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:47.449025 30183 leader_election.cc:290] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:47.429075 30179 raft_consensus.cc:697] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:47.441176 30145 raft_consensus.cc:2804] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.437270 29405 raft_consensus.cc:2468] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:47.461512 30148 raft_consensus.cc:2804] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.424655 30176 raft_consensus.cc:2749] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.442616 30189 raft_consensus.cc:697] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:47.472030 29550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f844d53679454696bf4c09f6eaa88a" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.472710 29554 raft_consensus.cc:2393] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:47.475229 30001 consensus_queue.cc:237] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.476348 30201 raft_consensus.cc:697] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:47.484134 30193 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:09:47.471598 29443 leader_election.cc:336] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.500528 29443 leader_election.cc:304] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
W20260709 13:09:47.501847 29443 leader_election.cc:336] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.502777 29443 leader_election.cc:336] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.503780 29443 leader_election.cc:336] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.486056 29518 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:47.493362 29553 raft_consensus.cc:2468] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:47.484158 29547 raft_consensus.cc:2468] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:47.496256 30145 raft_consensus.cc:697] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:47.516040 30179 consensus_queue.cc:237] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.517107 30189 consensus_queue.cc:237] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:47.521564 29443 leader_election.cc:336] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.522329 29443 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
W20260709 13:09:47.523404 30199 log.cc:927] Time spent T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:09:47.523283 30145 consensus_queue.cc:237] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.524369 29229 catalog_manager.cc:5697] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.525125 30201 consensus_queue.cc:237] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:47.498220 30148 raft_consensus.cc:697] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
W20260709 13:09:47.533396 29369 leader_election.cc:336] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.534253 29369 leader_election.cc:336] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.513368 30150 raft_consensus.cc:2749] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.513126 30176 raft_consensus.cc:2804] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.526562 29228 catalog_manager.cc:5697] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:47.542248 29369 leader_election.cc:336] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.546466 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.547456 29547 raft_consensus.cc:2393] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a5dacd0232c24e92bc64f941b7410a9d in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:47.547253 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:47.548079 29554 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:47.548890 29550 raft_consensus.cc:2468] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:47.549250 30148 consensus_queue.cc:237] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.554365 29371 leader_election.cc:304] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.544917 30176 raft_consensus.cc:697] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:47.599068 29371 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.599745 30000 raft_consensus.cc:2804] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.604568 29371 leader_election.cc:304] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.603680 30165 raft_consensus.cc:2804] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:47.612674 30200 log.cc:927] Time spent T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:47.613008 30178 raft_consensus.cc:2749] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.607286 30000 raft_consensus.cc:697] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:47.608132 30164 raft_consensus.cc:2804] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.635174 30165 raft_consensus.cc:697] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:47.648543 29517 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:47.653119 30164 raft_consensus.cc:697] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:47.665037 30193 raft_consensus.cc:2804] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:47.671190 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:47.665889 30176 consensus_queue.cc:237] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.722766 29550 raft_consensus.cc:1275] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.733660 30144 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:47.727362 30000 consensus_queue.cc:237] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.734812 30144 tablet_bootstrap.cc:492] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:47.735575 30144 ts_tablet_manager.cc:1403] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.531s	user 0.022s	sys 0.012s
I20260709 13:09:47.697578 30193 raft_consensus.cc:697] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:47.737424 30193 consensus_queue.cc:237] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:09:47.722842 29517 leader_election.cc:336] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.739450 29517 leader_election.cc:336] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.701154 29405 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:47.740342 29517 leader_election.cc:336] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.741146 29517 leader_election.cc:336] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.741525 29517 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:47.725632 29369 leader_election.cc:336] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.700884 30153 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.714138 30165 consensus_queue.cc:237] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.730846 30164 consensus_queue.cc:237] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:09:47.742537 29369 leader_election.cc:336] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.754901 29226 catalog_manager.cc:5697] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:47.754354 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 216251us
W20260709 13:09:47.755332 29369 leader_election.cc:336] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.744733 29517 leader_election.cc:336] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.752465 30153 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.758312 29517 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:47.759125 29369 leader_election.cc:336] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.759662 29369 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:47.756527 29226 catalog_manager.cc:5697] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.754551 30191 raft_consensus.cc:2749] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.764045 30153 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:47.764686 29226 catalog_manager.cc:5697] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:47.769320 29517 leader_election.cc:336] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.769462 29369 leader_election.cc:336] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.778049 29369 leader_election.cc:336] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.778970 29405 raft_consensus.cc:2468] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
W20260709 13:09:47.779909 29369 leader_election.cc:336] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.780493 29443 leader_election.cc:304] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:47.782541 29369 leader_election.cc:336] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.783893 30001 raft_consensus.cc:2749] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:47.783890 29369 leader_election.cc:336] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.784888 29369 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
W20260709 13:09:47.786378 29369 leader_election.cc:336] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.786854 29443 leader_election.cc:304] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:47.787009 29369 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:47.761232 30145 raft_consensus.cc:2749] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:47.846333 29369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 56370.2us
I20260709 13:09:47.753988 30201 consensus_queue.cc:1048] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:09:47.785694 30186 raft_consensus.cc:2749] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.788038 30126 raft_consensus.cc:2749] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.845697 30144 raft_consensus.cc:359] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.855361 30144 raft_consensus.cc:740] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
W20260709 13:09:47.852988 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 66227.4us
I20260709 13:09:47.842792 30189 raft_consensus.cc:2749] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:47.857826 30144 consensus_queue.cc:260] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:47.861552 29443 leader_election.cc:304] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:47.850309 29554 raft_consensus.cc:2468] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:47.853349 30120 raft_consensus.cc:2804] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:47.869292 30144 ts_tablet_manager.cc:1434] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.133s	user 0.012s	sys 0.001s
I20260709 13:09:47.867370 30172 raft_consensus.cc:2749] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:47.882151 30216 log.cc:927] Time spent T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:09:47.883163 29369 leader_election.cc:336] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.885506 29369 leader_election.cc:336] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.886112 29369 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:09:47.887315 30169 raft_consensus.cc:2749] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:47.887354 29369 leader_election.cc:336] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.868306 30120 raft_consensus.cc:493] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:09:47.889196 30120 raft_consensus.cc:3060] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:47.896009 29369 consensus_peers.cc:597] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.896847 29369 leader_election.cc:336] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:47.897891 29369 leader_election.cc:336] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:47.899271 29477 raft_consensus.cc:1275] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:47.902153 30145 consensus_queue.cc:1048] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:47.902964 30153 raft_consensus.cc:493] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.903625 30153 raft_consensus.cc:515] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:47.906754 29369 consensus_peers.cc:597] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.906287 30153 leader_election.cc:290] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:47.913214 30144 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
W20260709 13:09:47.949324 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 83555.9us
I20260709 13:09:47.954375 30120 raft_consensus.cc:515] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:47.971992 29371 leader_election.cc:304] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:48.012763 29517 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:47.965526 30153 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:48.025233 30229 log.cc:927] Time spent T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:48.025079 30153 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:48.027525 30153 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:48.028035 30153 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.005908 30165 raft_consensus.cc:2804] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.031993 30165 raft_consensus.cc:697] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:48.033102 30165 consensus_queue.cc:237] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:48.033819 29477 raft_consensus.cc:1275] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.037031 30120 leader_election.cc:290] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:48.024382 30233 raft_consensus.cc:2804] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.039825 30233 raft_consensus.cc:697] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:48.040949 30233 consensus_queue.cc:237] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:48.028512 30153 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:48.059914 29547 raft_consensus.cc:1275] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.064705 30153 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:48.069629 29477 raft_consensus.cc:1275] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.070120 30176 consensus_queue.cc:1048] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.072733 29475 raft_consensus.cc:1275] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.077322 30174 consensus_queue.cc:1048] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:48.078862 30226 log.cc:927] Time spent T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:09:48.079495 30173 consensus_queue.cc:1048] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.085119 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:48.085721 29405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:48.086319 29406 raft_consensus.cc:2393] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:48.086575 29405 raft_consensus.cc:2393] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:48.087913 29478 raft_consensus.cc:1275] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.088210 29475 raft_consensus.cc:1275] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.089406 29552 raft_consensus.cc:1275] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer 81cf9a977cb447069d98dedbda0e4f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.089614 29553 raft_consensus.cc:1275] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer 81cf9a977cb447069d98dedbda0e4f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.095024 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:48.095634 30231 consensus_queue.cc:1048] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.096508 30150 consensus_queue.cc:1048] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.097205 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:48.097370 30178 consensus_queue.cc:1048] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.098948 30169 consensus_queue.cc:1048] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:48.109225 29369 consensus_peers.cc:597] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.111958 29517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 99344.6us
I20260709 13:09:48.112044 30186 consensus_queue.cc:1048] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:09:48.115299 29369 consensus_peers.cc:597] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.121569 29476 raft_consensus.cc:1275] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:48.130592 29517 consensus_peers.cc:597] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.154115 29474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b29284ee8e4bb2b1b7c2f7c9319103" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:48.155311 29474 raft_consensus.cc:2393] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 2: Already voted for candidate a5dacd0232c24e92bc64f941b7410a9d in this term.
I20260709 13:09:48.156785 29473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:48.157696 29473 raft_consensus.cc:2393] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:48.159502 30139 leader_election.cc:304] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:48.161391 30236 raft_consensus.cc:3060] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.162513 29369 consensus_peers.cc:597] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.165625 29517 consensus_peers.cc:597] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.166181 29517 consensus_peers.cc:597] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.168376 29552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:48.169318 29552 raft_consensus.cc:2393] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23e24e0c40f44bc79274c2081c9fc002 in current term 2: Already voted for candidate 470465ef54334dbc8be5230ca16dc1a8 in this term.
I20260709 13:09:48.174168 30236 raft_consensus.cc:2749] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.209302 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:48.212852 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:48.216351 30164 consensus_queue.cc:1048] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.220834 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:48.226460 30140 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:48.228168 30236 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.231997 29518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 56451.6us
I20260709 13:09:48.239497 30236 raft_consensus.cc:2749] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.245820 30144 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.247236 30144 tablet_bootstrap.cc:492] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:48.248147 30144 ts_tablet_manager.cc:1403] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.372s	user 0.022s	sys 0.001s
I20260709 13:09:48.249923 30140 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:48.250902 29369 consensus_peers.cc:597] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.251894 30236 raft_consensus.cc:3060] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.255206 30140 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:48.256456 30153 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.262306 29517 consensus_peers.cc:597] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.263212 29517 consensus_peers.cc:597] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.276525 29403 raft_consensus.cc:1275] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.285097 29554 raft_consensus.cc:1275] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.287297 30173 consensus_queue.cc:1048] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.288201 29549 raft_consensus.cc:1275] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.290515 30140 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:48.296241 30144 raft_consensus.cc:359] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:48.321184 30153 raft_consensus.cc:2749] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.339848 30153 raft_consensus.cc:2749] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.341389 30144 raft_consensus.cc:740] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
W20260709 13:09:48.343737 29369 consensus_peers.cc:597] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.344542 29369 consensus_peers.cc:597] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.350666 30144 consensus_queue.cc:260] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:48.383004 30144 ts_tablet_manager.cc:1434] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.004s
I20260709 13:09:48.373375 30164 raft_consensus.cc:493] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81cf9a977cb447069d98dedbda0e4f06)
I20260709 13:09:48.364764 30231 consensus_queue.cc:1048] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:09:48.364738 30186 consensus_queue.cc:1048] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:09:48.391865 29549 raft_consensus.cc:1275] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.393075 30164 raft_consensus.cc:515] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:48.402518 30164 leader_election.cc:290] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
W20260709 13:09:48.389307 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.4:40041, user_credentials={real_user=slave}} blocked reactor thread for 111065us
I20260709 13:09:48.396279 30236 raft_consensus.cc:2749] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.403549 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:48.403746 30262 raft_consensus.cc:493] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.405057 30262 raft_consensus.cc:515] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:48.411301 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:48.411854 30262 leader_election.cc:290] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:48.413218 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
W20260709 13:09:48.413533 29517 consensus_peers.cc:597] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.414171 29517 consensus_peers.cc:597] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.415822 29406 raft_consensus.cc:1275] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.422760 30139 leader_election.cc:304] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:48.428534 30144 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:48.431070 30165 consensus_queue.cc:1048] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.432947 30262 raft_consensus.cc:2749] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:48.454028 29517 consensus_peers.cc:597] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.454995 30193 consensus_queue.cc:1048] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.462777 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d607df4f38c04c9190803085b2b1b842" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
W20260709 13:09:48.471246 29369 consensus_peers.cc:597] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.486627 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 482384us
I20260709 13:09:48.488271 29371 leader_election.cc:304] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:48.495529 30183 raft_consensus.cc:2749] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.497243 29476 raft_consensus.cc:1275] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.523120 29403 raft_consensus.cc:1275] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.522483 30193 consensus_queue.cc:1048] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:09:48.528087 29229 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34860 (request call id 109) took 1097 ms. Trace:
I20260709 13:09:48.549239 29228 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34882 (request call id 109) took 1041 ms. Trace:
I20260709 13:09:48.549621 29228 rpcz_store.cc:276] 0709 13:09:47.518127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.523294 (+  5167us) service_pool.cc:224] Handling call
0709 13:09:48.548588 (+1025294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:48.092486 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:48.093081 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:48.093112 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:09:48.093125 (+    13us) tablet.cc:662] Decoding operations
0709 13:09:48.093451 (+   326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:48.093497 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:48.093538 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:48.093710 (+   172us) tablet.cc:701] Row locks acquired
0709 13:09:48.093724 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:09:48.093858 (+   134us) write_op.cc:270] Start()
0709 13:09:48.093956 (+    98us) write_op.cc:276] Timestamp: P: 1783602588093812 usec, L: 0
0709 13:09:48.093976 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:09:48.391262 (+297286us) log.cc:844] Serialized 534 byte log entry
0709 13:09:48.447149 (+ 55887us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000ac154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635606de28 00007f6359aa8581 00007f6359aa7d58 00007f6359aac9f1 00007f6359aac9a9 00007f6359aac939 00007f6359aac901 00007f6359aabb2d 000000000038f354 000000000038f199
0709 13:09:48.544846 (+ 97697us) op_driver.cc:464] REPLICATION: finished
0709 13:09:48.546335 (+  1489us) write_op.cc:301] APPLY: starting
0709 13:09:48.546412 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:48.546507 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:48.546529 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:48.546755 (+   226us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:48.546900 (+   145us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:48.546943 (+    43us) write_op.cc:312] APPLY: finished
0709 13:09:48.547141 (+   198us) log.cc:844] Serialized 22 byte log entry
0709 13:09:48.547304 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.547375 (+    71us) write_op.cc:454] Released schema lock
0709 13:09:48.547412 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:48.548861 (+  1449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.548889 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1273,"apply.run_cpu_time_us":1398,"apply.run_wall_time_us":2471,"num_ops":1,"prepare.queue_time_us":538714,"prepare.run_cpu_time_us":7039,"prepare.run_wall_time_us":354816,"replication_time_us":450721,"spinlock_wait_cycles":677903104}]]}
W20260709 13:09:48.557086 29517 consensus_peers.cc:597] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.572760 29443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 83473.3us
I20260709 13:09:48.539568 29229 rpcz_store.cc:276] 0709 13:09:47.425760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.428814 (+  3054us) service_pool.cc:224] Handling call
0709 13:09:48.523450 (+1094636us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:47.850362 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:47.895609 (+ 45247us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:47.895669 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:09:47.895707 (+    38us) tablet.cc:662] Decoding operations
0709 13:09:47.896126 (+   419us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:47.896237 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:47.896273 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:47.896577 (+   304us) tablet.cc:701] Row locks acquired
0709 13:09:47.896635 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:09:47.896816 (+   181us) write_op.cc:270] Start()
0709 13:09:47.896980 (+   164us) write_op.cc:276] Timestamp: P: 1783602587896748 usec, L: 0
0709 13:09:47.897020 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:09:47.897752 (+   732us) log.cc:844] Serialized 534 byte log entry
0709 13:09:48.091906 (+194154us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b1800152560. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f635be4dde1 00007f635be5a5b1 00007f6355c1a4bc 00007f6352f6848b 00007f635bdc2ab9 00007f6352f8469b 00007f6352f8293f 00007f6352f84c02 00007f6355c0c20b 00007f6355c11d23 00007f6355c120d1
0709 13:09:48.092411 (+   505us) op_driver.cc:464] REPLICATION: finished
0709 13:09:48.471502 (+379091us) write_op.cc:301] APPLY: starting
0709 13:09:48.473841 (+  2339us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:48.486447 (+ 12606us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:48.490760 (+  4313us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:48.503822 (+ 13062us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b54000ac154. stack: 00007f6352f53343 00007f6352f53240 00007f63528e21d4 00007f635c620304 00007f635c620299 00007f6355fdb571 00007f635606f32a 00007f6355ff4f14 00007f6355ff4ec3 00007f6355ff4e38 00007f6355ff4df3 00007f6355ff40dc 00007f635601de16 00007f6356005cbb 00007f6355ff039d 00007f6355ff3d75
0709 13:09:48.504179 (+   357us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:48.504483 (+   304us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:48.504553 (+    70us) write_op.cc:312] APPLY: finished
0709 13:09:48.504880 (+   327us) log.cc:844] Serialized 22 byte log entry
0709 13:09:48.508824 (+  3944us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.510492 (+  1668us) write_op.cc:454] Released schema lock
0709 13:09:48.510566 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:48.511040 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.511070 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":371113,"apply.run_cpu_time_us":2627,"apply.run_wall_time_us":45210,"num_ops":1,"prepare.queue_time_us":230193,"prepare.run_cpu_time_us":12338,"prepare.run_wall_time_us":323948,"raft.queue_time_us":235968,"raft.run_cpu_time_us":83863,"raft.run_wall_time_us":486359,"replication_time_us":195200,"spinlock_wait_cycles":157076992,"thread_start_us":623648,"threads_started":4,"wal-append.queue_time_us":51730}]]}
I20260709 13:09:48.576750 30239 consensus_queue.cc:1048] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:09:48.647153 29547 raft_consensus.cc:1275] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.673053 30169 consensus_queue.cc:1048] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:48.688282 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c831fc495543c8beff6a28e80c0aa0" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:48.688987 29403 raft_consensus.cc:3060] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:48.694957 29517 consensus_peers.cc:597] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.695199 30144 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.738942 30144 tablet_bootstrap.cc:492] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:48.739920 30144 ts_tablet_manager.cc:1403] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.321s	user 0.019s	sys 0.012s
W20260709 13:09:48.748469 29369 consensus_peers.cc:597] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.749316 29369 consensus_peers.cc:597] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.784731 30164 raft_consensus.cc:493] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81cf9a977cb447069d98dedbda0e4f06)
I20260709 13:09:48.785370 30164 raft_consensus.cc:515] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:09:48.785915 30262 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.786450 30262 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:48.787595 30164 leader_election.cc:290] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:48.788524 30262 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:48.790405 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:48.795365 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:48.817484 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:48.819300 29371 leader_election.cc:304] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5dacd0232c24e92bc64f941b7410a9d; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:48.820489 30183 raft_consensus.cc:2749] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.768070 30144 raft_consensus.cc:359] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:48.828748 30144 raft_consensus.cc:740] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.829861 29554 raft_consensus.cc:1275] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer 81cf9a977cb447069d98dedbda0e4f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:48.837239 29403 raft_consensus.cc:2468] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 2.
I20260709 13:09:48.828332 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:48.845242 30148 consensus_queue.cc:1048] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:48.829917 30144 consensus_queue.cc:260] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
W20260709 13:09:48.864337 29443 consensus_peers.cc:597] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.866401 29443 consensus_peers.cc:597] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.867173 29443 leader_election.cc:336] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:09:48.867802 29443 consensus_peers.cc:597] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:48.868283 29443 consensus_peers.cc:597] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.874272 30138 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
W20260709 13:09:48.875016 29443 consensus_peers.cc:597] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.875619 30262 raft_consensus.cc:2749] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.876219 30144 ts_tablet_manager.cc:1434] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.136s	user 0.010s	sys 0.000s
W20260709 13:09:48.876510 29443 consensus_peers.cc:597] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.877523 30144 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:48.879282 29443 leader_election.cc:304] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:48.880133 30287 raft_consensus.cc:2804] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.880632 30287 raft_consensus.cc:697] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:48.881464 30287 consensus_queue.cc:237] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:09:48.882184 29369 consensus_peers.cc:597] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:48.897131 29369 consensus_peers.cc:597] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.884951 29228 catalog_manager.cc:5697] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.914204 29228 catalog_manager.cc:5697] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.934787 29228 catalog_manager.cc:5697] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:48.950716 29517 consensus_peers.cc:597] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.946813 29228 catalog_manager.cc:5697] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } }
I20260709 13:09:48.954795 29228 catalog_manager.cc:5697] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.959290 29228 catalog_manager.cc:5697] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.961156 29228 catalog_manager.cc:5697] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.969538 29228 catalog_manager.cc:5697] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.972412 29228 catalog_manager.cc:5697] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.975672 29228 catalog_manager.cc:5697] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } }
I20260709 13:09:48.978209 30144 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:48.979247 30144 tablet_bootstrap.cc:492] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:48.979914 30144 ts_tablet_manager.cc:1403] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.004s
W20260709 13:09:48.980108 29369 consensus_peers.cc:597] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:48.982803 30144 raft_consensus.cc:359] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:48.983562 30144 raft_consensus.cc:740] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.988000 30144 consensus_queue.cc:260] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:48.991431 30144 ts_tablet_manager.cc:1434] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:48.992379 30144 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
W20260709 13:09:48.996907 29443 consensus_peers.cc:597] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.008896 30191 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.009512 30191 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.015614 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:49.016580 29401 raft_consensus.cc:2468] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:49.012492 30191 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:49.024711 29517 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:49.029721 30191 raft_consensus.cc:2804] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.030766 30191 raft_consensus.cc:493] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.031127 30191 raft_consensus.cc:3060] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:49.041383 29517 leader_election.cc:336] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:49.046006 30191 raft_consensus.cc:515] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:09:49.055984 29369 consensus_peers.cc:597] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:49.068296 30144 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.069415 30144 tablet_bootstrap.cc:492] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:49.070133 30144 ts_tablet_manager.cc:1403] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.078s	user 0.029s	sys 0.012s
I20260709 13:09:49.073012 30144 raft_consensus.cc:359] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.073944 30144 raft_consensus.cc:740] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.074837 30144 consensus_queue.cc:260] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:09:49.076095 29517 leader_election.cc:336] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:49.080392 29229 catalog_manager.cc:5697] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.082439 29229 catalog_manager.cc:5697] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.084208 29229 catalog_manager.cc:5697] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.086585 29229 catalog_manager.cc:5697] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.091835 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e018f136fea466ab0d7ed7aa4592f06" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:49.092466 29401 raft_consensus.cc:3060] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.093391 29229 catalog_manager.cc:5697] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.082513 30144 ts_tablet_manager.cc:1434] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:49.088994 30191 leader_election.cc:290] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:49.101676 30144 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:49.147208 30287 raft_consensus.cc:493] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.147902 30287 raft_consensus.cc:515] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.149610 30144 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.156544 30144 tablet_bootstrap.cc:492] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:49.157455 30144 ts_tablet_manager.cc:1403] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.056s	user 0.028s	sys 0.017s
I20260709 13:09:49.161662 30144 raft_consensus.cc:359] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:49.162446 30144 raft_consensus.cc:740] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.163312 30144 consensus_queue.cc:260] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:49.165434 30144 ts_tablet_manager.cc:1434] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:49.185045 30144 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:49.150815 29401 raft_consensus.cc:2468] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 3.
I20260709 13:09:49.193837 29517 leader_election.cc:304] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:09:49.196900 30233 raft_consensus.cc:2804] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.197471 30233 raft_consensus.cc:697] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:49.198410 30233 consensus_queue.cc:237] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.182083 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:49.180230 30287 leader_election.cc:290] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:49.237957 29554 raft_consensus.cc:2468] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 2.
I20260709 13:09:49.260275 29445 leader_election.cc:304] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:49.265553 30148 raft_consensus.cc:2804] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.265992 30148 raft_consensus.cc:493] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.266316 30148 raft_consensus.cc:3060] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.275008 29225 catalog_manager.cc:5697] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 1 to 2, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.275051 30148 raft_consensus.cc:515] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.285630 30148 leader_election.cc:290] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:49.286414 30144 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.287439 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51388e1eccfc4e28afe0b67f552695c6" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:49.287434 30144 tablet_bootstrap.cc:492] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:49.288205 29554 raft_consensus.cc:3060] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.290685 30144 ts_tablet_manager.cc:1403] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.106s	user 0.030s	sys 0.018s
I20260709 13:09:49.304204 30144 raft_consensus.cc:359] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.304939 30144 raft_consensus.cc:740] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.305667 30144 consensus_queue.cc:260] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:49.289600 29443 consensus_peers.cc:597] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.307173 29443 leader_election.cc:336] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:49.306054 29554 raft_consensus.cc:2468] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 3.
I20260709 13:09:49.308756 30144 ts_tablet_manager.cc:1434] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:49.320843 29445 leader_election.cc:304] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:49.320889 30144 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:49.322311 30148 raft_consensus.cc:2804] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.322898 30148 raft_consensus.cc:697] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:49.323349 29225 catalog_manager.cc:5697] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 3, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 3 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.323792 30148 consensus_queue.cc:237] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:09:49.332851 29443 consensus_peers.cc:597] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.334251 29443 consensus_peers.cc:597] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.349130 29443 leader_election.cc:336] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:49.350721 29225 catalog_manager.cc:5697] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 1 to 3, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:49.358834 29443 consensus_peers.cc:597] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.376739 29443 consensus_peers.cc:597] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.392648 30144 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.394135 30144 tablet_bootstrap.cc:492] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:49.394999 30144 ts_tablet_manager.cc:1403] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.002s
I20260709 13:09:49.398697 30144 raft_consensus.cc:359] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.399631 30144 raft_consensus.cc:740] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.400499 30144 consensus_queue.cc:260] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.404241 30144 ts_tablet_manager.cc:1434] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:09:49.405159 30144 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:49.425894 30183 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.426587 30183 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.429482 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:49.430215 29554 raft_consensus.cc:2468] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:09:49.432500 29371 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
W20260709 13:09:49.433933 29443 consensus_peers.cc:597] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.440032 29369 leader_election.cc:336] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:09:49.440330 30126 raft_consensus.cc:2804] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.440793 30126 raft_consensus.cc:493] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.441021 30183 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:49.444921 30144 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.446303 30144 tablet_bootstrap.cc:492] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:49.447232 30144 ts_tablet_manager.cc:1403] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.004s
I20260709 13:09:49.451215 30144 raft_consensus.cc:359] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.452221 30144 raft_consensus.cc:740] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.454064 30144 consensus_queue.cc:260] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.458231 30144 ts_tablet_manager.cc:1434] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:09:49.441176 30126 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.460364 30144 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:49.471432 30126 raft_consensus.cc:515] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.474277 29406 raft_consensus.cc:1275] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 81cf9a977cb447069d98dedbda0e4f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.477893 30148 consensus_queue.cc:1048] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.480548 30262 raft_consensus.cc:493] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.481228 30262 raft_consensus.cc:515] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.483420 30126 leader_election.cc:290] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:49.483567 30262 leader_election.cc:290] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:49.485548 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:49.485801 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:49.486582 29549 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.487319 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a150eab0c5544ffdb1289b03eb527a5b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:49.490496 30140 leader_election.cc:304] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:49.492095 30262 raft_consensus.cc:2749] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.504747 29549 raft_consensus.cc:2468] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 3.
I20260709 13:09:49.510419 30144 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.511502 30144 tablet_bootstrap.cc:492] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:49.511600 29371 leader_election.cc:304] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:49.512173 30144 ts_tablet_manager.cc:1403] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.000s
I20260709 13:09:49.515779 30183 raft_consensus.cc:2804] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.515620 30144 raft_consensus.cc:359] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.517786 30144 raft_consensus.cc:740] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.518577 30144 consensus_queue.cc:260] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.524340 30144 ts_tablet_manager.cc:1434] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:09:49.525303 30144 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:49.533062 30183 raft_consensus.cc:697] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 3 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:09:49.534149 30183 consensus_queue.cc:237] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.636976 30148 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.637492 30148 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.639577 30148 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:49.644327 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:49.645118 29549 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 2.
I20260709 13:09:49.647258 29445 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:49.648316 30001 raft_consensus.cc:2804] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.648713 30001 raft_consensus.cc:493] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.649022 30001 raft_consensus.cc:3060] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.675943 29401 raft_consensus.cc:1275] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:49.678397 30233 consensus_queue.cc:1048] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:49.716511 29549 raft_consensus.cc:1275] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 81cf9a977cb447069d98dedbda0e4f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:49.717988 30287 consensus_queue.cc:1048] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.656507 30001 raft_consensus.cc:515] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.731369 30001 leader_election.cc:290] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:49.732067 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:09:49.735219 29547 raft_consensus.cc:3060] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.735765 30144 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.741034 30144 tablet_bootstrap.cc:492] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:49.742120 30144 ts_tablet_manager.cc:1403] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.217s	user 0.023s	sys 0.003s
I20260709 13:09:49.742367 29547 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 3.
I20260709 13:09:49.743510 29445 leader_election.cc:304] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:09:49.744242 30001 raft_consensus.cc:2804] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:49.735652 30326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:40325 every 8 connection(s)
I20260709 13:09:49.744697 30001 raft_consensus.cc:697] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 3 LEADER]: Becoming Leader. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:09:49.744925 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:40325
I20260709 13:09:49.752209 30144 raft_consensus.cc:359] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.753468 30144 raft_consensus.cc:740] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.754684 30144 consensus_queue.cc:260] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.762223 30001 consensus_queue.cc:237] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:49.767565 30144 ts_tablet_manager.cc:1434] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:09:49.778931 30144 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:49.780556 29225 catalog_manager.cc:5697] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 3, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 3 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.853179 30262 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.876992 30262 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.879957 30262 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:49.881201 30191 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.886857 30191 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.887789 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:49.889209 30191 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:49.895865 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:49.895013 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:49.897006 29406 raft_consensus.cc:2468] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:09:49.898518 29517 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:49.906051 29225 catalog_manager.cc:5697] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 reported cstate change: term changed from 1 to 3, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "81cf9a977cb447069d98dedbda0e4f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.907505 30138 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:49.901542 30191 raft_consensus.cc:2804] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:49.929085 30191 raft_consensus.cc:493] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.932431 30262 raft_consensus.cc:2749] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.943919 29549 raft_consensus.cc:1275] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:49.947552 30329 consensus_queue.cc:1048] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:49.951928 30262 raft_consensus.cc:493] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.952761 30262 raft_consensus.cc:515] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:49.942646 30191 raft_consensus.cc:3060] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:49.981019 30144 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.982120 30144 tablet_bootstrap.cc:492] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:49.982803 30144 ts_tablet_manager.cc:1403] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.204s	user 0.029s	sys 0.023s
I20260709 13:09:50.026326 30262 leader_election.cc:290] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:50.026984 30262 raft_consensus.cc:493] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.027421 30262 raft_consensus.cc:515] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:50.033924 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:50.010988 30144 raft_consensus.cc:359] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:50.035324 30144 raft_consensus.cc:740] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.043463 30191 raft_consensus.cc:515] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:50.045704 30262 leader_election.cc:290] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:50.046334 30262 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.046787 30262 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:50.047420 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:50.051100 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:50.053699 30292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b146e77806e403d90813507378d6bea" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:50.054536 30292 raft_consensus.cc:3060] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.056478 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4514facbaa1474a8481ce0b8849abeb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:50.036149 30144 consensus_queue.cc:260] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:50.058454 30337 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37947
I20260709 13:09:50.058917 30337 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:50.058801 30140 leader_election.cc:304] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:50.059381 30144 ts_tablet_manager.cc:1434] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:09:50.060073 30337 heartbeater.cc:507] Master 127.20.69.62:37947 requested a full tablet report, sending...
I20260709 13:09:50.060554 30349 raft_consensus.cc:2749] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.061249 30262 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:09:50.053699 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c38085886474ddd9d257bc1c526903f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:50.062815 29549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "470465ef54334dbc8be5230ca16dc1a8" is_pre_election: true
I20260709 13:09:50.060463 30144 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.069998 30191 leader_election.cc:290] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 election: Requested vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:09:50.070964 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:09:50.077021 30288 raft_consensus.cc:3060] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.089975 29401 raft_consensus.cc:3060] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.079337 30140 leader_election.cc:304] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:50.080842 30282 raft_consensus.cc:3060] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.098627 30140 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:09:50.099970 30292 raft_consensus.cc:2468] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 3.
I20260709 13:09:50.102581 29401 raft_consensus.cc:2468] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 3.
I20260709 13:09:50.108506 30348 raft_consensus.cc:2749] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.112637 30349 raft_consensus.cc:2749] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:50.119001 29517 leader_election.cc:304] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:09:50.120456 30191 raft_consensus.cc:2804] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:50.121006 30191 raft_consensus.cc:697] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 3 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:09:50.121850 30191 consensus_queue.cc:237] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:50.125885 30262 raft_consensus.cc:493] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.127288 30262 raft_consensus.cc:515] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.130426 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0651fb124d44bf80d91e28c36d58d3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:50.131036 30262 leader_election.cc:290] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:50.131690 29479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0651fb124d44bf80d91e28c36d58d3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:50.132943 30286 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.140707 30139 leader_election.cc:304] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:50.142576 30351 raft_consensus.cc:2749] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.148182 29226 ts_manager.cc:194] Re-registered known tserver with Master: 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:09:50.162935 30144 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.164480 30144 tablet_bootstrap.cc:492] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.165463 30144 ts_tablet_manager.cc:1403] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.105s	user 0.027s	sys 0.017s
I20260709 13:09:50.175390 30144 raft_consensus.cc:359] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:50.176489 30144 raft_consensus.cc:740] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.184336 30144 consensus_queue.cc:260] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:50.188340 30283 raft_consensus.cc:1275] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.191393 30351 raft_consensus.cc:493] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.191962 30351 raft_consensus.cc:515] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.202564 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81cf9a977cb447069d98dedbda0e4f06" is_pre_election: true
I20260709 13:09:50.208875 30351 leader_election.cc:290] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:09:50.215248 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d" is_pre_election: true
I20260709 13:09:50.216706 30144 ts_tablet_manager.cc:1434] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:09:50.223958 30138 leader_election.cc:304] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002; no voters: 81cf9a977cb447069d98dedbda0e4f06, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:09:50.232067 30144 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.241211 30262 raft_consensus.cc:2749] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:50.252856 30292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:50.253675 30292 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 1.
I20260709 13:09:50.270499 30283 raft_consensus.cc:3060] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.281739 30288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef92dc4e7b304f9e8f8e5318c7df0a9c" candidate_uuid: "81cf9a977cb447069d98dedbda0e4f06" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:50.282662 30288 raft_consensus.cc:3060] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.283696 29225 catalog_manager.cc:5697] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 3, leader changed from 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 3 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.318923 30278 raft_consensus.cc:3060] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.319021 30286 raft_consensus.cc:3060] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:50.321545 29226 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58716
I20260709 13:09:50.324990 30288 raft_consensus.cc:2468] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81cf9a977cb447069d98dedbda0e4f06 in term 3.
I20260709 13:09:50.325600 30282 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.327692 30337 heartbeater.cc:499] Master 127.20.69.62:37947 was elected leader, sending a full tablet report...
I20260709 13:09:50.333808 30286 raft_consensus.cc:1275] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.336161 30283 raft_consensus.cc:3060] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.341470 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002" is_pre_election: true
I20260709 13:09:50.356528 29554 raft_consensus.cc:1275] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 81cf9a977cb447069d98dedbda0e4f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.359826 30359 consensus_queue.cc:1048] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:50.374526 29443 consensus_peers.cc:597] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:50.375260 29443 consensus_peers.cc:597] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.363729 30288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e86fc16f64d159c1132b17d8ef34b" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
I20260709 13:09:50.366719 30171 consensus_queue.cc:1048] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:50.383895 30191 consensus_queue.cc:1048] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:50.387199 29517 leader_election.cc:343] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.402765 30281 raft_consensus.cc:1275] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Refusing update from remote peer 81cf9a977cb447069d98dedbda0e4f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:09:50.406423 29517 leader_election.cc:343] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.411388 30240 consensus_queue.cc:1048] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:50.438657 29517 consensus_peers.cc:597] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:50.457433 30144 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.458683 30144 tablet_bootstrap.cc:492] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.459285 30144 ts_tablet_manager.cc:1403] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.234s	user 0.026s	sys 0.009s
I20260709 13:09:50.463948 30144 raft_consensus.cc:359] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.464737 30144 raft_consensus.cc:740] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.465651 30144 consensus_queue.cc:260] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.467761 30144 ts_tablet_manager.cc:1434] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
W20260709 13:09:50.457445 30366 log.cc:927] Time spent T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:09:50.468587 30144 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.500986 30144 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.502261 30144 tablet_bootstrap.cc:492] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.503006 30144 ts_tablet_manager.cc:1403] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.004s
I20260709 13:09:50.507752 30144 raft_consensus.cc:359] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.508498 30144 raft_consensus.cc:740] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.510696 30144 consensus_queue.cc:260] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.513302 30144 ts_tablet_manager.cc:1434] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:50.518131 30144 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.529155 30283 raft_consensus.cc:3060] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:50.560971 29517 consensus_peers.cc:597] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:50.604288 30144 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.605573 30144 tablet_bootstrap.cc:492] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.613871 30144 ts_tablet_manager.cc:1403] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.096s	user 0.027s	sys 0.011s
I20260709 13:09:50.616252 30144 raft_consensus.cc:359] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.616842 30144 raft_consensus.cc:740] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.617410 30144 consensus_queue.cc:260] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.619788 30144 ts_tablet_manager.cc:1434] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:50.620679 30144 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.642500 30144 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.643607 30144 tablet_bootstrap.cc:492] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.644289 30144 ts_tablet_manager.cc:1403] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:09:50.646891 30144 raft_consensus.cc:359] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.647593 30144 raft_consensus.cc:740] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.648193 30144 consensus_queue.cc:260] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.650416 30144 ts_tablet_manager.cc:1434] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:50.669874 29403 raft_consensus.cc:1275] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:50.673175 30191 consensus_queue.cc:1048] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.687208 30144 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
W20260709 13:09:50.696774 29517 consensus_peers.cc:597] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:50.736676 30144 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.737703 30144 tablet_bootstrap.cc:492] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.738412 30144 ts_tablet_manager.cc:1403] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.019s
I20260709 13:09:50.741044 30144 raft_consensus.cc:359] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.741770 30144 raft_consensus.cc:740] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.742604 30144 consensus_queue.cc:260] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.745837 30144 ts_tablet_manager.cc:1434] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:50.746842 30144 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.773386 30144 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.774386 30144 tablet_bootstrap.cc:492] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.775132 30144 ts_tablet_manager.cc:1403] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 13:09:50.784771 30144 raft_consensus.cc:359] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:50.785535 30144 raft_consensus.cc:740] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.786238 30144 consensus_queue.cc:260] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:50.788735 30144 ts_tablet_manager.cc:1434] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:50.791193 30281 raft_consensus.cc:3060] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.797767 30144 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.877195 30281 raft_consensus.cc:3060] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:50.894136 29369 consensus_peers.cc:597] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:50.911039 30144 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.912046 30144 tablet_bootstrap.cc:492] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.912734 30144 ts_tablet_manager.cc:1403] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.123s	user 0.029s	sys 0.046s
I20260709 13:09:50.915321 30144 raft_consensus.cc:359] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.915993 30144 raft_consensus.cc:740] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.916705 30144 consensus_queue.cc:260] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:50.918939 30144 ts_tablet_manager.cc:1434] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:50.919736 30144 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.948887 30144 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.950238 30144 tablet_bootstrap.cc:492] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.951042 30144 ts_tablet_manager.cc:1403] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.008s
I20260709 13:09:50.954931 30144 raft_consensus.cc:359] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:50.955765 30144 raft_consensus.cc:740] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.957672 30144 consensus_queue.cc:260] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:50.960136 30144 ts_tablet_manager.cc:1434] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:50.961370 30144 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:50.978029 30144 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.979106 30144 tablet_bootstrap.cc:492] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:50.979894 30144 ts_tablet_manager.cc:1403] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:09:50.982769 30144 raft_consensus.cc:359] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:50.983502 30144 raft_consensus.cc:740] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.984284 30144 consensus_queue.cc:260] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:50.986622 30144 ts_tablet_manager.cc:1434] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:09:50.988231 30144 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.008425 30144 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.009421 30144 tablet_bootstrap.cc:492] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.010111 30144 ts_tablet_manager.cc:1403] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:09:51.012923 30144 raft_consensus.cc:359] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.013598 30144 raft_consensus.cc:740] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.014317 30144 consensus_queue.cc:260] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.017885 30144 ts_tablet_manager.cc:1434] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:51.019659 30144 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.037168 30144 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.038434 30144 tablet_bootstrap.cc:492] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.039191 30144 ts_tablet_manager.cc:1403] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:09:51.041999 30144 raft_consensus.cc:359] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.042742 30144 raft_consensus.cc:740] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.043462 30144 consensus_queue.cc:260] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.045754 30144 ts_tablet_manager.cc:1434] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:51.046883 30144 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.190567 30144 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.191583 30144 tablet_bootstrap.cc:492] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.192257 30144 ts_tablet_manager.cc:1403] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.146s	user 0.032s	sys 0.028s
W20260709 13:09:51.196291 29517 consensus_peers.cc:597] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:51.223250 30144 raft_consensus.cc:359] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:51.224398 30144 raft_consensus.cc:740] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.226146 30144 consensus_queue.cc:260] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:51.234300 30144 ts_tablet_manager.cc:1434] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:09:51.235167 30144 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.266618 30144 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.267537 30144 tablet_bootstrap.cc:492] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.268234 30144 ts_tablet_manager.cc:1403] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.004s
I20260709 13:09:51.270989 30144 raft_consensus.cc:359] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.271917 30144 raft_consensus.cc:740] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.272740 30144 consensus_queue.cc:260] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.274817 30144 ts_tablet_manager.cc:1434] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:51.275908 30144 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.286540 30283 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.293828 30144 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.295374 30144 tablet_bootstrap.cc:492] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.296121 30144 ts_tablet_manager.cc:1403] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:09:51.299974 30144 raft_consensus.cc:359] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.300978 30144 raft_consensus.cc:740] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.302013 30144 consensus_queue.cc:260] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.304266 30144 ts_tablet_manager.cc:1434] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:51.305334 30144 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.354657 30144 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.355561 30144 tablet_bootstrap.cc:492] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.356231 30144 ts_tablet_manager.cc:1403] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.024s
I20260709 13:09:51.359057 30144 raft_consensus.cc:359] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:51.359651 30144 raft_consensus.cc:740] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.360343 30144 consensus_queue.cc:260] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:51.362056 30144 ts_tablet_manager.cc:1434] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:51.362928 30144 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.385644 30144 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.386696 30144 tablet_bootstrap.cc:492] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.387372 30144 ts_tablet_manager.cc:1403] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.011s
I20260709 13:09:51.389621 30144 raft_consensus.cc:359] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.390127 30144 raft_consensus.cc:740] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.394961 30144 consensus_queue.cc:260] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.396584 30281 raft_consensus.cc:3060] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.397172 30144 ts_tablet_manager.cc:1434] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:51.398072 30144 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.514846 30144 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.515756 30144 tablet_bootstrap.cc:492] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.516362 30144 ts_tablet_manager.cc:1403] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.118s	user 0.049s	sys 0.041s
I20260709 13:09:51.519191 30144 raft_consensus.cc:359] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.519755 30144 raft_consensus.cc:740] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.520475 30144 consensus_queue.cc:260] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.522197 30144 ts_tablet_manager.cc:1434] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:51.522969 30144 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.541524 30144 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.542649 30144 tablet_bootstrap.cc:492] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.543494 30144 ts_tablet_manager.cc:1403] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:09:51.546566 30144 raft_consensus.cc:359] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.547326 30144 raft_consensus.cc:740] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.547467 30283 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.548316 30144 consensus_queue.cc:260] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.550755 30144 ts_tablet_manager.cc:1434] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:09:51.551653 30144 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.582693 30144 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.583734 30144 tablet_bootstrap.cc:492] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.584501 30144 ts_tablet_manager.cc:1403] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.009s
I20260709 13:09:51.587224 30144 raft_consensus.cc:359] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.587824 30144 raft_consensus.cc:740] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.588439 30144 consensus_queue.cc:260] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.590796 30144 ts_tablet_manager.cc:1434] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:51.591595 30144 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.607215 30144 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.608182 30144 tablet_bootstrap.cc:492] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.608863 30144 ts_tablet_manager.cc:1403] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:09:51.611474 30144 raft_consensus.cc:359] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.612047 30144 raft_consensus.cc:740] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.612703 30144 consensus_queue.cc:260] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:09:51.615684 30144 ts_tablet_manager.cc:1434] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:51.616544 30144 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.635748 30144 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.636759 30144 tablet_bootstrap.cc:492] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.637425 30144 ts_tablet_manager.cc:1403] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:09:51.645113 30144 raft_consensus.cc:359] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.645887 30144 raft_consensus.cc:740] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.646585 30144 consensus_queue.cc:260] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.649106 30144 ts_tablet_manager.cc:1434] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:51.650072 30144 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.677378 30144 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.678270 30144 tablet_bootstrap.cc:492] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.678943 30144 ts_tablet_manager.cc:1403] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.006s
I20260709 13:09:51.681553 30144 raft_consensus.cc:359] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:51.683203 30144 raft_consensus.cc:740] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.684031 30144 consensus_queue.cc:260] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:51.687158 30283 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.693341 30144 ts_tablet_manager.cc:1434] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:09:51.700541 30144 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:51.738416 30286 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.744843 30144 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:51.745900 30144 tablet_bootstrap.cc:492] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:51.746574 30144 ts_tablet_manager.cc:1403] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.007s
I20260709 13:09:51.749406 30144 raft_consensus.cc:359] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.750087 30144 raft_consensus.cc:740] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.767714 30144 consensus_queue.cc:260] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:51.779105 30144 ts_tablet_manager.cc:1434] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:09:51.780113 30144 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
W20260709 13:09:51.810146 30406 log.cc:927] Time spent T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:09:51.913861 29370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 43831.7us
W20260709 13:09:51.976823 29369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 177053us
W20260709 13:09:51.982872 29517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:40325, user_credentials={real_user=slave}} blocked reactor thread for 57964.6us
I20260709 13:09:52.000913 30283 raft_consensus.cc:3060] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.001832 30278 raft_consensus.cc:3060] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.040585 30144 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.048683 30288 raft_consensus.cc:3060] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.079885 30144 tablet_bootstrap.cc:492] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:52.080749 30144 ts_tablet_manager.cc:1403] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.301s	user 0.031s	sys 0.044s
I20260709 13:09:52.093736 30281 raft_consensus.cc:3060] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.094586 30144 raft_consensus.cc:359] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:52.104270 30144 raft_consensus.cc:740] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.105074 30144 consensus_queue.cc:260] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:09:52.107640 30144 ts_tablet_manager.cc:1434] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:52.108425 30144 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap starting.
I20260709 13:09:52.153627 30144 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:52.154644 30144 tablet_bootstrap.cc:492] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Bootstrap complete.
I20260709 13:09:52.155380 30144 ts_tablet_manager.cc:1403] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.010s
I20260709 13:09:52.158165 30144 raft_consensus.cc:359] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:52.159193 30144 raft_consensus.cc:740] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.159888 30144 consensus_queue.cc:260] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:09:52.162416 30144 ts_tablet_manager.cc:1434] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:52.255879 30281 raft_consensus.cc:3060] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:09:59.541193 29575 debug-util.cc:398] Leaking SignalData structure 0x7b0800055700 after lost signal to thread 20759
W20260709 13:09:59.542294 29575 debug-util.cc:398] Leaking SignalData structure 0x7b080005ef40 after lost signal to thread 29263
W20260709 13:09:59.543385 29575 debug-util.cc:398] Leaking SignalData structure 0x7b080031dec0 after lost signal to thread 29430
W20260709 13:09:59.544358 29575 debug-util.cc:398] Leaking SignalData structure 0x7b08002cf180 after lost signal to thread 29504
W20260709 13:09:59.545346 29575 debug-util.cc:398] Leaking SignalData structure 0x7b0800201120 after lost signal to thread 29578
W20260709 13:09:59.546370 29575 debug-util.cc:398] Leaking SignalData structure 0x7b08003704a0 after lost signal to thread 30326
I20260709 13:10:00.153761 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:00.217862 29480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:00.218838 29480 raft_consensus.cc:606] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:00.241969 29397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce"
dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:43392
I20260709 13:10:00.242579 29397 raft_consensus.cc:606] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:00.245453 29480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:00.246088 29480 raft_consensus.cc:606] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:10:00.248700 29480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:00.249329 29480 raft_consensus.cc:606] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:10:00.251966 29480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:00.252627 29480 raft_consensus.cc:606] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:00.257093 29480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:00.258860 29480 raft_consensus.cc:606] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:10:00.264849 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:00.266592 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:00.269297 30454 raft_consensus.cc:993] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:00.270105 30433 raft_consensus.cc:1081] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:00.272185 29547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:00.272797 29547 raft_consensus.cc:493] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.273253 29547 raft_consensus.cc:3060] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.279117 29547 raft_consensus.cc:515] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.281545 29547 leader_election.cc:290] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:00.282166 29397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:00.283077 29397 raft_consensus.cc:3060] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.287735 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97fa8cf984a4161b829432f9ecf4264" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:00.288152 30433 raft_consensus.cc:993] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:00.288877 30430 raft_consensus.cc:1081] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:00.289971 29480 raft_consensus.cc:3055] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.290433 29480 raft_consensus.cc:740] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:00.291345 29547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:00.291968 29547 raft_consensus.cc:493] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.296518 29547 raft_consensus.cc:3060] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.292989 29480 consensus_queue.cc:260] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.297914 29480 raft_consensus.cc:3060] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.299796 29397 raft_consensus.cc:2468] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:00.301461 29517 leader_election.cc:304] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:00.302563 30451 raft_consensus.cc:2804] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.303053 30451 raft_consensus.cc:697] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:00.304127 30451 consensus_queue.cc:237] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.305742 29480 raft_consensus.cc:2468] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:00.317209 29547 raft_consensus.cc:515] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.328387 29547 leader_election.cc:290] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:00.331988 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:00.332679 29476 raft_consensus.cc:3055] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.332988 29476 raft_consensus.cc:740] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:00.333853 29476 consensus_queue.cc:260] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.332993 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ae9afbd8b84370bae083fab7970e20" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:00.335640 29401 raft_consensus.cc:3060] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.340746 29476 raft_consensus.cc:3060] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.346792 29228 catalog_manager.cc:5697] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.358952 29476 raft_consensus.cc:2468] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:00.360358 29518 leader_election.cc:304] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:10:00.361289 30451 raft_consensus.cc:2804] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.361791 30451 raft_consensus.cc:697] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:00.362742 30451 consensus_queue.cc:237] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.401445 30430 raft_consensus.cc:993] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:00.402426 29401 raft_consensus.cc:2468] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:00.403221 30430 raft_consensus.cc:1081] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:00.410375 30449 raft_consensus.cc:993] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:00.411078 30427 raft_consensus.cc:1081] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:00.415176 30433 raft_consensus.cc:993] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:00.415797 30433 raft_consensus.cc:1081] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:00.415844 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49402
I20260709 13:10:00.416682 30267 raft_consensus.cc:493] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.419302 30267 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.424508 30286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49406
I20260709 13:10:00.428014 30286 raft_consensus.cc:493] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.428409 30286 raft_consensus.cc:3060] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.441309 30267 raft_consensus.cc:515] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:00.444294 29547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:00.445014 29547 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.449811 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee25eabd993465aafd680f5ab69e5ce" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:00.450819 29401 raft_consensus.cc:3055] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:00.453192 29401 raft_consensus.cc:740] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:10:00.454386 29401 consensus_queue.cc:260] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:00.460613 29401 raft_consensus.cc:3060] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.474224 29547 raft_consensus.cc:2468] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:00.479261 29554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:00.484056 29554 raft_consensus.cc:493] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.483886 29401 raft_consensus.cc:2468] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:00.484695 29554 raft_consensus.cc:3060] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.489257 30138 leader_election.cc:304] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:00.444335 30267 leader_election.cc:290] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:10:00.492542 29554 raft_consensus.cc:515] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.476941 30286 raft_consensus.cc:515] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:00.508049 30286 leader_election.cc:290] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:00.510984 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:00.513909 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e043911685cb4c5889c1ea44573a0f80" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:00.549010 29476 raft_consensus.cc:3055] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.549410 29476 raft_consensus.cc:740] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:00.519349 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:00.551524 29480 raft_consensus.cc:3055] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.552541 29480 raft_consensus.cc:740] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:00.553440 29480 consensus_queue.cc:260] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:00.554654 29480 raft_consensus.cc:3060] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.552100 29401 raft_consensus.cc:3060] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.550372 29476 consensus_queue.cc:260] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.561771 29476 raft_consensus.cc:3060] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.547837 29554 leader_election.cc:290] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:00.591121 29480 raft_consensus.cc:2468] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:00.592718 30139 leader_election.cc:304] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:10:00.596800 30465 raft_consensus.cc:993] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:00.597641 30465 raft_consensus.cc:1081] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:00.599778 29401 raft_consensus.cc:2468] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:00.600265 30283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49406
I20260709 13:10:00.603732 30283 raft_consensus.cc:493] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.604179 30283 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.613767 30283 raft_consensus.cc:515] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:00.619582 29517 leader_election.cc:304] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:00.653825 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:00.659742 29480 raft_consensus.cc:3055] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:00.660199 29480 raft_consensus.cc:740] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:00.661221 29480 consensus_queue.cc:260] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:00.655752 30472 raft_consensus.cc:2804] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.666859 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078e833dff54448e9a5a55e83660ff35" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:00.667655 29553 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.654991 30469 raft_consensus.cc:2804] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.656657 30283 leader_election.cc:290] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:00.662326 30431 raft_consensus.cc:2804] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.672297 29228 catalog_manager.cc:5697] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.619580 29476 raft_consensus.cc:2468] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
W20260709 13:10:00.656059 30138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 166992us
I20260709 13:10:00.680243 29480 raft_consensus.cc:3060] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.715750 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec95604cb33f41a39ea52005380127cb" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:00.709591 29553 raft_consensus.cc:2468] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:00.730399 29401 raft_consensus.cc:3060] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.731031 30469 raft_consensus.cc:697] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:00.727044 29399 raft_consensus.cc:1275] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.721401 30431 raft_consensus.cc:697] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:00.733135 30469 consensus_queue.cc:237] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:00.734845 30431 consensus_queue.cc:237] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:00.737133 30472 raft_consensus.cc:697] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:00.738209 30472 consensus_queue.cc:237] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:00.753682 30140 leader_election.cc:304] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:10:00.755007 30475 raft_consensus.cc:2804] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.753607 30477 consensus_queue.cc:1048] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:00.755543 30475 raft_consensus.cc:697] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:00.756508 30475 consensus_queue.cc:237] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:00.757249 29480 raft_consensus.cc:2468] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:00.781705 29401 raft_consensus.cc:2468] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:00.798339 29228 catalog_manager.cc:5697] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.810037 29226 catalog_manager.cc:5697] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 2 to 3, leader changed from a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.817706 29401 raft_consensus.cc:1275] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.811784 29226 catalog_manager.cc:5697] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.823496 30477 consensus_queue.cc:1048] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.831394 29226 catalog_manager.cc:5697] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 2 to 3, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.850435 29480 raft_consensus.cc:1275] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.852454 30431 consensus_queue.cc:1048] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.853363 29480 raft_consensus.cc:1275] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.856791 30451 consensus_queue.cc:1048] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.119818 29399 raft_consensus.cc:1275] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.122233 30475 consensus_queue.cc:1048] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:01.139225 29553 raft_consensus.cc:1275] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.140964 30469 consensus_queue.cc:1048] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.158255 29399 raft_consensus.cc:1275] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.162277 30474 consensus_queue.cc:1048] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.189505 29480 raft_consensus.cc:1275] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.191900 30477 consensus_queue.cc:1048] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.267688 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.277878 29476 raft_consensus.cc:1275] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.279400 30469 consensus_queue.cc:1048] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.300539 29480 raft_consensus.cc:1275] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.302054 30469 consensus_queue.cc:1048] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.307379 29399 raft_consensus.cc:1275] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.313863 30469 consensus_queue.cc:1048] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.326172 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.347684 29553 raft_consensus.cc:1275] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.372774 30472 consensus_queue.cc:1048] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.466904 29476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:01.467609 29476 raft_consensus.cc:606] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:10:01.470892 29476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:01.471617 29476 raft_consensus.cc:606] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:10:01.476920 29476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:01.477677 29476 raft_consensus.cc:606] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:10:01.482200 29399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe"
dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:43392
I20260709 13:10:01.482901 29399 raft_consensus.cc:606] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:01.502821 29553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d828a447d3f049c58c173033d6095611"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:43808
I20260709 13:10:01.503513 29553 raft_consensus.cc:606] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:01.510442 29553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd516b0c89f946de845897e58c667be6"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:43808
I20260709 13:10:01.511139 29553 raft_consensus.cc:606] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:01.512806 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:01.514649 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:01.520181 30427 raft_consensus.cc:993] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:01.520752 30449 raft_consensus.cc:1081] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:01.527588 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49402
I20260709 13:10:01.528218 30267 raft_consensus.cc:493] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.528620 30267 raft_consensus.cc:3060] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.534127 30466 raft_consensus.cc:993] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:01.534785 30466 raft_consensus.cc:1081] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:01.537846 30267 raft_consensus.cc:515] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:01.540752 30267 leader_election.cc:290] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:01.540889 29399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:01.541638 29399 raft_consensus.cc:3055] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.542009 29399 raft_consensus.cc:740] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:10:01.543057 29399 consensus_queue.cc:260] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:01.543367 29553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:01.544135 29553 raft_consensus.cc:493] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.544471 29399 raft_consensus.cc:3060] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.544556 29553 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.546813 29476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7d4ae59b2148a9ba089ad2475cddbe" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:01.547575 29476 raft_consensus.cc:3060] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.552371 29553 raft_consensus.cc:515] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:01.553690 29399 raft_consensus.cc:2468] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:01.555087 30138 leader_election.cc:304] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:01.555630 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:01.555784 29553 leader_election.cc:290] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:01.556053 30472 raft_consensus.cc:2804] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.556319 29403 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.556646 30472 raft_consensus.cc:697] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:01.557610 30472 consensus_queue.cc:237] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:01.562866 29475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:01.563585 29475 raft_consensus.cc:3055] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.563906 29475 raft_consensus.cc:740] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:01.564792 29475 consensus_queue.cc:260] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:01.565958 29475 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.574532 29475 raft_consensus.cc:2468] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:01.587517 29518 leader_election.cc:304] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:10:01.588548 30474 raft_consensus.cc:2804] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.589100 30474 raft_consensus.cc:697] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:01.590092 30474 consensus_queue.cc:237] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:01.613901 29225 catalog_manager.cc:5697] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 1 to 2, leader changed from a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.619820 29228 catalog_manager.cc:5697] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.623879 29403 raft_consensus.cc:2468] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:01.625754 29476 raft_consensus.cc:2468] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:01.663916 30474 raft_consensus.cc:993] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:01.664494 30474 raft_consensus.cc:1081] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:01.666426 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d828a447d3f049c58c173033d6095611"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49408
I20260709 13:10:01.667142 30267 raft_consensus.cc:493] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.667539 30267 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.677150 30267 raft_consensus.cc:515] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:01.679168 30267 leader_election.cc:290] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:01.680085 29475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:01.680174 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d828a447d3f049c58c173033d6095611" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:01.681042 29475 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.681418 29553 raft_consensus.cc:3055] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:01.681751 29553 raft_consensus.cc:740] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:01.682560 29553 consensus_queue.cc:260] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:01.683842 29553 raft_consensus.cc:3060] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.689090 29475 raft_consensus.cc:2468] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:01.690891 30139 leader_election.cc:304] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:10:01.691905 30472 raft_consensus.cc:2804] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.692386 30472 raft_consensus.cc:697] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:01.693341 30472 consensus_queue.cc:237] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:01.694128 29553 raft_consensus.cc:2468] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:01.712955 29225 catalog_manager.cc:5697] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 2 to 3, leader changed from 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.767215 30463 raft_consensus.cc:993] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:01.767870 30467 raft_consensus.cc:1081] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:01.769862 29553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:01.770432 29553 raft_consensus.cc:493] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.770750 29553 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.779292 29553 raft_consensus.cc:515] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:01.781169 29553 leader_election.cc:290] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:01.781987 29399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:01.782369 29475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:01.782723 29399 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.783198 29475 raft_consensus.cc:3055] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.783644 29475 raft_consensus.cc:740] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:01.784706 29475 consensus_queue.cc:260] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:01.786367 29475 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.789348 29399 raft_consensus.cc:2468] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:01.796190 29517 leader_election.cc:304] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:01.797093 30474 raft_consensus.cc:2804] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.797335 29475 raft_consensus.cc:2468] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:01.798233 30474 raft_consensus.cc:697] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:01.799198 30474 consensus_queue.cc:237] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:01.811430 29225 catalog_manager.cc:5697] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.904407 30451 raft_consensus.cc:993] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:01.904945 30477 raft_consensus.cc:1081] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:01.906589 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd516b0c89f946de845897e58c667be6"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49408
I20260709 13:10:01.907101 30267 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.907392 30267 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.914659 30267 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:01.917315 30267 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:01.918272 29475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:01.919020 29475 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.920991 29554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd516b0c89f946de845897e58c667be6" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:01.921645 29554 raft_consensus.cc:3055] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:01.921957 29554 raft_consensus.cc:740] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:01.922665 29554 consensus_queue.cc:260] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:01.923650 29554 raft_consensus.cc:3060] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.927294 29475 raft_consensus.cc:2468] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:01.930650 30139 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:10:01.931648 30472 raft_consensus.cc:2804] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.932016 30465 raft_consensus.cc:993] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower a5dacd0232c24e92bc64f941b7410a9d to start an election
I20260709 13:10:01.932159 30472 raft_consensus.cc:697] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:01.933285 30472 consensus_queue.cc:237] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:01.933743 30466 raft_consensus.cc:1081] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer a5dacd0232c24e92bc64f941b7410a9d to start an election
I20260709 13:10:01.937263 29403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5"
dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
 from {username='slave'} at 127.0.0.1:35402
I20260709 13:10:01.937858 29403 raft_consensus.cc:493] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.938232 29403 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.945137 29403 raft_consensus.cc:515] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:01.946864 29403 leader_election.cc:290] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:01.948043 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:01.948060 29554 raft_consensus.cc:2468] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:01.949407 29553 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.974016 29225 catalog_manager.cc:5697] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 2 to 3, leader changed from 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.980363 29476 raft_consensus.cc:1275] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.982553 30451 consensus_queue.cc:1048] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.995404 29475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:01.996135 29475 raft_consensus.cc:3055] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.996511 29475 raft_consensus.cc:740] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:01.998378 29553 raft_consensus.cc:2468] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:10:02.000590 29475 consensus_queue.cc:260] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:02.001230 29399 raft_consensus.cc:1275] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.042771 29371 leader_election.cc:304] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:02.044557 30473 raft_consensus.cc:2804] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.045809 30473 raft_consensus.cc:697] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:10:02.046684 30473 consensus_queue.cc:237] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:02.044890 30469 consensus_queue.cc:1048] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:10:02.045056 29475 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.093883 29554 raft_consensus.cc:1275] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.102006 30472 consensus_queue.cc:1048] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.104200 29403 raft_consensus.cc:1275] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.109265 30474 consensus_queue.cc:1048] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.109673 29478 raft_consensus.cc:1275] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:02.123572 29228 catalog_manager.cc:5697] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 2 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.126323 29475 raft_consensus.cc:2468] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 2.
I20260709 13:10:02.125540 30469 consensus_queue.cc:1048] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.212205 29475 raft_consensus.cc:1275] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.224805 30475 consensus_queue.cc:1048] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:02.249498 29517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:32963, user_credentials={real_user=slave}} blocked reactor thread for 114838us
I20260709 13:10:02.268760 29401 raft_consensus.cc:1275] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.274585 30520 consensus_queue.cc:1048] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:02.339762 29480 raft_consensus.cc:1275] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:02.341552 30531 consensus_queue.cc:1048] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:02.373133 29480 raft_consensus.cc:1275] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.377280 29554 raft_consensus.cc:1275] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:02.382256 30475 consensus_queue.cc:1048] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.384132 30477 consensus_queue.cc:1048] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.515898 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.528892 29480 raft_consensus.cc:1275] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.530661 30449 consensus_queue.cc:1048] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.550308 29554 raft_consensus.cc:1275] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.552086 30427 consensus_queue.cc:1048] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.601279 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.664213 29480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:02.664837 29480 raft_consensus.cc:606] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:02.667873 29480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:02.668416 29480 raft_consensus.cc:606] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:10:02.671406 29553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
mode: GRACEFUL
new_leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
 from {username='slave'} at 127.0.0.1:43808
I20260709 13:10:02.671986 29553 raft_consensus.cc:606] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Received request to transfer leadership to TS a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:10:02.677361 29403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5"
dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
mode: GRACEFUL
new_leader_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:43392
I20260709 13:10:02.677960 29403 raft_consensus.cc:606] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Received request to transfer leadership to TS 470465ef54334dbc8be5230ca16dc1a8
I20260709 13:10:02.680966 30521 raft_consensus.cc:993] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:02.681469 30467 raft_consensus.cc:1081] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:02.682960 29554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:43808
I20260709 13:10:02.683581 29554 raft_consensus.cc:606] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:02.684798 29553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:55264
I20260709 13:10:02.685402 29553 raft_consensus.cc:493] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.686728 29475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:02.687372 29475 raft_consensus.cc:606] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:02.688686 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:02.690965 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:02.685760 29553 raft_consensus.cc:3060] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.700309 30521 raft_consensus.cc:993] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:02.700901 30465 raft_consensus.cc:1081] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:02.701610 29553 raft_consensus.cc:515] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:02.703055 30282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49406
I20260709 13:10:02.703729 30282 raft_consensus.cc:493] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.704092 30282 raft_consensus.cc:3060] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.704149 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:02.704457 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b7f988005d4faeaaa356919ab5a9f3" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:02.704913 29403 raft_consensus.cc:3060] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.705025 29480 raft_consensus.cc:3055] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.705412 29480 raft_consensus.cc:740] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:02.706204 29480 consensus_queue.cc:260] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:02.707252 29480 raft_consensus.cc:3060] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.715927 29553 leader_election.cc:290] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:02.715837 29403 raft_consensus.cc:2468] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:02.717497 29517 leader_election.cc:304] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:02.718218 30521 raft_consensus.cc:993] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:02.718397 30519 raft_consensus.cc:2804] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.718837 30521 raft_consensus.cc:1081] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:02.719661 30519 raft_consensus.cc:697] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:02.720471 30519 consensus_queue.cc:237] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:02.720642 30282 raft_consensus.cc:515] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:02.723717 30272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49406
I20260709 13:10:02.724463 30282 leader_election.cc:290] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:02.715837 29480 raft_consensus.cc:2468] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 2.
I20260709 13:10:02.724372 30272 raft_consensus.cc:493] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.726217 30272 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.726430 29475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:02.727344 29475 raft_consensus.cc:3055] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.727780 29475 raft_consensus.cc:740] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:02.731722 29475 consensus_queue.cc:260] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:02.732923 29475 raft_consensus.cc:3060] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.736546 30272 raft_consensus.cc:515] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:02.738664 29225 catalog_manager.cc:5697] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 2 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.740759 30272 leader_election.cc:290] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:02.742956 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:02.743548 29480 raft_consensus.cc:3055] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.743829 29480 raft_consensus.cc:740] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:02.742254 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97afae1ea704b1da66dcdd1a25acce4" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:02.745009 29553 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.744560 29480 consensus_queue.cc:260] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:02.752313 29480 raft_consensus.cc:3060] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.754694 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "082807e3cf274d8c96c0332b98c67b3f" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:02.755323 29403 raft_consensus.cc:3060] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.762524 29480 raft_consensus.cc:2468] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:02.763594 29553 raft_consensus.cc:2468] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:02.765000 30139 leader_election.cc:304] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:10:02.765825 29403 raft_consensus.cc:2468] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:02.767961 30138 leader_election.cc:304] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:02.767953 30475 raft_consensus.cc:2804] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.769433 30530 raft_consensus.cc:2804] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.770809 29475 raft_consensus.cc:2468] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:02.769394 30475 raft_consensus.cc:697] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:02.776628 30475 consensus_queue.cc:237] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:02.773792 30530 raft_consensus.cc:697] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:02.781176 30530 consensus_queue.cc:237] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:02.803026 29228 catalog_manager.cc:5697] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 2 to 3, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.804752 29228 catalog_manager.cc:5697] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.921924 30520 raft_consensus.cc:993] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8: : Instructing follower a5dacd0232c24e92bc64f941b7410a9d to start an election
I20260709 13:10:02.922472 30520 raft_consensus.cc:1081] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Signalling peer a5dacd0232c24e92bc64f941b7410a9d to start an election
I20260709 13:10:02.924144 29403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84"
dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
 from {username='slave'} at 127.0.0.1:35414
I20260709 13:10:02.924808 29403 raft_consensus.cc:493] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.925217 29403 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.930279 29403 raft_consensus.cc:515] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:02.932022 29403 leader_election.cc:290] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:02.932708 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:02.933034 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f75a290a07449f1a429e85726f0db84" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:02.933380 29480 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.933701 29553 raft_consensus.cc:3055] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.934029 29553 raft_consensus.cc:740] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:02.934763 29553 consensus_queue.cc:260] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:02.935892 29553 raft_consensus.cc:3060] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.941349 29480 raft_consensus.cc:2468] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 3.
I20260709 13:10:02.942786 29553 raft_consensus.cc:2468] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 3.
I20260709 13:10:02.944504 29371 leader_election.cc:304] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:02.949267 30449 raft_consensus.cc:2804] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.950083 30449 raft_consensus.cc:697] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 3 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:10:02.951009 30449 consensus_queue.cc:237] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:02.961562 29225 catalog_manager.cc:5697] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 2 to 3, leader changed from 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 3 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.027375 30477 raft_consensus.cc:993] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:03.027952 30520 raft_consensus.cc:1081] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:03.029806 30272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49408
I20260709 13:10:03.030480 30272 raft_consensus.cc:493] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.030860 30272 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.039603 30272 raft_consensus.cc:515] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:03.042228 30272 leader_election.cc:290] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:03.042639 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:03.043031 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2a16c1a5674ca19b3c85e15da674df" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:03.043423 29480 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.043792 29553 raft_consensus.cc:3055] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:03.044145 29553 raft_consensus.cc:740] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:03.044876 29553 consensus_queue.cc:260] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:03.045825 29553 raft_consensus.cc:3060] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.055455 30514 raft_consensus.cc:993] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d: : Instructing follower 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:03.056071 30514 raft_consensus.cc:1081] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Signalling peer 470465ef54334dbc8be5230ca16dc1a8 to start an election
I20260709 13:10:03.059553 29480 raft_consensus.cc:2468] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:03.061663 30139 leader_election.cc:304] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:10:03.062399 29554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
 from {username='slave'} at 127.0.0.1:55268
I20260709 13:10:03.062704 30475 raft_consensus.cc:2804] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.063015 29554 raft_consensus.cc:493] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.063382 29554 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.063352 30475 raft_consensus.cc:697] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:03.064781 30475 consensus_queue.cc:237] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:03.071218 29554 raft_consensus.cc:515] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:03.074294 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:03.074960 29403 raft_consensus.cc:3055] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:03.075276 29403 raft_consensus.cc:740] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:10:03.076185 29403 consensus_queue.cc:260] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:03.077261 29403 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.081552 29554 leader_election.cc:290] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:03.082346 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc6d2066784e858af22723c6508fc5" candidate_uuid: "470465ef54334dbc8be5230ca16dc1a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:03.083051 29480 raft_consensus.cc:3060] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.085104 29225 catalog_manager.cc:5697] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 2 to 3, leader changed from 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.098160 29403 raft_consensus.cc:2468] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 3.
I20260709 13:10:03.100701 29517 leader_election.cc:304] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:03.101796 30477 raft_consensus.cc:2804] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.102340 30477 raft_consensus.cc:697] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 LEADER]: Becoming Leader. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:03.102573 29553 raft_consensus.cc:2468] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:03.103248 30477 consensus_queue.cc:237] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:03.109105 29480 raft_consensus.cc:2468] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 470465ef54334dbc8be5230ca16dc1a8 in term 3.
I20260709 13:10:03.115376 29228 catalog_manager.cc:5697] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 reported cstate change: term changed from 2 to 3, leader changed from a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2) to 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4). New cstate: current_term: 3 leader_uuid: "470465ef54334dbc8be5230ca16dc1a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.221159 29403 raft_consensus.cc:1275] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.222396 30477 consensus_queue.cc:1048] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.248697 29480 raft_consensus.cc:1275] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.250545 30520 consensus_queue.cc:1048] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.276432 29553 raft_consensus.cc:1275] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.278091 30475 consensus_queue.cc:1048] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.316120 29480 raft_consensus.cc:1275] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.317521 30541 consensus_queue.cc:1048] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.336941 29480 raft_consensus.cc:1275] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.338261 30541 consensus_queue.cc:1048] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.352360 29547 raft_consensus.cc:1275] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.354220 30449 consensus_queue.cc:1048] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.367825 29403 raft_consensus.cc:1275] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:03.369490 30475 consensus_queue.cc:1048] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.385655 29478 raft_consensus.cc:1275] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.389577 30427 consensus_queue.cc:1048] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.494136 29478 raft_consensus.cc:1275] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.496219 30557 consensus_queue.cc:1048] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.515439 29553 raft_consensus.cc:1275] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.517256 30475 consensus_queue.cc:1048] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.537842 29403 raft_consensus.cc:1275] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.540009 30519 consensus_queue.cc:1048] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:03.553237 29478 raft_consensus.cc:1275] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Refusing update from remote peer 470465ef54334dbc8be5230ca16dc1a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.570855 30564 consensus_queue.cc:1048] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.691991 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.751890 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.804809 29480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:03.805450 29480 raft_consensus.cc:606] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:03.811812 29478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53e855aeeff54a25af4276a79567436b"
dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:10:03.812532 29478 raft_consensus.cc:606] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:03.816121 29553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
mode: GRACEFUL
new_leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
 from {username='slave'} at 127.0.0.1:43808
I20260709 13:10:03.816962 29553 raft_consensus.cc:606] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Received request to transfer leadership to TS a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:10:03.820331 29401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd"
dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:43392
I20260709 13:10:03.820956 29401 raft_consensus.cc:606] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:03.823904 29553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a"
dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:43808
I20260709 13:10:03.824617 29553 raft_consensus.cc:606] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:03.825883 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:03.827091 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:03.846395 30519 raft_consensus.cc:993] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8: : Instructing follower a5dacd0232c24e92bc64f941b7410a9d to start an election
I20260709 13:10:03.846969 30477 raft_consensus.cc:1081] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Signalling peer a5dacd0232c24e92bc64f941b7410a9d to start an election
I20260709 13:10:03.848716 29401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e"
dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
 from {username='slave'} at 127.0.0.1:35414
I20260709 13:10:03.849236 29401 raft_consensus.cc:493] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.849572 29401 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.854511 29401 raft_consensus.cc:515] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:03.857292 29401 leader_election.cc:290] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:03.857462 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:03.858260 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81821b5154314716bfe0d430b08ffb5e" candidate_uuid: "a5dacd0232c24e92bc64f941b7410a9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:03.858291 29478 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.858983 29553 raft_consensus.cc:3055] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:03.859285 29553 raft_consensus.cc:740] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:03.859956 29553 consensus_queue.cc:260] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:03.860993 29553 raft_consensus.cc:3060] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.868034 29553 raft_consensus.cc:2468] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 3.
I20260709 13:10:03.869318 29371 leader_election.cc:304] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:03.870965 30558 raft_consensus.cc:2804] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.871481 30558 raft_consensus.cc:697] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 3 LEADER]: Becoming Leader. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:10:03.872380 30558 consensus_queue.cc:237] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } }
I20260709 13:10:03.873916 29478 raft_consensus.cc:2468] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5dacd0232c24e92bc64f941b7410a9d in term 3.
I20260709 13:10:03.885407 29228 catalog_manager.cc:5697] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d reported cstate change: term changed from 2 to 3, leader changed from 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4) to a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2). New cstate: current_term: 3 leader_uuid: "a5dacd0232c24e92bc64f941b7410a9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.901293 30427 raft_consensus.cc:993] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:03.901839 30558 raft_consensus.cc:1081] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:03.903441 30282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49402
I20260709 13:10:03.903930 30282 raft_consensus.cc:493] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.904246 30282 raft_consensus.cc:3060] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.909210 30282 raft_consensus.cc:515] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:03.910863 30282 leader_election.cc:290] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:10:03.911746 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:03.912353 29401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3086b5afd543099cb84670c2da84bd" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:03.912461 29553 raft_consensus.cc:3060] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.912958 29401 raft_consensus.cc:3055] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.913287 29401 raft_consensus.cc:740] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:10:03.914067 29401 consensus_queue.cc:260] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:03.915151 29401 raft_consensus.cc:3060] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.923755 29401 raft_consensus.cc:2468] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:03.925503 30138 leader_election.cc:304] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:03.926457 30475 raft_consensus.cc:2804] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.926954 30475 raft_consensus.cc:697] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:03.927870 30475 consensus_queue.cc:237] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:03.930260 29553 raft_consensus.cc:2468] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:03.931156 29547 raft_consensus.cc:1240] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Rejecting Update request from peer a5dacd0232c24e92bc64f941b7410a9d for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:03.943284 29228 catalog_manager.cc:5697] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 1 to 2, leader changed from a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.030449 30521 raft_consensus.cc:993] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:04.032976 30465 raft_consensus.cc:1081] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:04.037285 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49406
I20260709 13:10:04.037940 30267 raft_consensus.cc:493] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.038340 30267 raft_consensus.cc:3060] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.046298 30267 raft_consensus.cc:515] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:04.049770 30267 leader_election.cc:290] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Requested vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041)
I20260709 13:10:04.050675 29478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:04.051348 29478 raft_consensus.cc:3055] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:04.051666 29478 raft_consensus.cc:740] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:04.052402 29478 consensus_queue.cc:260] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:04.053510 29478 raft_consensus.cc:3060] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.063112 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a43a0adadf04f62a440ac2f485f116d" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:04.066283 29553 raft_consensus.cc:3060] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.064718 29478 raft_consensus.cc:2468] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:04.072695 30139 leader_election.cc:304] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06; no voters: 
I20260709 13:10:04.073764 30530 raft_consensus.cc:2804] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:04.074333 30530 raft_consensus.cc:697] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:04.075368 30530 consensus_queue.cc:237] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:04.078893 29553 raft_consensus.cc:2468] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:04.098302 29225 catalog_manager.cc:5697] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.141678 30521 raft_consensus.cc:993] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:04.142234 30574 raft_consensus.cc:1081] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:04.144156 30282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53e855aeeff54a25af4276a79567436b"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49406
I20260709 13:10:04.144737 30282 raft_consensus.cc:493] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.145085 30282 raft_consensus.cc:3060] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.153175 30282 raft_consensus.cc:515] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:04.155637 30282 leader_election.cc:290] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Requested vote from peers a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963), 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103)
I20260709 13:10:04.155658 29399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:04.156629 29399 raft_consensus.cc:3060] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.155938 29480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e855aeeff54a25af4276a79567436b" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81cf9a977cb447069d98dedbda0e4f06"
I20260709 13:10:04.160956 29480 raft_consensus.cc:3055] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:04.161315 29480 raft_consensus.cc:740] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81cf9a977cb447069d98dedbda0e4f06, State: Running, Role: LEADER
I20260709 13:10:04.162115 29480 consensus_queue.cc:260] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:04.163364 29480 raft_consensus.cc:3060] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.173418 29399 raft_consensus.cc:2468] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:04.174633 30138 leader_election.cc:304] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:04.173418 29480 raft_consensus.cc:2468] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 2.
I20260709 13:10:04.175599 30530 raft_consensus.cc:2804] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:04.176093 30530 raft_consensus.cc:697] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:04.177312 30530 consensus_queue.cc:237] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:04.188293 29225 catalog_manager.cc:5697] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 1 to 2, leader changed from 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 2 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.195765 30519 raft_consensus.cc:993] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:04.196274 30477 raft_consensus.cc:1081] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:04.198714 30282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49408
I20260709 13:10:04.199324 30282 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.199680 30282 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.209195 30282 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:04.212285 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:04.212669 29399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f0a5f595ee48d48b1bdf8c5f330f0a" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:04.213346 29399 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.212953 29553 raft_consensus.cc:3055] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:04.217576 29553 raft_consensus.cc:740] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 470465ef54334dbc8be5230ca16dc1a8, State: Running, Role: LEADER
I20260709 13:10:04.219620 29553 consensus_queue.cc:260] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:04.220827 29553 raft_consensus.cc:3060] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.223604 29399 raft_consensus.cc:2468] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:04.224879 30138 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d; no voters: 
I20260709 13:10:04.225843 30530 raft_consensus.cc:2804] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:04.227094 30530 raft_consensus.cc:697] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:04.228044 30530 consensus_queue.cc:237] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:04.231500 30282 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:10:04.236445 29553 raft_consensus.cc:2468] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:04.255757 29225 catalog_manager.cc:5697] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 2 to 3, leader changed from 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.274165 29480 raft_consensus.cc:1275] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:04.276139 30449 consensus_queue.cc:1048] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.328795 29399 raft_consensus.cc:1275] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.331588 29553 raft_consensus.cc:1275] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer a5dacd0232c24e92bc64f941b7410a9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:04.334239 30427 consensus_queue.cc:1048] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.336076 30530 consensus_queue.cc:1048] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.472819 29547 raft_consensus.cc:1275] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.475358 30541 consensus_queue.cc:1048] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.544224 29547 raft_consensus.cc:1275] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.545535 30530 consensus_queue.cc:1048] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.564386 29475 raft_consensus.cc:1275] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.575232 30475 consensus_queue.cc:1048] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.609408 29475 raft_consensus.cc:1275] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.611109 30475 consensus_queue.cc:1048] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.619194 29401 raft_consensus.cc:1275] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.621007 30475 consensus_queue.cc:1048] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.634457 29547 raft_consensus.cc:1275] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:04.643973 30475 consensus_queue.cc:1048] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.674825 29403 raft_consensus.cc:1275] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:04.684800 30475 consensus_queue.cc:1048] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.881291 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:04.882294 29370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:37103, user_credentials={real_user=slave}} blocked reactor thread for 130201us
I20260709 13:10:05.015130 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:05.056471 29403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3"
dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
mode: GRACEFUL
new_leader_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:43392
I20260709 13:10:05.057104 29403 raft_consensus.cc:606] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Received request to transfer leadership to TS 23e24e0c40f44bc79274c2081c9fc002
I20260709 13:10:05.058297 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:05.059514 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:05.492280 30597 raft_consensus.cc:993] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d: : Instructing follower 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:05.492908 30558 raft_consensus.cc:1081] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Signalling peer 23e24e0c40f44bc79274c2081c9fc002 to start an election
I20260709 13:10:05.494364 30272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3"
dest_uuid: "23e24e0c40f44bc79274c2081c9fc002"
 from {username='slave'} at 127.0.0.1:49402
I20260709 13:10:05.495021 30272 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.495327 30272 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.501986 30272 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:05.504657 29553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "470465ef54334dbc8be5230ca16dc1a8"
I20260709 13:10:05.504886 30272 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Requested vote from peers 470465ef54334dbc8be5230ca16dc1a8 (127.20.69.4:40041), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:10:05.505245 29553 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.506723 29403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189ffad2edf44a8da1f0fb3c5cb386c3" candidate_uuid: "23e24e0c40f44bc79274c2081c9fc002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5dacd0232c24e92bc64f941b7410a9d"
I20260709 13:10:05.507566 29403 raft_consensus.cc:3055] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:05.507920 29403 raft_consensus.cc:740] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a5dacd0232c24e92bc64f941b7410a9d, State: Running, Role: LEADER
I20260709 13:10:05.508831 29403 consensus_queue.cc:260] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:05.512101 29403 raft_consensus.cc:3060] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.515583 29553 raft_consensus.cc:2468] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:05.517093 30140 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e24e0c40f44bc79274c2081c9fc002, 470465ef54334dbc8be5230ca16dc1a8; no voters: 
I20260709 13:10:05.518296 30475 raft_consensus.cc:2804] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:05.519550 30475 raft_consensus.cc:697] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Becoming Leader. State: Replica: 23e24e0c40f44bc79274c2081c9fc002, State: Running, Role: LEADER
I20260709 13:10:05.530865 29403 raft_consensus.cc:2468] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e24e0c40f44bc79274c2081c9fc002 in term 3.
I20260709 13:10:05.522018 30475 consensus_queue.cc:237] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:05.572582 29229 catalog_manager.cc:5697] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 reported cstate change: term changed from 2 to 3, leader changed from a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2) to 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1). New cstate: current_term: 3 leader_uuid: "23e24e0c40f44bc79274c2081c9fc002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.060500 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.071161 29547 raft_consensus.cc:1275] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:06.074587 30475 consensus_queue.cc:1048] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:06.119424 20756 tablet_server.cc:179] TabletServer@127.20.69.1:40325 shutting down...
I20260709 13:10:06.121186 29401 raft_consensus.cc:1275] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Refusing update from remote peer 23e24e0c40f44bc79274c2081c9fc002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:10:06.121611 29517 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 268 similar messages]
I20260709 13:10:06.124970 30530 consensus_queue.cc:1048] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:10:06.130769 29517 consensus_peers.cc:597] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.164757 29443 consensus_peers.cc:597] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.182216 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.183360 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.184492 20756 raft_consensus.cc:2243] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.185197 20756 raft_consensus.cc:2272] T e4ae44c83a2a422eb794cba0bfb917e1 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.186141 29443 consensus_peers.cc:597] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.188098 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.189003 20756 raft_consensus.cc:2243] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.190032 20756 raft_consensus.cc:2272] T d828a447d3f049c58c173033d6095611 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.193274 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.194311 20756 raft_consensus.cc:2243] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.194950 20756 raft_consensus.cc:2272] T f1c831fc495543c8beff6a28e80c0aa0 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.198336 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.199342 20756 raft_consensus.cc:2243] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.199968 20756 raft_consensus.cc:2272] T 5216cf90df5f43a090fc0d60c20f0e23 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.202979 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.203619 20756 raft_consensus.cc:2243] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.204064 20756 raft_consensus.cc:2272] T 1aa47941789a4465bfdfbd693ad766ba P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.206245 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.206820 20756 raft_consensus.cc:2243] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.207569 20756 raft_consensus.cc:2272] T 1a43a0adadf04f62a440ac2f485f116d P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.209733 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.210297 20756 raft_consensus.cc:2243] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.210707 20756 raft_consensus.cc:2272] T d7de023ca3234343a50acdd1f0fddb6b P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.212723 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.213291 20756 raft_consensus.cc:2243] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.213711 20756 raft_consensus.cc:2272] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.215777 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.216317 20756 raft_consensus.cc:2243] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.217116 20756 raft_consensus.cc:2272] T f97afae1ea704b1da66dcdd1a25acce4 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.219321 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.220009 20756 raft_consensus.cc:2243] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.220438 20756 raft_consensus.cc:2272] T 1940d3c343814440a73d53c937f06f56 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.222826 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.223408 20756 raft_consensus.cc:2243] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.224303 20756 raft_consensus.cc:2272] T bd7d4ae59b2148a9ba089ad2475cddbe P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.226837 20756 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:06.227430 29517 consensus_peers.cc:597] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.227653 20756 raft_consensus.cc:2243] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.228331 20756 raft_consensus.cc:2272] T 94f844d53679454696bf4c09f6eaa88a P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.230943 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.231578 20756 raft_consensus.cc:2243] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.231980 20756 raft_consensus.cc:2272] T 3e0651fb124d44bf80d91e28c36d58d3 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.237020 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.237881 20756 raft_consensus.cc:2243] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.238456 20756 raft_consensus.cc:2272] T ce1d7834cd644ccdb86354a7aca74628 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.242151 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.243076 20756 raft_consensus.cc:2243] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.243714 20756 raft_consensus.cc:2272] T 895df96ea5c54121bb29dba7f08193a0 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.246893 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.247761 20756 raft_consensus.cc:2243] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.248359 20756 raft_consensus.cc:2272] T a150eab0c5544ffdb1289b03eb527a5b P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.251621 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.252441 20756 raft_consensus.cc:2243] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.252974 20756 raft_consensus.cc:2272] T 980b900980f24f1d8afef6fda8d06023 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.253376 29443 consensus_peers.cc:597] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.255378 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.256234 20756 raft_consensus.cc:2243] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.256841 20756 raft_consensus.cc:2272] T 9e018f136fea466ab0d7ed7aa4592f06 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.260705 20756 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:06.260808 29517 consensus_peers.cc:597] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.261523 20756 raft_consensus.cc:2243] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.262377 20756 raft_consensus.cc:2272] T 2ee25eabd993465aafd680f5ab69e5ce P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.264621 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.265348 20756 raft_consensus.cc:2243] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.266141 20756 raft_consensus.cc:2272] T 8d3086b5afd543099cb84670c2da84bd P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.268388 20756 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:06.269016 29443 consensus_peers.cc:597] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.269302 20756 raft_consensus.cc:2243] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.269939 20756 raft_consensus.cc:2272] T 0df9a8d24a9d4474be608101a853cacb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.272574 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.273389 20756 raft_consensus.cc:2243] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.273849 20756 raft_consensus.cc:2272] T 5bf1de53534642b28b9b16f82438c57c P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.276324 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.276927 20756 raft_consensus.cc:2243] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.277319 20756 raft_consensus.cc:2272] T 129c6dc7c28b457b872000878f181772 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.279345 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.280073 20756 raft_consensus.cc:2243] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.280565 20756 raft_consensus.cc:2272] T 6f7e7b55465b4831a7f942c64dc80ef7 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.283182 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.283924 20756 raft_consensus.cc:2243] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.284443 20756 raft_consensus.cc:2272] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.286989 29517 consensus_peers.cc:597] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.287026 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.287883 20756 raft_consensus.cc:2243] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.288355 20756 raft_consensus.cc:2272] T 9ce1e737440642bcabdd71181160d267 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.290477 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.291044 20756 raft_consensus.cc:2243] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.291493 20756 raft_consensus.cc:2272] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.293546 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.294106 20756 raft_consensus.cc:2243] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.294519 20756 raft_consensus.cc:2272] T bdf053ddbc384257a33de229f027366e P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.296428 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.297013 20756 raft_consensus.cc:2243] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.297498 20756 raft_consensus.cc:2272] T 4c38085886474ddd9d257bc1c526903f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.300272 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.300853 20756 raft_consensus.cc:2243] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.301730 20756 raft_consensus.cc:2272] T 53e855aeeff54a25af4276a79567436b P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.304047 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.304656 20756 raft_consensus.cc:2243] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.305379 20756 raft_consensus.cc:2272] T 082807e3cf274d8c96c0332b98c67b3f P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.307296 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.307832 20756 raft_consensus.cc:2243] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.308202 20756 raft_consensus.cc:2272] T 19f5075a32114023bc747cfd4d99a934 P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.310431 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.311058 20756 raft_consensus.cc:2243] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.311506 20756 raft_consensus.cc:2272] T 3c6a22b4c6b24ef8b19f1a79234febac P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.314136 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.314842 20756 raft_consensus.cc:2243] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.315346 20756 raft_consensus.cc:2272] T 51388e1eccfc4e28afe0b67f552695c6 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.317296 29443 consensus_peers.cc:597] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.317927 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.318755 20756 raft_consensus.cc:2243] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.319840 20756 raft_consensus.cc:2272] T 078e833dff54448e9a5a55e83660ff35 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.322700 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.323397 20756 raft_consensus.cc:2243] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.323871 20756 raft_consensus.cc:2272] T 694e86fc16f64d159c1132b17d8ef34b P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.326932 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.327674 20756 raft_consensus.cc:2243] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.328231 20756 raft_consensus.cc:2272] T b4514facbaa1474a8481ce0b8849abeb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.331137 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.331837 20756 raft_consensus.cc:2243] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.332319 20756 raft_consensus.cc:2272] T 45d78702effa4fe58b63767c5805a8af P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.334636 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.335191 20756 raft_consensus.cc:2243] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.335852 20756 raft_consensus.cc:2272] T ed2a16c1a5674ca19b3c85e15da674df P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.337767 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.338335 20756 raft_consensus.cc:2243] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.339226 20756 raft_consensus.cc:2272] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.341548 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.342168 20756 raft_consensus.cc:2243] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.342947 20756 raft_consensus.cc:2272] T ec95604cb33f41a39ea52005380127cb P 23e24e0c40f44bc79274c2081c9fc002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.345000 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.345587 20756 raft_consensus.cc:2243] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.346311 20756 raft_consensus.cc:2272] T dd516b0c89f946de845897e58c667be6 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.348214 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.348758 20756 raft_consensus.cc:2243] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.349123 20756 raft_consensus.cc:2272] T f3460ebfc0d344b5b7ede68f74c3983a P 23e24e0c40f44bc79274c2081c9fc002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.351287 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:06.351949 20756 raft_consensus.cc:2243] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.353009 20756 raft_consensus.cc:2272] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.358175 20756 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:06.358826 29443 consensus_peers.cc:597] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.359314 20756 raft_consensus.cc:2243] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.360352 20756 raft_consensus.cc:2272] T 3b146e77806e403d90813507378d6bea P 23e24e0c40f44bc79274c2081c9fc002 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.367748 29517 consensus_peers.cc:597] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.369444 29369 consensus_peers.cc:597] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.414448 29369 consensus_peers.cc:597] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.427054 29369 consensus_peers.cc:597] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.431150 29369 consensus_peers.cc:597] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.447032 29369 connection.cc:769] client connection to 127.20.69.1:40325 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:10:06.447865 29369 consensus_peers.cc:597] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.452281 20756 tablet_server.cc:196] TabletServer@127.20.69.1:40325 shutdown complete.
W20260709 13:10:06.456202 29369 consensus_peers.cc:597] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.469412 29369 consensus_peers.cc:597] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.473433 29369 consensus_peers.cc:597] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.481904 29517 consensus_peers.cc:597] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.482452 29443 consensus_peers.cc:597] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.493382 29443 consensus_peers.cc:597] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.507735 29517 consensus_peers.cc:597] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.553699 20756 tablet_server.cc:179] TabletServer@127.20.69.2:0 shutting down...
W20260709 13:10:06.558640 29517 consensus_peers.cc:597] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.562384 29369 consensus_peers.cc:597] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.566550 29443 consensus_peers.cc:597] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.605134 29443 consensus_peers.cc:597] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.605331 29517 consensus_peers.cc:597] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.605911 29443 consensus_peers.cc:597] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.613507 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.614391 20756 tablet_replica.cc:333] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.615043 20756 raft_consensus.cc:2243] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.615509 20756 raft_consensus.cc:2272] T e043911685cb4c5889c1ea44573a0f80 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.617854 20756 tablet_replica.cc:333] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.618535 20756 raft_consensus.cc:2243] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.619386 20756 raft_consensus.cc:2272] T d7de023ca3234343a50acdd1f0fddb6b P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.621702 20756 tablet_replica.cc:333] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.622486 20756 raft_consensus.cc:2243] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.623449 20756 raft_consensus.cc:2272] T 980b900980f24f1d8afef6fda8d06023 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.625470 29369 consensus_peers.cc:597] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.626070 20756 tablet_replica.cc:333] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.626767 20756 raft_consensus.cc:2243] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.627588 20756 raft_consensus.cc:2272] T 94f844d53679454696bf4c09f6eaa88a P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.629876 20756 tablet_replica.cc:333] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.630740 20756 raft_consensus.cc:2243] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.631675 20756 raft_consensus.cc:2272] T 5bf1de53534642b28b9b16f82438c57c P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.633659 29369 consensus_peers.cc:597] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.634163 20756 tablet_replica.cc:333] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.634850 20756 raft_consensus.cc:2243] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.635339 20756 raft_consensus.cc:2272] T 129c6dc7c28b457b872000878f181772 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.637373 20756 tablet_replica.cc:333] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.637948 20756 raft_consensus.cc:2243] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.638372 20756 raft_consensus.cc:2272] T bdf053ddbc384257a33de229f027366e P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.640338 20756 tablet_replica.cc:333] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.641150 20756 raft_consensus.cc:2243] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.641705 20756 raft_consensus.cc:2272] T c04c7be6ae194d58a25d56e4c5628b4a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.644397 20756 tablet_replica.cc:333] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.645305 20756 raft_consensus.cc:2243] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.646306 20756 raft_consensus.cc:2272] T 81821b5154314716bfe0d430b08ffb5e P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.646709 29517 consensus_peers.cc:597] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.647377 29517 consensus_peers.cc:597] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.648540 20756 tablet_replica.cc:333] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.649266 20756 raft_consensus.cc:2243] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.649701 20756 raft_consensus.cc:2272] T ec95604cb33f41a39ea52005380127cb P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.651787 20756 tablet_replica.cc:333] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.652424 20756 raft_consensus.cc:2243] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.653249 20756 raft_consensus.cc:2272] T 60b29284ee8e4bb2b1b7c2f7c9319103 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.655659 20756 tablet_replica.cc:333] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.656255 20756 raft_consensus.cc:2243] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.657307 20756 raft_consensus.cc:2272] T 6f7e7b55465b4831a7f942c64dc80ef7 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.660154 20756 tablet_replica.cc:333] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
W20260709 13:10:06.660836 29443 consensus_peers.cc:597] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.661011 20756 raft_consensus.cc:2243] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.661680 20756 raft_consensus.cc:2272] T 20b7f988005d4faeaaa356919ab5a9f3 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.663836 20756 tablet_replica.cc:333] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.664428 20756 raft_consensus.cc:2243] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.664891 20756 raft_consensus.cc:2272] T 1aa47941789a4465bfdfbd693ad766ba P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.667095 20756 tablet_replica.cc:333] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.667713 20756 raft_consensus.cc:2243] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.668495 20756 raft_consensus.cc:2272] T 5216cf90df5f43a090fc0d60c20f0e23 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.669489 29517 consensus_peers.cc:597] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.670801 20756 tablet_replica.cc:333] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.671486 20756 raft_consensus.cc:2243] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.671916 20756 raft_consensus.cc:2272] T d607df4f38c04c9190803085b2b1b842 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.674273 20756 tablet_replica.cc:333] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.674934 20756 raft_consensus.cc:2243] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.675880 20756 raft_consensus.cc:2272] T ce1d7834cd644ccdb86354a7aca74628 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.678084 20756 tablet_replica.cc:333] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.678654 20756 raft_consensus.cc:2243] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.679414 20756 raft_consensus.cc:2272] T 3e0651fb124d44bf80d91e28c36d58d3 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.681401 20756 tablet_replica.cc:333] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.681901 20756 raft_consensus.cc:2243] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.682308 20756 raft_consensus.cc:2272] T 787fe78a1da34fb38a66dc8e8e4a416d P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.684263 20756 tablet_replica.cc:333] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.684773 20756 raft_consensus.cc:2243] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.685494 20756 raft_consensus.cc:2272] T 7f75a290a07449f1a429e85726f0db84 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.687516 20756 tablet_replica.cc:333] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.688036 20756 raft_consensus.cc:2243] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.688503 20756 raft_consensus.cc:2272] T 082807e3cf274d8c96c0332b98c67b3f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.691203 20756 tablet_replica.cc:333] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.691958 20756 raft_consensus.cc:2243] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.692543 20756 raft_consensus.cc:2272] T 4c38085886474ddd9d257bc1c526903f P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.695441 20756 tablet_replica.cc:333] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
W20260709 13:10:06.695817 29443 consensus_peers.cc:597] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 -> Peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Couldn't send request to peer 23e24e0c40f44bc79274c2081c9fc002. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.696065 20756 raft_consensus.cc:2243] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.696719 20756 raft_consensus.cc:2272] T 53e855aeeff54a25af4276a79567436b P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.698590 20756 tablet_replica.cc:333] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.699172 20756 raft_consensus.cc:2243] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.699615 20756 raft_consensus.cc:2272] T b3fc6d2066784e858af22723c6508fc5 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.701597 20756 tablet_replica.cc:333] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.702215 20756 raft_consensus.cc:2243] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.702677 20756 raft_consensus.cc:2272] T 19f5075a32114023bc747cfd4d99a934 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.704784 20756 tablet_replica.cc:333] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.705473 20756 raft_consensus.cc:2243] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.705948 20756 raft_consensus.cc:2272] T eb067576b44a4b3fa9852a63cc5f17ec P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.708798 20756 tablet_replica.cc:333] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.709614 20756 raft_consensus.cc:2243] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:06.710309 29443 consensus_peers.cc:597] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.710659 20756 raft_consensus.cc:2272] T 3c6a22b4c6b24ef8b19f1a79234febac P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.713583 20756 tablet_replica.cc:333] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.714395 20756 raft_consensus.cc:2243] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.714917 20756 raft_consensus.cc:2272] T 9e018f136fea466ab0d7ed7aa4592f06 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.717159 20756 tablet_replica.cc:333] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.717860 20756 raft_consensus.cc:2243] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.718950 20756 raft_consensus.cc:2272] T b4514facbaa1474a8481ce0b8849abeb P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.721328 20756 tablet_replica.cc:333] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.721956 20756 raft_consensus.cc:2243] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.722471 20756 raft_consensus.cc:2272] T 694e86fc16f64d159c1132b17d8ef34b P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.724742 20756 tablet_replica.cc:333] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.725337 20756 raft_consensus.cc:2243] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.725812 20756 raft_consensus.cc:2272] T f3460ebfc0d344b5b7ede68f74c3983a P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.728222 20756 tablet_replica.cc:333] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.728998 20756 raft_consensus.cc:2243] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.729955 20756 raft_consensus.cc:2272] T 3b146e77806e403d90813507378d6bea P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.732079 20756 tablet_replica.cc:333] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.732720 20756 raft_consensus.cc:2243] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.733223 20756 raft_consensus.cc:2272] T 189ffad2edf44a8da1f0fb3c5cb386c3 P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.737380 20756 tablet_replica.cc:333] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
W20260709 13:10:06.737668 29443 consensus_peers.cc:597] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.738093 20756 raft_consensus.cc:2243] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.738703 20756 raft_consensus.cc:2272] T 2ee25eabd993465aafd680f5ab69e5ce P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.741058 20756 tablet_replica.cc:333] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.741669 20756 raft_consensus.cc:2243] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.742118 20756 raft_consensus.cc:2272] T 8d3086b5afd543099cb84670c2da84bd P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.744323 20756 tablet_replica.cc:333] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.745023 20756 raft_consensus.cc:2243] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.745509 20756 raft_consensus.cc:2272] T a7f0a5f595ee48d48b1bdf8c5f330f0a P a5dacd0232c24e92bc64f941b7410a9d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.747570 20756 tablet_replica.cc:333] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.748160 20756 raft_consensus.cc:2243] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.748683 20756 raft_consensus.cc:2272] T f97fa8cf984a4161b829432f9ecf4264 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.750690 20756 tablet_replica.cc:333] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.751279 20756 raft_consensus.cc:2243] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.752099 20756 raft_consensus.cc:2272] T e65b26d5bb9645bfaa8468e215b4b65d P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.754369 20756 tablet_replica.cc:333] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.754920 20756 raft_consensus.cc:2243] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.755481 20756 raft_consensus.cc:2272] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.757697 20756 tablet_replica.cc:333] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.758260 20756 raft_consensus.cc:2243] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.758837 20756 raft_consensus.cc:2272] T 45d78702effa4fe58b63767c5805a8af P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.761270 20756 tablet_replica.cc:333] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.762181 20756 raft_consensus.cc:2243] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.762753 20756 raft_consensus.cc:2272] T a1ae9afbd8b84370bae083fab7970e20 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.764660 29443 consensus_peers.cc:597] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.765506 20756 tablet_replica.cc:333] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.766274 20756 raft_consensus.cc:2243] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.766680 20756 raft_consensus.cc:2272] T bd7d4ae59b2148a9ba089ad2475cddbe P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.769300 20756 tablet_replica.cc:333] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.770082 20756 raft_consensus.cc:2243] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.770612 20756 raft_consensus.cc:2272] T 806a266f2f6a474293cb069696090159 P a5dacd0232c24e92bc64f941b7410a9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.773463 20756 tablet_replica.cc:333] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d: stopping tablet replica
I20260709 13:10:06.774122 20756 raft_consensus.cc:2243] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.774700 20756 raft_consensus.cc:2272] T f1c831fc495543c8beff6a28e80c0aa0 P a5dacd0232c24e92bc64f941b7410a9d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:06.795951 29517 consensus_peers.cc:597] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.856400 29517 consensus_peers.cc:597] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.914882 29517 consensus_peers.cc:597] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.927380 29517 consensus_peers.cc:597] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.937961 29517 consensus_peers.cc:597] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.938676 29517 consensus_peers.cc:597] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.939882 29443 consensus_peers.cc:597] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.955456 29517 consensus_peers.cc:597] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.967713 29443 consensus_peers.cc:597] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.969967 29517 consensus_peers.cc:597] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:06.972440 29443 consensus_peers.cc:597] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.006003 20756 tablet_server.cc:196] TabletServer@127.20.69.2:0 shutdown complete.
W20260709 13:10:07.037500 29517 consensus_peers.cc:597] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Couldn't send request to peer a5dacd0232c24e92bc64f941b7410a9d. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:32963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.138808 20756 tablet_server.cc:179] TabletServer@127.20.69.3:0 shutting down...
W20260709 13:10:07.178030 29518 consensus_peers.cc:597] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.185613 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:07.186741 20756 tablet_replica.cc:333] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.187809 20756 raft_consensus.cc:2243] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.189262 20756 raft_consensus.cc:2272] T f3460ebfc0d344b5b7ede68f74c3983a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.191533 20756 tablet_replica.cc:333] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.192147 20756 raft_consensus.cc:2243] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.192567 20756 raft_consensus.cc:2272] T e043911685cb4c5889c1ea44573a0f80 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.194866 20756 tablet_replica.cc:333] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.195446 20756 raft_consensus.cc:2243] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.195871 20756 raft_consensus.cc:2272] T d7de023ca3234343a50acdd1f0fddb6b P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.197975 20756 tablet_replica.cc:333] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.198460 20756 raft_consensus.cc:2243] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.198824 20756 raft_consensus.cc:2272] T e4ae44c83a2a422eb794cba0bfb917e1 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.201367 20756 tablet_replica.cc:333] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.202306 20756 raft_consensus.cc:2243] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.203502 20756 raft_consensus.cc:2272] T c04c7be6ae194d58a25d56e4c5628b4a P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.207096 20756 tablet_replica.cc:333] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
W20260709 13:10:07.207006 29518 consensus_peers.cc:597] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.208135 20756 raft_consensus.cc:2243] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.208711 20756 raft_consensus.cc:2272] T 078e833dff54448e9a5a55e83660ff35 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.211306 20756 tablet_replica.cc:333] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.212323 20756 raft_consensus.cc:2243] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.213724 20756 raft_consensus.cc:2272] T 51388e1eccfc4e28afe0b67f552695c6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.216554 20756 tablet_replica.cc:333] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.217244 20756 raft_consensus.cc:2243] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.217835 20756 raft_consensus.cc:2272] T 81821b5154314716bfe0d430b08ffb5e P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.220415 20756 tablet_replica.cc:333] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.221064 20756 raft_consensus.cc:2243] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.221611 20756 raft_consensus.cc:2272] T b3fc6d2066784e858af22723c6508fc5 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.224360 20756 tablet_replica.cc:333] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.225039 20756 raft_consensus.cc:2243] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.225716 20756 raft_consensus.cc:2272] T ec95604cb33f41a39ea52005380127cb P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.228116 20756 tablet_replica.cc:333] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.228796 20756 raft_consensus.cc:2243] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.229321 20756 raft_consensus.cc:2272] T dd516b0c89f946de845897e58c667be6 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.231586 20756 tablet_replica.cc:333] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.232116 20756 raft_consensus.cc:2243] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.233085 20756 raft_consensus.cc:2272] T d607df4f38c04c9190803085b2b1b842 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.235292 20756 tablet_replica.cc:333] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.235904 20756 raft_consensus.cc:2243] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.236397 20756 raft_consensus.cc:2272] T ce1d7834cd644ccdb86354a7aca74628 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.238619 20756 tablet_replica.cc:333] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.239223 20756 raft_consensus.cc:2243] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.239812 20756 raft_consensus.cc:2272] T 3e0651fb124d44bf80d91e28c36d58d3 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.242162 20756 tablet_replica.cc:333] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.242818 20756 raft_consensus.cc:2243] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.243703 20756 raft_consensus.cc:2272] T 787fe78a1da34fb38a66dc8e8e4a416d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.246037 20756 tablet_replica.cc:333] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.246618 20756 raft_consensus.cc:2243] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.247162 20756 raft_consensus.cc:2272] T 7f75a290a07449f1a429e85726f0db84 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.249322 20756 tablet_replica.cc:333] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.250203 20756 raft_consensus.cc:2243] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.251149 20756 raft_consensus.cc:2272] T 9ce1e737440642bcabdd71181160d267 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.253598 20756 tablet_replica.cc:333] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.254119 20756 raft_consensus.cc:2243] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.254619 20756 raft_consensus.cc:2272] T 60b29284ee8e4bb2b1b7c2f7c9319103 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.256811 20756 tablet_replica.cc:333] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.257336 20756 raft_consensus.cc:2243] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.257786 20756 raft_consensus.cc:2272] T 6f7e7b55465b4831a7f942c64dc80ef7 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.259778 20756 tablet_replica.cc:333] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.260257 20756 raft_consensus.cc:2243] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.261207 20756 raft_consensus.cc:2272] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.264137 20756 tablet_replica.cc:333] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.265075 20756 raft_consensus.cc:2243] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.266428 20756 raft_consensus.cc:2272] T eb067576b44a4b3fa9852a63cc5f17ec P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.269598 20756 tablet_replica.cc:333] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.270167 20756 raft_consensus.cc:2243] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.270804 20756 raft_consensus.cc:2272] T 3c6a22b4c6b24ef8b19f1a79234febac P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.272161 29518 consensus_peers.cc:597] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.273337 20756 tablet_replica.cc:333] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.274014 20756 raft_consensus.cc:2243] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.274926 20756 raft_consensus.cc:2272] T a150eab0c5544ffdb1289b03eb527a5b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.277530 20756 tablet_replica.cc:333] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.278116 20756 raft_consensus.cc:2243] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.278687 20756 raft_consensus.cc:2272] T 980b900980f24f1d8afef6fda8d06023 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.279088 29518 consensus_peers.cc:597] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.280833 20756 tablet_replica.cc:333] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.281472 20756 raft_consensus.cc:2243] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.281934 20756 raft_consensus.cc:2272] T 895df96ea5c54121bb29dba7f08193a0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.284150 20756 tablet_replica.cc:333] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.284838 20756 raft_consensus.cc:2243] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.285725 20756 raft_consensus.cc:2272] T 1940d3c343814440a73d53c937f06f56 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.288432 20756 tablet_replica.cc:333] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.289093 20756 raft_consensus.cc:2243] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.289746 20756 raft_consensus.cc:2272] T d828a447d3f049c58c173033d6095611 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.292881 20756 tablet_replica.cc:333] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.293645 20756 raft_consensus.cc:2243] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.294785 20756 raft_consensus.cc:2272] T 806a266f2f6a474293cb069696090159 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.297848 20756 tablet_replica.cc:333] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.298610 20756 raft_consensus.cc:2243] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.299778 20756 raft_consensus.cc:2272] T f1c831fc495543c8beff6a28e80c0aa0 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.302695 20756 tablet_replica.cc:333] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.303236 20756 raft_consensus.cc:2243] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.303766 20756 raft_consensus.cc:2272] T 0df9a8d24a9d4474be608101a853cacb P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.305979 20756 tablet_replica.cc:333] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.306562 20756 raft_consensus.cc:2243] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.307011 20756 raft_consensus.cc:2272] T 20b7f988005d4faeaaa356919ab5a9f3 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.308900 20756 tablet_replica.cc:333] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.309435 20756 raft_consensus.cc:2243] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.310283 20756 raft_consensus.cc:2272] T 1aa47941789a4465bfdfbd693ad766ba P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.312249 20756 tablet_replica.cc:333] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.312834 20756 raft_consensus.cc:2243] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.313354 20756 raft_consensus.cc:2272] T 1a43a0adadf04f62a440ac2f485f116d P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.315330 20756 tablet_replica.cc:333] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.315815 20756 raft_consensus.cc:2243] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.316706 20756 raft_consensus.cc:2272] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.317310 30600 raft_consensus.cc:493] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:10:07.318040 30600 raft_consensus.cc:515] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } } peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } }
I20260709 13:10:07.319687 20756 tablet_replica.cc:333] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.320571 20756 raft_consensus.cc:2243] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.320788 30600 leader_election.cc:290] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:10:07.321826 20756 raft_consensus.cc:2272] T 45d78702effa4fe58b63767c5805a8af P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.324895 20756 tablet_replica.cc:333] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.325631 20756 raft_consensus.cc:2243] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.326278 20756 raft_consensus.cc:2272] T a1ae9afbd8b84370bae083fab7970e20 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.326725 29443 leader_election.cc:336] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:10:07.328989 29443 leader_election.cc:336] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Network error: Client connection negotiation failed: client connection to 127.20.69.2:32963: connect: Connection refused (error 111)
I20260709 13:10:07.329061 20756 tablet_replica.cc:333] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.329433 29443 leader_election.cc:304] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81cf9a977cb447069d98dedbda0e4f06; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:10:07.329995 20756 raft_consensus.cc:2243] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.330192 30600 raft_consensus.cc:2749] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:07.330856 20756 raft_consensus.cc:2272] T ed2a16c1a5674ca19b3c85e15da674df P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.333585 20756 tablet_replica.cc:333] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.334139 20756 raft_consensus.cc:2243] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.334702 20756 raft_consensus.cc:2272] T 082807e3cf274d8c96c0332b98c67b3f P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.336978 20756 tablet_replica.cc:333] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.337556 20756 raft_consensus.cc:2243] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.338155 20756 raft_consensus.cc:2272] T 53e855aeeff54a25af4276a79567436b P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.340543 20756 tablet_replica.cc:333] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.341285 20756 raft_consensus.cc:2243] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.341821 20756 raft_consensus.cc:2272] T bd7d4ae59b2148a9ba089ad2475cddbe P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.341826 29518 consensus_peers.cc:597] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.344026 20756 tablet_replica.cc:333] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.344668 20756 raft_consensus.cc:2243] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.345196 20756 raft_consensus.cc:2272] T f97fa8cf984a4161b829432f9ecf4264 P 81cf9a977cb447069d98dedbda0e4f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.347229 20756 tablet_replica.cc:333] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.347733 20756 raft_consensus.cc:2243] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.348224 20756 raft_consensus.cc:2272] T f97afae1ea704b1da66dcdd1a25acce4 P 81cf9a977cb447069d98dedbda0e4f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.350333 20756 tablet_replica.cc:333] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.351024 20756 raft_consensus.cc:2243] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.351742 20756 raft_consensus.cc:2272] T e65b26d5bb9645bfaa8468e215b4b65d P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.354995 20756 tablet_replica.cc:333] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06: stopping tablet replica
I20260709 13:10:07.355676 20756 raft_consensus.cc:2243] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.356308 20756 raft_consensus.cc:2272] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 81cf9a977cb447069d98dedbda0e4f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.356992 30621 raft_consensus.cc:493] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:10:07.357671 30621 raft_consensus.cc:515] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:07.360008 30621 leader_election.cc:290] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:10:07.363255 29518 leader_election.cc:336] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:10:07.365790 29517 leader_election.cc:336] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:10:07.366266 29517 leader_election.cc:304] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:10:07.367097 30621 raft_consensus.cc:2749] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:07.421181 30621 raft_consensus.cc:493] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:10:07.421877 30621 raft_consensus.cc:515] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
W20260709 13:10:07.423312 29518 connection.cc:573] client connection to 127.20.69.3:37103 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:10:07.425274 30621 leader_election.cc:290] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:10:07.428272 29518 consensus_peers.cc:597] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:37103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.430078 30621 raft_consensus.cc:493] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
W20260709 13:10:07.430989 29518 consensus_peers.cc:597] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:37103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.431604 30621 raft_consensus.cc:515] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
W20260709 13:10:07.435075 29517 leader_election.cc:336] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:10:07.437590 29517 leader_election.cc:336] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Network error: Client connection negotiation failed: client connection to 127.20.69.2:32963: connect: Connection refused (error 111)
I20260709 13:10:07.438033 29517 leader_election.cc:304] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:10:07.438426 30621 leader_election.cc:290] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
I20260709 13:10:07.439145 30621 raft_consensus.cc:2749] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:07.448488 29518 leader_election.cc:336] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Network error: Client connection negotiation failed: client connection to 127.20.69.3:37103: connect: Connection refused (error 111)
I20260709 13:10:07.451402 20756 tablet_server.cc:196] TabletServer@127.20.69.3:0 shutdown complete.
W20260709 13:10:07.452239 29517 leader_election.cc:336] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:10:07.454236 29517 leader_election.cc:304] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:10:07.457437 30621 raft_consensus.cc:2749] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:07.471093 30625 raft_consensus.cc:493] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:10:07.471704 30625 raft_consensus.cc:515] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:07.474041 30625 leader_election.cc:290] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:10:07.482088 29518 leader_election.cc:336] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Network error: Client connection negotiation failed: client connection to 127.20.69.3:37103: connect: Connection refused (error 111)
W20260709 13:10:07.482748 29517 leader_election.cc:336] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:10:07.483251 30625 raft_consensus.cc:493] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:10:07.483291 29517 leader_election.cc:304] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:10:07.484086 30625 raft_consensus.cc:515] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81cf9a977cb447069d98dedbda0e4f06" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 37103 } } peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } }
I20260709 13:10:07.484452 30621 raft_consensus.cc:2749] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:07.486828 30625 leader_election.cc:290] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103), 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325)
W20260709 13:10:07.492961 29517 leader_election.cc:336] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:10:07.493758 29518 leader_election.cc:336] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Network error: Client connection negotiation failed: client connection to 127.20.69.3:37103: connect: Connection refused (error 111)
I20260709 13:10:07.494381 29518 leader_election.cc:304] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, 81cf9a977cb447069d98dedbda0e4f06
I20260709 13:10:07.495370 30625 raft_consensus.cc:2749] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:07.518936 29518 consensus_peers.cc:597] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:37103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.558619 20756 tablet_server.cc:179] TabletServer@127.20.69.4:0 shutting down...
I20260709 13:10:07.587165 30621 raft_consensus.cc:493] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:10:07.587950 30621 raft_consensus.cc:515] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:07.593298 30621 leader_election.cc:290] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
W20260709 13:10:07.603192 29517 leader_election.cc:336] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
W20260709 13:10:07.603894 29517 leader_election.cc:336] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Network error: Client connection negotiation failed: client connection to 127.20.69.2:32963: connect: Connection refused (error 111)
I20260709 13:10:07.604338 29517 leader_election.cc:304] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:10:07.605090 30621 raft_consensus.cc:2749] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:07.610972 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:07.611706 20756 tablet_replica.cc:333] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.612481 20756 raft_consensus.cc:2243] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.613400 20756 raft_consensus.cc:2272] T e043911685cb4c5889c1ea44573a0f80 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.615463 20756 tablet_replica.cc:333] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.616065 20756 raft_consensus.cc:2243] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.616540 20756 raft_consensus.cc:2272] T d828a447d3f049c58c173033d6095611 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.618628 20756 tablet_replica.cc:333] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.619225 20756 raft_consensus.cc:2243] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.619657 20756 raft_consensus.cc:2272] T 806a266f2f6a474293cb069696090159 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.621675 20756 tablet_replica.cc:333] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.622395 20756 raft_consensus.cc:2243] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.622991 20756 raft_consensus.cc:2272] T 94f844d53679454696bf4c09f6eaa88a P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.625231 20756 tablet_replica.cc:333] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.625819 20756 raft_consensus.cc:2243] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.626652 20756 raft_consensus.cc:2272] T e4ae44c83a2a422eb794cba0bfb917e1 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.628753 20756 tablet_replica.cc:333] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.629348 20756 raft_consensus.cc:2243] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.629802 20756 raft_consensus.cc:2272] T 5bf1de53534642b28b9b16f82438c57c P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.631850 20756 tablet_replica.cc:333] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.632445 20756 raft_consensus.cc:2243] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.633320 20756 raft_consensus.cc:2272] T 129c6dc7c28b457b872000878f181772 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.635469 20756 tablet_replica.cc:333] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.636093 20756 raft_consensus.cc:2243] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.636704 20756 raft_consensus.cc:2272] T 9ce1e737440642bcabdd71181160d267 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.636725 30621 raft_consensus.cc:493] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:10:07.637379 30621 raft_consensus.cc:515] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:07.639086 20756 tablet_replica.cc:333] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.639344 30621 leader_election.cc:290] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:10:07.640050 20756 raft_consensus.cc:2243] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.640813 20756 raft_consensus.cc:2272] T c04c7be6ae194d58a25d56e4c5628b4a P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.643541 29517 leader_election.cc:336] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:10:07.644102 20756 tablet_replica.cc:333] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
W20260709 13:10:07.644317 29517 leader_election.cc:336] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Network error: Client connection negotiation failed: client connection to 127.20.69.2:32963: connect: Connection refused (error 111)
I20260709 13:10:07.644821 29517 leader_election.cc:304] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:10:07.645011 20756 raft_consensus.cc:2243] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.645499 30621 raft_consensus.cc:2749] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:07.645771 20756 raft_consensus.cc:2272] T 81821b5154314716bfe0d430b08ffb5e P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.647965 20756 tablet_replica.cc:333] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.648643 20756 raft_consensus.cc:2243] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.649466 20756 raft_consensus.cc:2272] T bdf053ddbc384257a33de229f027366e P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.651994 20756 tablet_replica.cc:333] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.652864 20756 raft_consensus.cc:2243] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.653472 20756 raft_consensus.cc:2272] T ef92dc4e7b304f9e8f8e5318c7df0a9c P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.656071 29518 consensus_peers.cc:597] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 -> Peer 81cf9a977cb447069d98dedbda0e4f06 (127.20.69.3:37103): Couldn't send request to peer 81cf9a977cb447069d98dedbda0e4f06. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.3:37103: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.656656 20756 tablet_replica.cc:333] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.657588 20756 raft_consensus.cc:2243] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.658618 20756 raft_consensus.cc:2272] T a1ae9afbd8b84370bae083fab7970e20 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.661828 20756 tablet_replica.cc:333] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.662654 20756 raft_consensus.cc:2243] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.663100 20756 raft_consensus.cc:2272] T ed2a16c1a5674ca19b3c85e15da674df P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.665267 20756 tablet_replica.cc:333] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.665861 20756 raft_consensus.cc:2243] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.666319 20756 raft_consensus.cc:2272] T 5216cf90df5f43a090fc0d60c20f0e23 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.668426 20756 tablet_replica.cc:333] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.669018 20756 raft_consensus.cc:2243] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.669445 20756 raft_consensus.cc:2272] T d607df4f38c04c9190803085b2b1b842 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.671294 20756 tablet_replica.cc:333] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.671948 20756 raft_consensus.cc:2243] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.672376 20756 raft_consensus.cc:2272] T 787fe78a1da34fb38a66dc8e8e4a416d P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.674382 20756 tablet_replica.cc:333] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.674885 20756 raft_consensus.cc:2243] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.675300 20756 raft_consensus.cc:2272] T 7f75a290a07449f1a429e85726f0db84 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.677356 20756 tablet_replica.cc:333] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.677889 20756 raft_consensus.cc:2243] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.678347 20756 raft_consensus.cc:2272] T ab1dcaf42e0d4b14a3f96b090c1ae07e P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.680370 20756 tablet_replica.cc:333] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.680975 20756 raft_consensus.cc:2243] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.681777 20756 raft_consensus.cc:2272] T b3fc6d2066784e858af22723c6508fc5 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.683609 20756 tablet_replica.cc:333] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.684247 20756 raft_consensus.cc:2243] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.685170 20756 raft_consensus.cc:2272] T 4c38085886474ddd9d257bc1c526903f P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.687165 20756 tablet_replica.cc:333] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.687732 20756 raft_consensus.cc:2243] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.688192 20756 raft_consensus.cc:2272] T b4514facbaa1474a8481ce0b8849abeb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.690377 20756 tablet_replica.cc:333] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.691007 20756 raft_consensus.cc:2243] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.691458 20756 raft_consensus.cc:2272] T 078e833dff54448e9a5a55e83660ff35 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.693342 20756 tablet_replica.cc:333] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.693921 20756 raft_consensus.cc:2243] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.694368 20756 raft_consensus.cc:2272] T 51388e1eccfc4e28afe0b67f552695c6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.696385 20756 tablet_replica.cc:333] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.696991 20756 raft_consensus.cc:2243] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.698372 20756 raft_consensus.cc:2272] T 694e86fc16f64d159c1132b17d8ef34b P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.701342 20756 tablet_replica.cc:333] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.702191 20756 raft_consensus.cc:2243] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.702934 20756 raft_consensus.cc:2272] T 19f5075a32114023bc747cfd4d99a934 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.705212 20756 tablet_replica.cc:333] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.705855 20756 raft_consensus.cc:2243] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.706362 20756 raft_consensus.cc:2272] T eb067576b44a4b3fa9852a63cc5f17ec P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.708547 20756 tablet_replica.cc:333] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.709209 20756 raft_consensus.cc:2243] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.710146 20756 raft_consensus.cc:2272] T 20b7f988005d4faeaaa356919ab5a9f3 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.712662 20756 tablet_replica.cc:333] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.714021 20756 raft_consensus.cc:2243] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.714569 20756 raft_consensus.cc:2272] T 1a43a0adadf04f62a440ac2f485f116d P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.716878 20756 tablet_replica.cc:333] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.717453 20756 raft_consensus.cc:2243] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.717901 20756 raft_consensus.cc:2272] T 2ee25eabd993465aafd680f5ab69e5ce P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.719987 20756 tablet_replica.cc:333] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.720677 20756 raft_consensus.cc:2243] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.721221 20756 raft_consensus.cc:2272] T 8d3086b5afd543099cb84670c2da84bd P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.723587 20756 tablet_replica.cc:333] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.724330 20756 raft_consensus.cc:2243] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.725301 20756 raft_consensus.cc:2272] T 0df9a8d24a9d4474be608101a853cacb P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.727559 20756 tablet_replica.cc:333] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.728237 20756 raft_consensus.cc:2243] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.728827 20756 raft_consensus.cc:2272] T 3b146e77806e403d90813507378d6bea P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.731074 20756 tablet_replica.cc:333] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.731688 20756 raft_consensus.cc:2243] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.732209 20756 raft_consensus.cc:2272] T 189ffad2edf44a8da1f0fb3c5cb386c3 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.734952 20756 tablet_replica.cc:333] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.735628 20756 raft_consensus.cc:2243] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.736524 20756 raft_consensus.cc:2272] T 2d4628fa3c2c4dc29582dbdc8f25f8d1 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.739315 20756 tablet_replica.cc:333] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.739925 20756 raft_consensus.cc:2243] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.740835 20756 raft_consensus.cc:2272] T f97fa8cf984a4161b829432f9ecf4264 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.742926 20756 tablet_replica.cc:333] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.743486 20756 raft_consensus.cc:2243] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.743973 20756 raft_consensus.cc:2272] T f97afae1ea704b1da66dcdd1a25acce4 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.746263 20756 tablet_replica.cc:333] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.746897 20756 raft_consensus.cc:2243] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.747445 20756 raft_consensus.cc:2272] T e65b26d5bb9645bfaa8468e215b4b65d P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.749910 20756 tablet_replica.cc:333] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.750559 20756 raft_consensus.cc:2243] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.751057 20756 raft_consensus.cc:2272] T 1940d3c343814440a73d53c937f06f56 P 470465ef54334dbc8be5230ca16dc1a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.751717 30621 raft_consensus.cc:493] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23e24e0c40f44bc79274c2081c9fc002)
I20260709 13:10:07.752321 30621 raft_consensus.cc:515] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "470465ef54334dbc8be5230ca16dc1a8" member_type: VOTER last_known_addr { host: "127.20.69.4" port: 40041 } } peers { permanent_uuid: "23e24e0c40f44bc79274c2081c9fc002" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 40325 } } peers { permanent_uuid: "a5dacd0232c24e92bc64f941b7410a9d" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 32963 } }
I20260709 13:10:07.754076 20756 tablet_replica.cc:333] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.754890 30621 leader_election.cc:290] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325), a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963)
I20260709 13:10:07.754951 20756 raft_consensus.cc:2243] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.756027 20756 raft_consensus.cc:2272] T a150eab0c5544ffdb1289b03eb527a5b P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.759087 20756 tablet_replica.cc:333] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
W20260709 13:10:07.759392 29517 leader_election.cc:336] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23e24e0c40f44bc79274c2081c9fc002 (127.20.69.1:40325): Network error: Client connection negotiation failed: client connection to 127.20.69.1:40325: connect: Connection refused (error 111)
I20260709 13:10:07.759740 20756 raft_consensus.cc:2243] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:07.760228 29517 leader_election.cc:336] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a5dacd0232c24e92bc64f941b7410a9d (127.20.69.2:32963): Network error: Client connection negotiation failed: client connection to 127.20.69.2:32963: connect: Connection refused (error 111)
I20260709 13:10:07.760581 29517 leader_election.cc:304] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 470465ef54334dbc8be5230ca16dc1a8; no voters: 23e24e0c40f44bc79274c2081c9fc002, a5dacd0232c24e92bc64f941b7410a9d
I20260709 13:10:07.761034 20756 raft_consensus.cc:2272] T 895df96ea5c54121bb29dba7f08193a0 P 470465ef54334dbc8be5230ca16dc1a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.761561 30621 raft_consensus.cc:2749] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:07.763619 20756 tablet_replica.cc:333] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.764326 20756 raft_consensus.cc:2243] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.765457 20756 raft_consensus.cc:2272] T 9e018f136fea466ab0d7ed7aa4592f06 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.767611 20756 tablet_replica.cc:333] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.768067 20756 raft_consensus.cc:2243] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.768461 20756 raft_consensus.cc:2272] T dd516b0c89f946de845897e58c667be6 P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.770426 20756 tablet_replica.cc:333] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8: stopping tablet replica
I20260709 13:10:07.770831 20756 raft_consensus.cc:2243] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.771234 20756 raft_consensus.cc:2272] T a7f0a5f595ee48d48b1bdf8c5f330f0a P 470465ef54334dbc8be5230ca16dc1a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.861312 20756 tablet_server.cc:196] TabletServer@127.20.69.4:0 shutdown complete.
I20260709 13:10:07.926520 20756 master.cc:562] Master@127.20.69.62:37947 shutting down...
I20260709 13:10:07.955127 20756 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.955762 20756 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.956111 20756 tablet_replica.cc:333] T 00000000000000000000000000000000 P 84e4fcab92c047b4a7853b0eafa48991: stopping tablet replica
I20260709 13:10:08.005088 20756 master.cc:584] Master@127.20.69.62:37947 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36726 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:10:08.099603 20756 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.69.62:37073
I20260709 13:10:08.100888 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:08.107673 30630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.107689 30628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.107757 30627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.108229 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:08.110092 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:08.110337 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:08.110495 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602608110479 us; error 0 us; skew 500 ppm
I20260709 13:10:08.111115 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:08.114306 20756 webserver.cc:533] Webserver started at http://127.20.69.62:32955/ using document root <none> and password file <none>
I20260709 13:10:08.114821 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:08.115023 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:08.115315 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:08.116549 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/master-0-root/instance:
uuid: "6a5a876e89024425aec0a827b2b43455"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:08.121604 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:10:08.125092 30635 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.125864 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:08.126161 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/master-0-root
uuid: "6a5a876e89024425aec0a827b2b43455"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:08.126433 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:08.167765 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.169076 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.208715 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.62:37073
I20260709 13:10:08.208830 30686 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.62:37073 every 8 connection(s)
I20260709 13:10:08.212815 30687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.224494 30687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455: Bootstrap starting.
I20260709 13:10:08.229717 30687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.234256 30687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455: No bootstrap required, opened a new log
I20260709 13:10:08.236534 30687 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5a876e89024425aec0a827b2b43455" member_type: VOTER }
I20260709 13:10:08.236992 30687 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.237174 30687 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a5a876e89024425aec0a827b2b43455, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.237694 30687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5a876e89024425aec0a827b2b43455" member_type: VOTER }
I20260709 13:10:08.238092 30687 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:08.238288 30687 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:08.238495 30687 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.243307 30687 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5a876e89024425aec0a827b2b43455" member_type: VOTER }
I20260709 13:10:08.243808 30687 leader_election.cc:304] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a5a876e89024425aec0a827b2b43455; no voters: 
I20260709 13:10:08.244947 30687 leader_election.cc:290] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:08.245318 30690 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.246861 30690 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 1 LEADER]: Becoming Leader. State: Replica: 6a5a876e89024425aec0a827b2b43455, State: Running, Role: LEADER
I20260709 13:10:08.247679 30690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5a876e89024425aec0a827b2b43455" member_type: VOTER }
I20260709 13:10:08.248190 30687 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:08.254225 30691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a5a876e89024425aec0a827b2b43455" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5a876e89024425aec0a827b2b43455" member_type: VOTER } }
I20260709 13:10:08.254345 30692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a5a876e89024425aec0a827b2b43455. Latest consensus state: current_term: 1 leader_uuid: "6a5a876e89024425aec0a827b2b43455" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a5a876e89024425aec0a827b2b43455" member_type: VOTER } }
I20260709 13:10:08.255467 30691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:08.255483 30692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:08.261838 30698 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:08.266975 30698 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:08.268021 20756 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:08.276095 30698 catalog_manager.cc:1383] Generated new cluster ID: a0e370f6ad9944feb6d1177072b2f8bf
I20260709 13:10:08.276410 30698 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:08.297077 30698 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:08.298417 30698 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:08.311041 30698 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455: Generated new TSK 0
I20260709 13:10:08.311702 30698 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:08.335294 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:08.341926 30708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.343248 30709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.345703 30711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.345818 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:08.347262 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:08.347461 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:08.347608 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602608347580 us; error 0 us; skew 500 ppm
I20260709 13:10:08.348083 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:08.350633 20756 webserver.cc:533] Webserver started at http://127.20.69.1:34475/ using document root <none> and password file <none>
I20260709 13:10:08.351121 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:08.351276 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:08.351490 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:08.352562 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root/instance:
uuid: "44c7cec569f24c72869298ad09030032"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:08.357343 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:08.361372 30716 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.362174 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:08.362504 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "44c7cec569f24c72869298ad09030032"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:08.362787 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:08.375018 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.376214 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.377776 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:08.380059 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:08.380246 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.380535 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:08.380767 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:10:08.421288 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:35189
I20260709 13:10:08.421396 30778 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:35189 every 8 connection(s)
I20260709 13:10:08.427481 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:08.434792 30783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.436519 30784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.439632 30786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.440258 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:08.441037 30779 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37073
I20260709 13:10:08.441535 30779 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:08.441682 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:08.441993 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:08.442171 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602608442137 us; error 0 us; skew 500 ppm
I20260709 13:10:08.442413 30779 heartbeater.cc:507] Master 127.20.69.62:37073 requested a full tablet report, sending...
I20260709 13:10:08.442843 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:08.444854 30652 ts_manager.cc:194] Registered new tserver with Master: 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189)
I20260709 13:10:08.445833 20756 webserver.cc:533] Webserver started at http://127.20.69.2:37585/ using document root <none> and password file <none>
I20260709 13:10:08.446417 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:08.446614 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:08.446898 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:08.446964 30652 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36336
I20260709 13:10:08.448061 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-1-root/instance:
uuid: "5a86c59861274d90944fbf7a5a72b0a5"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:08.452852 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:08.456660 30791 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.457623 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:08.457975 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-1-root
uuid: "5a86c59861274d90944fbf7a5a72b0a5"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:08.458287 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:08.477447 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.478775 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.480298 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:08.482730 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:08.482986 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.483245 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:08.483424 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.524942 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.2:34769
I20260709 13:10:08.525065 30853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.2:34769 every 8 connection(s)
I20260709 13:10:08.530272 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:08.538152 30857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.539507 30858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.542869 20756 server_base.cc:1061] running on GCE node
W20260709 13:10:08.543335 30860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.544210 30854 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37073
I20260709 13:10:08.544636 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:08.544700 30854 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:08.544981 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:08.545250 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602608545231 us; error 0 us; skew 500 ppm
I20260709 13:10:08.545739 30854 heartbeater.cc:507] Master 127.20.69.62:37073 requested a full tablet report, sending...
I20260709 13:10:08.545920 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:08.548523 30652 ts_manager.cc:194] Registered new tserver with Master: 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:08.549537 20756 webserver.cc:533] Webserver started at http://127.20.69.3:42589/ using document root <none> and password file <none>
I20260709 13:10:08.550343 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:08.550585 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:08.550685 30652 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36342
I20260709 13:10:08.550912 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:08.552500 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-2-root/instance:
uuid: "162c5efd182141119904db2a7071b578"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:08.557193 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:08.560515 30865 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.561322 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:08.561640 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-2-root
uuid: "162c5efd182141119904db2a7071b578"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:08.561947 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:08.575939 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.577286 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.578807 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:08.581396 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:08.581655 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.581910 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:08.582106 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.624518 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.3:39891
I20260709 13:10:08.624850 30927 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.3:39891 every 8 connection(s)
I20260709 13:10:08.639075 30928 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37073
I20260709 13:10:08.639567 30928 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:08.640386 30928 heartbeater.cc:507] Master 127.20.69.62:37073 requested a full tablet report, sending...
I20260709 13:10:08.642491 30652 ts_manager.cc:194] Registered new tserver with Master: 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:08.642798 20756 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015083154s
I20260709 13:10:08.644016 30652 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36350
I20260709 13:10:08.670527 30652 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36352:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:08.673529 30652 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:08.749712 30743 tablet_service.cc:1511] Processing CreateTablet for tablet bc02342efb5241f7aa87b80a37643800 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:08.751207 30743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc02342efb5241f7aa87b80a37643800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.752089 30818 tablet_service.cc:1511] Processing CreateTablet for tablet bc02342efb5241f7aa87b80a37643800 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:08.753602 30818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc02342efb5241f7aa87b80a37643800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.753821 30742 tablet_service.cc:1511] Processing CreateTablet for tablet 00a07a56a421476db11bb72bca539066 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:08.755228 30742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a07a56a421476db11bb72bca539066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.757879 30819 tablet_service.cc:1511] Processing CreateTablet for tablet eae411bee00d4a468d3b397059d72d9d (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:08.759356 30819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae411bee00d4a468d3b397059d72d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.763010 30892 tablet_service.cc:1511] Processing CreateTablet for tablet bc02342efb5241f7aa87b80a37643800 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:10:08.764969 30892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc02342efb5241f7aa87b80a37643800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.766304 30816 tablet_service.cc:1511] Processing CreateTablet for tablet 68b8b40037ae4412bad58fc32afe9dec (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:08.767843 30816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b8b40037ae4412bad58fc32afe9dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.770221 30741 tablet_service.cc:1511] Processing CreateTablet for tablet 68b8b40037ae4412bad58fc32afe9dec (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:08.771715 30741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b8b40037ae4412bad58fc32afe9dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.748229 30744 tablet_service.cc:1511] Processing CreateTablet for tablet eae411bee00d4a468d3b397059d72d9d (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:08.773728 30744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae411bee00d4a468d3b397059d72d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.760236 30893 tablet_service.cc:1511] Processing CreateTablet for tablet eae411bee00d4a468d3b397059d72d9d (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:10:08.774974 30891 tablet_service.cc:1511] Processing CreateTablet for tablet 00a07a56a421476db11bb72bca539066 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:08.775499 30893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae411bee00d4a468d3b397059d72d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.760931 30817 tablet_service.cc:1511] Processing CreateTablet for tablet 00a07a56a421476db11bb72bca539066 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:10:08.777755 30817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a07a56a421476db11bb72bca539066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.778563 30890 tablet_service.cc:1511] Processing CreateTablet for tablet 68b8b40037ae4412bad58fc32afe9dec (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:10:08.784269 30889 tablet_service.cc:1511] Processing CreateTablet for tablet 18f70792f2c048629016c0ff7da82437 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:08.787628 30740 tablet_service.cc:1511] Processing CreateTablet for tablet 18f70792f2c048629016c0ff7da82437 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:08.796998 30740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f70792f2c048629016c0ff7da82437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.790411 30739 tablet_service.cc:1511] Processing CreateTablet for tablet 82a22f62a6544f509f4f5a6f1b4ef21e (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:08.793877 30814 tablet_service.cc:1511] Processing CreateTablet for tablet 82a22f62a6544f509f4f5a6f1b4ef21e (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:08.793877 30815 tablet_service.cc:1511] Processing CreateTablet for tablet 18f70792f2c048629016c0ff7da82437 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:10:08.799015 30739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a22f62a6544f509f4f5a6f1b4ef21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.799015 30814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a22f62a6544f509f4f5a6f1b4ef21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.801052 30815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f70792f2c048629016c0ff7da82437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.776479 30891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a07a56a421476db11bb72bca539066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.797286 30888 tablet_service.cc:1511] Processing CreateTablet for tablet 82a22f62a6544f509f4f5a6f1b4ef21e (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:10:08.804757 30888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a22f62a6544f509f4f5a6f1b4ef21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.810019 30890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b8b40037ae4412bad58fc32afe9dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.811609 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f70792f2c048629016c0ff7da82437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.825178 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 0a725a7ea50c4709beeb1f9bb2268e70 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:08.826651 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a725a7ea50c4709beeb1f9bb2268e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.829506 30886 tablet_service.cc:1511] Processing CreateTablet for tablet a6f665ec66ea4a8b8bbd6e079e564149 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:08.831089 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f665ec66ea4a8b8bbd6e079e564149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.833912 30885 tablet_service.cc:1511] Processing CreateTablet for tablet b88778a226fe44e89803191220d955b0 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:08.835404 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88778a226fe44e89803191220d955b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.838361 30884 tablet_service.cc:1511] Processing CreateTablet for tablet de3dd578d9e4422fa529d9722c14b37c (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:08.840454 30884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3dd578d9e4422fa529d9722c14b37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.850493 30738 tablet_service.cc:1511] Processing CreateTablet for tablet 0a725a7ea50c4709beeb1f9bb2268e70 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:08.852154 30738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a725a7ea50c4709beeb1f9bb2268e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.854451 30737 tablet_service.cc:1511] Processing CreateTablet for tablet a6f665ec66ea4a8b8bbd6e079e564149 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:08.855966 30737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f665ec66ea4a8b8bbd6e079e564149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.857918 30736 tablet_service.cc:1511] Processing CreateTablet for tablet b88778a226fe44e89803191220d955b0 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:08.859515 30736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88778a226fe44e89803191220d955b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.861726 30735 tablet_service.cc:1511] Processing CreateTablet for tablet de3dd578d9e4422fa529d9722c14b37c (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:08.863201 30735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3dd578d9e4422fa529d9722c14b37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.865810 30811 tablet_service.cc:1511] Processing CreateTablet for tablet b88778a226fe44e89803191220d955b0 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:10:08.867355 30811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88778a226fe44e89803191220d955b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.869771 30810 tablet_service.cc:1511] Processing CreateTablet for tablet de3dd578d9e4422fa529d9722c14b37c (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:10:08.871245 30810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3dd578d9e4422fa529d9722c14b37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.875432 30812 tablet_service.cc:1511] Processing CreateTablet for tablet a6f665ec66ea4a8b8bbd6e079e564149 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:10:08.873907 30813 tablet_service.cc:1511] Processing CreateTablet for tablet 0a725a7ea50c4709beeb1f9bb2268e70 (DEFAULT_TABLE table=test-workload [id=1cbc074f8245491bbc0a0725d8b8c1e1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:10:08.881623 30812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f665ec66ea4a8b8bbd6e079e564149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.885033 30813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a725a7ea50c4709beeb1f9bb2268e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.946461 30943 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:08.955982 30943 tablet_bootstrap.cc:654] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.006108 30943 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.006632 30943 ts_tablet_manager.cc:1403] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.034s
I20260709 13:10:09.008953 30946 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.009727 30943 raft_consensus.cc:359] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.010573 30943 raft_consensus.cc:385] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.010880 30943 raft_consensus.cc:740] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.012197 30944 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.016834 30946 tablet_bootstrap.cc:654] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.011816 30943 consensus_queue.cc:260] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.044535 30943 ts_tablet_manager.cc:1434] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:10:09.046729 30854 heartbeater.cc:499] Master 127.20.69.62:37073 was elected leader, sending a full tablet report...
I20260709 13:10:09.052685 30943 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.060274 30943 tablet_bootstrap.cc:654] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.062676 30944 tablet_bootstrap.cc:654] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.068105 30946 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.068840 30946 ts_tablet_manager.cc:1403] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.030s
I20260709 13:10:09.070277 30943 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.070845 30943 ts_tablet_manager.cc:1403] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 13:10:09.073840 30946 raft_consensus.cc:359] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.073895 30943 raft_consensus.cc:359] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.074851 30946 raft_consensus.cc:385] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.074909 30943 raft_consensus.cc:385] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.075273 30946 raft_consensus.cc:740] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.075356 30944 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.075414 30943 raft_consensus.cc:740] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.076025 30944 ts_tablet_manager.cc:1403] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.007s
I20260709 13:10:09.076431 30943 consensus_queue.cc:260] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.076293 30946 consensus_queue.cc:260] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.078588 30943 ts_tablet_manager.cc:1434] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:09.079777 30943 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.079739 30944 raft_consensus.cc:359] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.080981 30944 raft_consensus.cc:385] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.081377 30944 raft_consensus.cc:740] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.082569 30944 consensus_queue.cc:260] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.086514 30946 ts_tablet_manager.cc:1434] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 13:10:09.087523 30943 tablet_bootstrap.cc:654] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.087587 30779 heartbeater.cc:499] Master 127.20.69.62:37073 was elected leader, sending a full tablet report...
I20260709 13:10:09.087956 30946 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.095290 30946 tablet_bootstrap.cc:654] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.102180 30946 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.103056 30946 ts_tablet_manager.cc:1403] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:10:09.104151 30928 heartbeater.cc:499] Master 127.20.69.62:37073 was elected leader, sending a full tablet report...
I20260709 13:10:09.105234 30944 ts_tablet_manager.cc:1434] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.007s
I20260709 13:10:09.106415 30944 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.106552 30946 raft_consensus.cc:359] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.107450 30946 raft_consensus.cc:385] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.107828 30946 raft_consensus.cc:740] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.108675 30946 consensus_queue.cc:260] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.110932 30946 ts_tablet_manager.cc:1434] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:09.112026 30946 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.114024 30944 tablet_bootstrap.cc:654] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.118115 30943 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.118705 30943 ts_tablet_manager.cc:1403] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.015s
I20260709 13:10:09.119450 30946 tablet_bootstrap.cc:654] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.121785 30943 raft_consensus.cc:359] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.122741 30943 raft_consensus.cc:385] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.123114 30943 raft_consensus.cc:740] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.124333 30943 consensus_queue.cc:260] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
W20260709 13:10:09.129045 30929 tablet.cc:2406] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:09.138928 30943 ts_tablet_manager.cc:1434] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:10:09.142307 30943 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.144526 30946 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.145192 30946 ts_tablet_manager.cc:1403] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.011s
I20260709 13:10:09.146311 30944 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.146845 30944 ts_tablet_manager.cc:1403] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.023s
I20260709 13:10:09.148725 30943 tablet_bootstrap.cc:654] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.148555 30946 raft_consensus.cc:359] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.149477 30946 raft_consensus.cc:385] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.149801 30946 raft_consensus.cc:740] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.149976 30944 raft_consensus.cc:359] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.150767 30944 raft_consensus.cc:385] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.150597 30946 consensus_queue.cc:260] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.151077 30944 raft_consensus.cc:740] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.151932 30944 consensus_queue.cc:260] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.154114 30946 ts_tablet_manager.cc:1434] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:09.154333 30944 ts_tablet_manager.cc:1434] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:09.155211 30944 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.155211 30946 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.162463 30946 tablet_bootstrap.cc:654] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.162811 30944 tablet_bootstrap.cc:654] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.163936 30943 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.164726 30943 ts_tablet_manager.cc:1403] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.008s
I20260709 13:10:09.168118 30943 raft_consensus.cc:359] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.168964 30943 raft_consensus.cc:385] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.169298 30943 raft_consensus.cc:740] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.170022 30943 consensus_queue.cc:260] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.172638 30943 ts_tablet_manager.cc:1434] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:09.173776 30943 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.177613 30946 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.178218 30946 ts_tablet_manager.cc:1403] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:10:09.179210 30944 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.179777 30944 ts_tablet_manager.cc:1403] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:10:09.180349 30948 raft_consensus.cc:493] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.180881 30948 raft_consensus.cc:515] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.181291 30946 raft_consensus.cc:359] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.182093 30946 raft_consensus.cc:385] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.182382 30946 raft_consensus.cc:740] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.182783 30944 raft_consensus.cc:359] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.183149 30946 consensus_queue.cc:260] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.183557 30948 leader_election.cc:290] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.183561 30944 raft_consensus.cc:385] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.184221 30944 raft_consensus.cc:740] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.186313 30943 tablet_bootstrap.cc:654] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.185159 30944 consensus_queue.cc:260] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.190819 30946 ts_tablet_manager.cc:1434] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:10:09.192025 30946 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.197057 30944 ts_tablet_manager.cc:1434] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:10:09.198248 30944 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.201867 30952 raft_consensus.cc:493] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.204793 30952 raft_consensus.cc:515] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.205897 30944 tablet_bootstrap.cc:654] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.208396 30952 leader_election.cc:290] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:09.228272 30946 tablet_bootstrap.cc:654] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.231464 30951 raft_consensus.cc:493] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.232050 30951 raft_consensus.cc:515] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.243369 30951 leader_election.cc:290] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.244156 30943 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.246198 30943 ts_tablet_manager.cc:1403] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.016s
I20260709 13:10:09.251328 30943 raft_consensus.cc:359] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.254369 30943 raft_consensus.cc:385] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.254751 30943 raft_consensus.cc:740] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.256229 30903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:09.257074 30903 raft_consensus.cc:2468] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 0.
I20260709 13:10:09.258594 30793 leader_election.cc:304] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.259636 30948 raft_consensus.cc:2804] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.260046 30948 raft_consensus.cc:493] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:09.261289 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:09.261607 30948 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.259904 30943 consensus_queue.cc:260] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.267653 30972 raft_consensus.cc:493] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.268205 30972 raft_consensus.cc:515] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.269702 30946 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.270527 30946 ts_tablet_manager.cc:1403] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.003s
I20260709 13:10:09.271225 30972 leader_election.cc:290] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.273466 30943 ts_tablet_manager.cc:1434] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:10:09.273658 30948 raft_consensus.cc:515] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.279389 30944 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.280159 30944 ts_tablet_manager.cc:1403] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.004s
I20260709 13:10:09.280910 30948 leader_election.cc:290] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.286784 30903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f665ec66ea4a8b8bbd6e079e564149" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:09.288329 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:09.293025 30903 raft_consensus.cc:2468] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 0.
I20260709 13:10:09.293154 30902 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.294387 30793 leader_election.cc:304] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.296211 30972 raft_consensus.cc:2804] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.296586 30972 raft_consensus.cc:493] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.296939 30972 raft_consensus.cc:3060] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.284529 30944 raft_consensus.cc:359] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.298283 30944 raft_consensus.cc:385] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.298570 30944 raft_consensus.cc:740] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.300159 30944 consensus_queue.cc:260] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.289664 30754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:09.291324 30753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f665ec66ea4a8b8bbd6e079e564149" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:09.291611 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:09.303194 30944 ts_tablet_manager.cc:1434] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:10:09.290315 30943 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.304294 30944 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.301829 30951 raft_consensus.cc:493] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.309247 30951 raft_consensus.cc:515] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.309888 30903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:09.311295 30951 leader_election.cc:290] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.311420 30944 tablet_bootstrap.cc:654] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:09.311479 30718 leader_election.cc:343] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 162c5efd182141119904db2a7071b578 (127.20.69.3:39891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.291997 30946 raft_consensus.cc:359] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.312659 30946 raft_consensus.cc:385] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.312953 30946 raft_consensus.cc:740] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.313347 30903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f70792f2c048629016c0ff7da82437" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
W20260709 13:10:09.314064 30792 leader_election.cc:343] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:09.315601 30792 leader_election.cc:343] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.317414 30902 raft_consensus.cc:2468] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 1.
I20260709 13:10:09.318931 30793 leader_election.cc:304] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
W20260709 13:10:09.319205 30718 leader_election.cc:343] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 162c5efd182141119904db2a7071b578 (127.20.69.3:39891): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:09.319968 30792 leader_election.cc:343] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.320433 30971 raft_consensus.cc:2804] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.321034 30971 raft_consensus.cc:697] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:09.321915 30971 consensus_queue.cc:237] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.322180 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f665ec66ea4a8b8bbd6e079e564149" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
W20260709 13:10:09.326396 30866 leader_election.cc:343] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.327282 30972 raft_consensus.cc:515] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.319957 30946 consensus_queue.cc:260] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.329082 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f665ec66ea4a8b8bbd6e079e564149" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:09.330377 30829 raft_consensus.cc:2393] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 162c5efd182141119904db2a7071b578 in current term 1: Already voted for candidate 5a86c59861274d90944fbf7a5a72b0a5 in this term.
I20260709 13:10:09.330873 30946 ts_tablet_manager.cc:1434] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:10:09.332280 30946 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.333338 30972 leader_election.cc:290] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.333472 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f665ec66ea4a8b8bbd6e079e564149" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:09.334225 30902 raft_consensus.cc:3060] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.340400 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f665ec66ea4a8b8bbd6e079e564149" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:09.340703 30943 tablet_bootstrap.cc:654] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:09.342239 30792 leader_election.cc:343] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.343461 30866 leader_election.cc:304] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 162c5efd182141119904db2a7071b578; no voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:09.348524 30946 tablet_bootstrap.cc:654] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.348974 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:09.350750 30902 raft_consensus.cc:2468] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 1.
I20260709 13:10:09.351405 30952 raft_consensus.cc:2749] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.351751 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f70792f2c048629016c0ff7da82437" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
W20260709 13:10:09.353696 30717 leader_election.cc:343] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.354394 30717 leader_election.cc:304] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c7cec569f24c72869298ad09030032; no voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:09.355455 30951 raft_consensus.cc:2749] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.355703 30793 leader_election.cc:304] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 44c7cec569f24c72869298ad09030032
W20260709 13:10:09.355852 30717 leader_election.cc:343] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.356990 30717 leader_election.cc:304] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c7cec569f24c72869298ad09030032; no voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:09.357367 30972 raft_consensus.cc:2804] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.357932 30972 raft_consensus.cc:697] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:09.358101 30951 raft_consensus.cc:2749] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.358863 30972 consensus_queue.cc:237] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.360728 30948 raft_consensus.cc:493] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.369114 30948 raft_consensus.cc:515] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.371695 30943 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.372521 30943 ts_tablet_manager.cc:1403] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.002s
I20260709 13:10:09.373514 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88778a226fe44e89803191220d955b0" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
W20260709 13:10:09.375650 30792 leader_election.cc:343] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.376356 30948 leader_election.cc:290] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.378710 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88778a226fe44e89803191220d955b0" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:09.379031 30944 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.377748 30652 catalog_manager.cc:5697] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.379460 30943 raft_consensus.cc:359] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
W20260709 13:10:09.379992 30793 leader_election.cc:343] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 162c5efd182141119904db2a7071b578 (127.20.69.3:39891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.380075 30944 ts_tablet_manager.cc:1403] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.013s
I20260709 13:10:09.381011 30951 raft_consensus.cc:493] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.383833 30951 raft_consensus.cc:515] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.385705 30951 leader_election.cc:290] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.382848 30793 leader_election.cc:304] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a86c59861274d90944fbf7a5a72b0a5; no voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032
I20260709 13:10:09.386499 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:09.387017 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:09.387691 30978 raft_consensus.cc:2749] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.380229 30943 raft_consensus.cc:385] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.385475 30946 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
W20260709 13:10:09.388265 30717 leader_election.cc:343] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.388684 30943 raft_consensus.cc:740] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.389086 30946 ts_tablet_manager.cc:1403] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.011s
W20260709 13:10:09.389024 30718 leader_election.cc:343] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 162c5efd182141119904db2a7071b578 (127.20.69.3:39891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.389629 30718 leader_election.cc:304] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c7cec569f24c72869298ad09030032; no voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:09.391004 30951 raft_consensus.cc:2749] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.392159 30943 consensus_queue.cc:260] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.392409 30946 raft_consensus.cc:359] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.393222 30946 raft_consensus.cc:385] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.393532 30946 raft_consensus.cc:740] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.394289 30943 ts_tablet_manager.cc:1434] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:10:09.395155 30943 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.394382 30946 consensus_queue.cc:260] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.386093 30944 raft_consensus.cc:359] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.396847 30944 raft_consensus.cc:385] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.397154 30946 ts_tablet_manager.cc:1434] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:09.397181 30944 raft_consensus.cc:740] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.398219 30946 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.398403 30944 consensus_queue.cc:260] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.400900 30944 ts_tablet_manager.cc:1434] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:10:09.402032 30943 tablet_bootstrap.cc:654] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.404088 30944 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.405522 30946 tablet_bootstrap.cc:654] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.413416 30944 tablet_bootstrap.cc:654] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.429417 30944 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.429970 30944 ts_tablet_manager.cc:1403] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:10:09.434032 30944 raft_consensus.cc:359] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.435086 30944 raft_consensus.cc:385] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.435477 30944 raft_consensus.cc:740] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.436522 30944 consensus_queue.cc:260] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.437589 30952 raft_consensus.cc:493] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.438413 30952 raft_consensus.cc:515] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.442827 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88778a226fe44e89803191220d955b0" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
W20260709 13:10:09.445022 30866 leader_election.cc:343] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.448452 30944 ts_tablet_manager.cc:1434] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:10:09.449120 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88778a226fe44e89803191220d955b0" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:09.458143 30829 raft_consensus.cc:2468] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 0.
I20260709 13:10:09.458360 30944 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.460487 30866 leader_election.cc:304] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 44c7cec569f24c72869298ad09030032
I20260709 13:10:09.461974 30985 raft_consensus.cc:2804] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.462598 30985 raft_consensus.cc:493] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.463065 30985 raft_consensus.cc:3060] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.446913 30952 leader_election.cc:290] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:09.478384 30985 raft_consensus.cc:515] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.485397 30944 tablet_bootstrap.cc:654] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.492339 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88778a226fe44e89803191220d955b0" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:09.493302 30985 leader_election.cc:290] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:09.495208 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88778a226fe44e89803191220d955b0" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:09.495919 30978 raft_consensus.cc:493] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.496721 30978 raft_consensus.cc:515] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
W20260709 13:10:09.497648 30866 leader_election.cc:343] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.496168 30829 raft_consensus.cc:3060] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.499899 30978 leader_election.cc:290] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.501183 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a725a7ea50c4709beeb1f9bb2268e70" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:09.501609 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a725a7ea50c4709beeb1f9bb2268e70" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:09.501858 30902 raft_consensus.cc:2468] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 0.
I20260709 13:10:09.503321 30793 leader_election.cc:304] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.504418 30978 raft_consensus.cc:2804] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.504917 30978 raft_consensus.cc:493] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.505339 30978 raft_consensus.cc:3060] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.502244 30752 raft_consensus.cc:2468] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 0.
I20260709 13:10:09.512029 30946 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.512734 30946 ts_tablet_manager.cc:1403] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.115s	user 0.043s	sys 0.070s
I20260709 13:10:09.512900 30829 raft_consensus.cc:2468] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 1.
I20260709 13:10:09.513293 30978 raft_consensus.cc:515] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.514343 30866 leader_election.cc:304] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 44c7cec569f24c72869298ad09030032
I20260709 13:10:09.515731 30952 raft_consensus.cc:2804] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.516287 30944 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.516764 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a725a7ea50c4709beeb1f9bb2268e70" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:09.517287 30985 raft_consensus.cc:493] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.517506 30902 raft_consensus.cc:3060] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.517421 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a725a7ea50c4709beeb1f9bb2268e70" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:09.518292 30752 raft_consensus.cc:3060] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.518097 30985 raft_consensus.cc:515] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.522354 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:09.523456 30828 raft_consensus.cc:2468] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 0.
I20260709 13:10:09.516865 30944 ts_tablet_manager.cc:1403] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.001s
I20260709 13:10:09.527808 30943 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.533290 30943 ts_tablet_manager.cc:1403] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.138s	user 0.059s	sys 0.046s
I20260709 13:10:09.532735 30946 raft_consensus.cc:359] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.533993 30946 raft_consensus.cc:385] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.525784 30866 leader_election.cc:304] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.525389 30972 raft_consensus.cc:493] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.536270 30972 raft_consensus.cc:515] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.538652 30952 raft_consensus.cc:697] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:09.539904 30988 raft_consensus.cc:2804] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.534459 30946 raft_consensus.cc:740] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.540045 30952 consensus_queue.cc:237] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.542969 30753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:09.540470 30988 raft_consensus.cc:493] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.542205 30946 consensus_queue.cc:260] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.529959 30902 raft_consensus.cc:2468] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 1.
I20260709 13:10:09.547994 30753 raft_consensus.cc:2468] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 0.
I20260709 13:10:09.544096 30978 leader_election.cc:290] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.549973 30793 leader_election.cc:304] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.547998 30988 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.546195 30652 catalog_manager.cc:5697] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.551085 30792 leader_election.cc:304] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.552030 30948 raft_consensus.cc:2804] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.552539 30948 raft_consensus.cc:697] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:09.553407 30948 consensus_queue.cc:237] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.550012 30946 ts_tablet_manager.cc:1434] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.005s
I20260709 13:10:09.554916 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:09.555500 30972 leader_election.cc:290] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.555930 30971 raft_consensus.cc:2804] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:09.556363 30793 leader_election.cc:343] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 162c5efd182141119904db2a7071b578 (127.20.69.3:39891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.556358 30971 raft_consensus.cc:493] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.557117 30971 raft_consensus.cc:3060] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.557665 30985 leader_election.cc:290] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769), 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189)
I20260709 13:10:09.555210 30946 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.542088 30943 raft_consensus.cc:359] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.558346 30943 raft_consensus.cc:385] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.558655 30943 raft_consensus.cc:740] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.559396 30943 consensus_queue.cc:260] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.561291 30753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:09.561522 30752 raft_consensus.cc:2468] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 1.
I20260709 13:10:09.561959 30943 ts_tablet_manager.cc:1434] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 13:10:09.562036 30753 raft_consensus.cc:2468] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 0.
I20260709 13:10:09.534758 30944 raft_consensus.cc:359] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.564215 30944 raft_consensus.cc:385] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.564656 30944 raft_consensus.cc:740] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.565433 30944 consensus_queue.cc:260] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.567399 30943 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.569875 30946 tablet_bootstrap.cc:654] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.572407 30971 raft_consensus.cc:515] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.574380 30944 ts_tablet_manager.cc:1434] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:10:09.576076 30944 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.576903 30985 raft_consensus.cc:493] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.577544 30985 raft_consensus.cc:515] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.579860 30985 leader_election.cc:290] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:09.582196 30753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:09.583266 30753 raft_consensus.cc:3060] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.584124 30943 tablet_bootstrap.cc:654] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.585152 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
W20260709 13:10:09.587489 30866 leader_election.cc:343] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.582398 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:09.588858 30752 raft_consensus.cc:2468] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 0.
I20260709 13:10:09.590492 30866 leader_election.cc:304] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:09.591710 30944 tablet_bootstrap.cc:654] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.591738 30985 raft_consensus.cc:2804] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.592334 30985 raft_consensus.cc:493] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.592715 30985 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.595014 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578"
W20260709 13:10:09.596979 30793 leader_election.cc:343] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 162c5efd182141119904db2a7071b578 (127.20.69.3:39891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.575227 30988 raft_consensus.cc:515] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.602869 30988 leader_election.cc:290] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Requested vote from peers 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769), 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189)
I20260709 13:10:09.605378 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:09.605903 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:09.606251 30752 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.606637 30829 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.606781 30944 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.609174 30944 ts_tablet_manager.cc:1403] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.008s
I20260709 13:10:09.602805 30971 leader_election.cc:290] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.612103 30649 catalog_manager.cc:5697] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.614974 30944 raft_consensus.cc:359] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.615804 30944 raft_consensus.cc:385] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.615669 30829 raft_consensus.cc:2468] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 1.
I20260709 13:10:09.616207 30944 raft_consensus.cc:740] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.616973 30944 consensus_queue.cc:260] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.617268 30866 leader_election.cc:304] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.618503 30946 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.618659 30989 raft_consensus.cc:2804] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.619454 30989 raft_consensus.cc:697] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:09.620625 30989 consensus_queue.cc:237] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.622751 30752 raft_consensus.cc:2468] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 1.
I20260709 13:10:09.619115 30946 ts_tablet_manager.cc:1403] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.012s
I20260709 13:10:09.622393 30944 ts_tablet_manager.cc:1434] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:09.625607 30944 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.626590 30985 raft_consensus.cc:515] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.621222 30753 raft_consensus.cc:2468] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 1.
I20260709 13:10:09.626932 30946 raft_consensus.cc:359] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.628746 30792 leader_election.cc:304] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 162c5efd182141119904db2a7071b578
I20260709 13:10:09.628966 30946 raft_consensus.cc:385] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.630213 30946 raft_consensus.cc:740] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.630461 30971 raft_consensus.cc:2804] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.632001 30944 tablet_bootstrap.cc:654] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.631928 30971 raft_consensus.cc:697] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:09.632933 30971 consensus_queue.cc:237] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.634791 30943 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.635313 30943 ts_tablet_manager.cc:1403] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.007s
I20260709 13:10:09.631282 30946 consensus_queue.cc:260] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.638372 30943 raft_consensus.cc:359] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.639120 30943 raft_consensus.cc:385] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.639384 30943 raft_consensus.cc:740] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.639591 30946 ts_tablet_manager.cc:1434] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:09.639940 30649 catalog_manager.cc:5697] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.642860 30951 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.643411 30951 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.644465 30943 consensus_queue.cc:260] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.645694 30951 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.647346 30943 ts_tablet_manager.cc:1434] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:09.650038 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:09.651032 30828 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c7cec569f24c72869298ad09030032 in term 0.
I20260709 13:10:09.652338 30946 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.648312 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:09.655961 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:09.656669 30828 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.652038 30650 catalog_manager.cc:5697] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.652714 30717 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.665233 30946 tablet_bootstrap.cc:654] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.666282 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:09.666956 30752 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:09.668787 30718 leader_election.cc:343] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 162c5efd182141119904db2a7071b578 (127.20.69.3:39891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.671409 30944 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.671962 30944 ts_tablet_manager.cc:1403] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.004s
I20260709 13:10:09.674775 30944 raft_consensus.cc:359] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.675211 30946 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.675460 30944 raft_consensus.cc:385] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.675802 30946 ts_tablet_manager.cc:1403] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:10:09.654791 30985 leader_election.cc:290] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:09.675813 30944 raft_consensus.cc:740] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.654209 30943 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.678064 30944 consensus_queue.cc:260] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.678947 30946 raft_consensus.cc:359] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.679647 30946 raft_consensus.cc:385] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.679898 30946 raft_consensus.cc:740] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.680328 30944 ts_tablet_manager.cc:1434] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:10:09.681641 30944 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578: Bootstrap starting.
I20260709 13:10:09.680574 30946 consensus_queue.cc:260] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.685238 30951 raft_consensus.cc:2804] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.685683 30951 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.686054 30951 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.688237 30649 catalog_manager.cc:5697] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.689911 30828 raft_consensus.cc:2468] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 1.
I20260709 13:10:09.690701 30944 tablet_bootstrap.cc:654] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.691388 30866 leader_election.cc:304] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.692272 30985 raft_consensus.cc:2804] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.692457 30752 raft_consensus.cc:2468] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 1.
I20260709 13:10:09.692866 30985 raft_consensus.cc:697] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:09.693853 30985 consensus_queue.cc:237] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.701088 30943 tablet_bootstrap.cc:654] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.702538 30951 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.705762 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:09.706372 30828 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.714309 30943 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.714901 30946 ts_tablet_manager.cc:1434] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:10:09.715128 30943 ts_tablet_manager.cc:1403] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.003s
I20260709 13:10:09.720077 30946 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:09.719164 30943 raft_consensus.cc:359] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.721727 30943 raft_consensus.cc:385] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.722148 30943 raft_consensus.cc:740] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.723271 30943 consensus_queue.cc:260] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.725698 30951 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 election: Requested vote from peers 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:09.728983 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "44c7cec569f24c72869298ad09030032" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:09.729787 30902 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.729833 30943 ts_tablet_manager.cc:1434] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:10:09.731055 30943 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5: Bootstrap starting.
I20260709 13:10:09.728307 30828 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c7cec569f24c72869298ad09030032 in term 1.
I20260709 13:10:09.733662 30717 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.735776 30946 tablet_bootstrap.cc:654] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.736720 30943 tablet_bootstrap.cc:654] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.738241 30902 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c7cec569f24c72869298ad09030032 in term 1.
I20260709 13:10:09.741285 30944 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578: No bootstrap required, opened a new log
I20260709 13:10:09.742296 30944 ts_tablet_manager.cc:1403] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.023s
I20260709 13:10:09.745093 30951 raft_consensus.cc:2804] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.746429 30944 raft_consensus.cc:359] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.747651 30944 raft_consensus.cc:385] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.748051 30944 raft_consensus.cc:740] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.751025 30944 consensus_queue.cc:260] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.754580 30944 ts_tablet_manager.cc:1434] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:10:09.748272 30951 raft_consensus.cc:697] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 1 LEADER]: Becoming Leader. State: Replica: 44c7cec569f24c72869298ad09030032, State: Running, Role: LEADER
I20260709 13:10:09.757054 30752 raft_consensus.cc:3060] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.757588 30951 consensus_queue.cc:237] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.759783 30649 catalog_manager.cc:5697] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.761312 30946 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: No bootstrap required, opened a new log
I20260709 13:10:09.761924 30946 ts_tablet_manager.cc:1403] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.014s
I20260709 13:10:09.764758 30985 raft_consensus.cc:493] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.765491 30985 raft_consensus.cc:515] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.767069 30971 consensus_queue.cc:1048] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:09.769517 30753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:09.769977 30985 leader_election.cc:290] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:09.770519 30753 raft_consensus.cc:2393] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 162c5efd182141119904db2a7071b578 in current term 1: Already voted for candidate 5a86c59861274d90944fbf7a5a72b0a5 in this term.
I20260709 13:10:09.772719 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:09.775131 30866 leader_election.cc:304] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 162c5efd182141119904db2a7071b578; no voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:09.779552 30985 raft_consensus.cc:3060] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.779814 30943 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5: No bootstrap required, opened a new log
I20260709 13:10:09.782457 30943 ts_tablet_manager.cc:1403] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.008s
I20260709 13:10:09.785571 30943 raft_consensus.cc:359] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.786307 30943 raft_consensus.cc:385] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.786605 30943 raft_consensus.cc:740] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.792091 30946 raft_consensus.cc:359] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.792784 30946 raft_consensus.cc:385] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.792747 30943 consensus_queue.cc:260] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.793304 30946 raft_consensus.cc:740] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.794834 30985 raft_consensus.cc:2749] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.794718 30946 consensus_queue.cc:260] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.795459 30943 ts_tablet_manager.cc:1434] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:09.797204 30946 ts_tablet_manager.cc:1434] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 13:10:09.798192 30649 catalog_manager.cc:5697] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c7cec569f24c72869298ad09030032 (127.20.69.1). New cstate: current_term: 1 leader_uuid: "44c7cec569f24c72869298ad09030032" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.806370 30948 consensus_queue.cc:1048] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.814941 30948 consensus_queue.cc:1048] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.827903 30753 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.834787 30971 consensus_queue.cc:1048] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.936316 30989 raft_consensus.cc:493] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.937036 30989 raft_consensus.cc:515] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.939030 30989 leader_election.cc:290] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:09.940019 30753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f70792f2c048629016c0ff7da82437" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:09.940327 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f70792f2c048629016c0ff7da82437" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:09.940770 30753 raft_consensus.cc:2468] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 0.
I20260709 13:10:09.941167 30828 raft_consensus.cc:2468] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 0.
I20260709 13:10:09.941870 30866 leader_election.cc:304] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 
I20260709 13:10:09.942719 30989 raft_consensus.cc:2804] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:09.943080 30989 raft_consensus.cc:493] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.943435 30989 raft_consensus.cc:3060] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.949043 30989 raft_consensus.cc:515] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.951388 30989 leader_election.cc:290] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:09.952081 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f70792f2c048629016c0ff7da82437" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:09.952391 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f70792f2c048629016c0ff7da82437" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:09.952854 30752 raft_consensus.cc:3060] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.953028 30828 raft_consensus.cc:3060] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:09.953282 30971 consensus_queue.cc:1048] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.960112 30828 raft_consensus.cc:2468] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 1.
I20260709 13:10:09.961141 30752 raft_consensus.cc:2468] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 1.
I20260709 13:10:09.961769 30866 leader_election.cc:304] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:09.963562 30989 raft_consensus.cc:2804] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:09.964375 30989 raft_consensus.cc:697] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:09.965636 30989 consensus_queue.cc:237] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:09.971968 30978 consensus_queue.cc:1048] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:09.980139 30649 catalog_manager.cc:5697] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 0 to 1, leader changed from <none> to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.012715 30989 consensus_queue.cc:1048] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.022854 30752 raft_consensus.cc:3060] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.032219 30952 consensus_queue.cc:1048] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.052182 30978 consensus_queue.cc:1048] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.067847 30971 consensus_queue.cc:1048] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.087963 30952 consensus_queue.cc:1048] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:10.095438 30948 raft_consensus.cc:493] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.096239 30948 raft_consensus.cc:515] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:10.099640 30948 leader_election.cc:290] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:10.100952 30903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:10.101199 30753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032" is_pre_election: true
I20260709 13:10:10.101831 30903 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 0.
I20260709 13:10:10.101950 30753 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 0.
I20260709 13:10:10.102715 30989 consensus_queue.cc:1048] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:10.103210 30792 leader_election.cc:304] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:10.104527 30948 raft_consensus.cc:2804] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.104996 30948 raft_consensus.cc:493] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.105413 30948 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.113104 30948 raft_consensus.cc:515] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:10.115146 30948 leader_election.cc:290] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:10.116137 30752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:10.116133 30903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:10.116869 30752 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.117048 30903 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.123656 30752 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 1.
I20260709 13:10:10.124577 30903 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 1.
I20260709 13:10:10.124799 30792 leader_election.cc:304] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:10.125669 30948 raft_consensus.cc:2804] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.126207 30948 raft_consensus.cc:697] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:10.126930 30948 consensus_queue.cc:237] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:10.131395 30989 consensus_queue.cc:1048] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.135535 30649 catalog_manager.cc:5697] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.143265 30985 consensus_queue.cc:1048] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:10.200947 30951 consensus_queue.cc:1048] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.213194 31026 consensus_queue.cc:1048] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:10.270220 20756 ts_manager.cc:295] Set tserver state for 44c7cec569f24c72869298ad09030032 to MAINTENANCE_MODE
I20260709 13:10:10.271170 20756 tablet_server.cc:179] TabletServer@127.20.69.1:0 shutting down...
I20260709 13:10:10.294605 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:10.295389 20756 tablet_replica.cc:333] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.296398 20756 raft_consensus.cc:2243] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.297050 20756 raft_consensus.cc:2272] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.299726 20756 tablet_replica.cc:333] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.300382 20756 raft_consensus.cc:2243] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.300869 20756 raft_consensus.cc:2272] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.303470 20756 tablet_replica.cc:333] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.304085 20756 raft_consensus.cc:2243] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.304527 20756 raft_consensus.cc:2272] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.307011 20756 tablet_replica.cc:333] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.307588 20756 raft_consensus.cc:2243] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.308029 20756 raft_consensus.cc:2272] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.310724 20756 tablet_replica.cc:333] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.311321 20756 raft_consensus.cc:2243] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.311772 20756 raft_consensus.cc:2272] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.314179 20756 tablet_replica.cc:333] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.314762 20756 raft_consensus.cc:2243] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.315680 20756 raft_consensus.cc:2272] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.318069 20756 tablet_replica.cc:333] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.318636 20756 raft_consensus.cc:2243] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.319077 20756 raft_consensus.cc:2272] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.321449 20756 tablet_replica.cc:333] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.322021 20756 raft_consensus.cc:2243] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.322420 20756 raft_consensus.cc:2272] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.324194 20756 tablet_replica.cc:333] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.324747 20756 raft_consensus.cc:2243] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.325166 20756 raft_consensus.cc:2272] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.327462 20756 tablet_replica.cc:333] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: stopping tablet replica
I20260709 13:10:10.328063 20756 raft_consensus.cc:2243] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.328459 20756 raft_consensus.cc:2272] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.357306 20756 tablet_server.cc:196] TabletServer@127.20.69.1:0 shutdown complete.
W20260709 13:10:10.428958 30792 consensus_peers.cc:597] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.441829 30792 consensus_peers.cc:597] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.460494 30792 consensus_peers.cc:597] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.461879 30985 consensus_queue.cc:1048] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:10.462992 30792 consensus_peers.cc:597] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.471414 30866 consensus_peers.cc:597] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.529736 30866 consensus_peers.cc:597] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.577596 30972 consensus_queue.cc:1048] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:10.586625 30792 consensus_peers.cc:597] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.599912 30866 consensus_peers.cc:597] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.734025 30866 consensus_peers.cc:597] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:11.141374 30866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111) [suppressed 148 similar messages]
W20260709 13:10:11.285718 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:11.713965 31035 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c7cec569f24c72869298ad09030032)
I20260709 13:10:11.714625 31035 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:11.717307 31035 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:11.717934 30985 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c7cec569f24c72869298ad09030032)
I20260709 13:10:11.718533 30985 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:11.720786 30985 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:11.727053 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5" is_pre_election: true
I20260709 13:10:11.727856 30829 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 1.
I20260709 13:10:11.729969 30903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:11.730842 30903 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 1.
I20260709 13:10:11.732398 30793 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:11.733717 31034 raft_consensus.cc:2804] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:11.734153 31034 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c7cec569f24c72869298ad09030032)
I20260709 13:10:11.734556 31034 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:11.735371 30866 leader_election.cc:336] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111)
I20260709 13:10:11.739444 30866 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 44c7cec569f24c72869298ad09030032
W20260709 13:10:11.739866 30792 leader_election.cc:336] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111)
I20260709 13:10:11.740356 30985 raft_consensus.cc:2804] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:11.740943 30985 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c7cec569f24c72869298ad09030032)
I20260709 13:10:11.741336 30985 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.741786 31034 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:11.745092 31034 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:11.745353 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:11.748870 30985 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
W20260709 13:10:11.749127 30792 leader_election.cc:336] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111)
I20260709 13:10:11.750029 30902 raft_consensus.cc:2393] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5a86c59861274d90944fbf7a5a72b0a5 in current term 2: Already voted for candidate 162c5efd182141119904db2a7071b578 in this term.
I20260709 13:10:11.750846 30985 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:11.753858 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:11.754402 30793 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a86c59861274d90944fbf7a5a72b0a5; no voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032
I20260709 13:10:11.754706 30829 raft_consensus.cc:2393] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 162c5efd182141119904db2a7071b578 in current term 2: Already voted for candidate 5a86c59861274d90944fbf7a5a72b0a5 in this term.
I20260709 13:10:11.755316 31034 raft_consensus.cc:2749] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:11.756018 30866 leader_election.cc:336] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111)
I20260709 13:10:11.756960 30866 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 162c5efd182141119904db2a7071b578; no voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:11.757694 30985 raft_consensus.cc:2749] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:12.286742 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:12.656546 30683 debug-util.cc:398] Leaking SignalData structure 0x7b0800035340 after lost signal to thread 20759
W20260709 13:10:12.657570 30683 debug-util.cc:398] Leaking SignalData structure 0x7b0800281a80 after lost signal to thread 30686
W20260709 13:10:12.658602 30683 debug-util.cc:398] Leaking SignalData structure 0x7b0800292220 after lost signal to thread 30853
W20260709 13:10:12.659524 30683 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe240 after lost signal to thread 30927
W20260709 13:10:12.831103 30792 consensus_peers.cc:597] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.944618 30866 consensus_peers.cc:597] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:12.995975 30792 consensus_peers.cc:597] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.047178 30866 consensus_peers.cc:597] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.087198 30792 consensus_peers.cc:597] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.100648 30792 consensus_peers.cc:597] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.238394 30866 consensus_peers.cc:597] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:13.287772 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:13.313369 30866 consensus_peers.cc:597] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:13.317463 31034 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.318207 31034 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:13.320456 31034 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:13.321627 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578" is_pre_election: true
I20260709 13:10:13.322326 30902 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 2.
I20260709 13:10:13.323441 30793 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:13.324349 31037 raft_consensus.cc:2804] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:13.324772 30792 leader_election.cc:336] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111)
I20260709 13:10:13.324824 31037 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.325577 31037 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:13.330402 30792 consensus_peers.cc:597] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:13.332006 31037 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:13.333873 31037 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:13.334972 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:13.335548 30902 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:13.338632 30792 leader_election.cc:336] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111)
I20260709 13:10:13.342782 30902 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 3.
I20260709 13:10:13.344136 30793 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 44c7cec569f24c72869298ad09030032
I20260709 13:10:13.345258 31037 raft_consensus.cc:2804] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:13.345724 31037 raft_consensus.cc:697] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:13.346778 31037 consensus_queue.cc:237] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:13.361164 30649 catalog_manager.cc:5697] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 1 to 3, leader changed from 44c7cec569f24c72869298ad09030032 (127.20.69.1) to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:13.862739 30792 consensus_peers.cc:597] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.942442 30902 raft_consensus.cc:1275] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:13.944253 31034 consensus_queue.cc:1048] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:14.288956 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:15.183434 30792 consensus_peers.cc:597] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:15.289984 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:15.405623 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:15.411967 31047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.412267 31048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.413825 31050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.415288 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:15.416934 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:15.417217 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:15.417402 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602615417379 us; error 0 us; skew 500 ppm
I20260709 13:10:15.417951 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:15.420365 20756 webserver.cc:533] Webserver started at http://127.20.69.1:34475/ using document root <none> and password file <none>
I20260709 13:10:15.420902 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:15.421115 20756 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:15.424804 20756 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
W20260709 13:10:15.428949 30866 consensus_peers.cc:597] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:15.430522 31055 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.431454 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:10:15.431792 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "44c7cec569f24c72869298ad09030032"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-56lb"
I20260709 13:10:15.432127 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:15.470707 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:15.471802 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:15.473318 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:15.477145 31062 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:10:15.530193 30866 consensus_peers.cc:597] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:15.537806 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:10:15.538290 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.062s	user 0.003s	sys 0.000s
I20260709 13:10:15.538650 20756 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:10:15.543851 31062 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:15.557129 31062 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.558153 31062 tablet_bootstrap.cc:492] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.558851 31062 ts_tablet_manager.cc:1403] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:10:15.561468 31062 raft_consensus.cc:359] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.562067 31062 raft_consensus.cc:740] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.562777 31062 consensus_queue.cc:260] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.565492 31062 ts_tablet_manager.cc:1434] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:15.566351 31062 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
W20260709 13:10:15.571000 30792 consensus_peers.cc:597] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:15.578787 30792 consensus_peers.cc:597] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:15.578861 31062 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.579787 31062 tablet_bootstrap.cc:492] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.580386 31062 ts_tablet_manager.cc:1403] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:15.582194 20756 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:10:15.582521 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.043s	sys 0.000s
I20260709 13:10:15.582432 31062 raft_consensus.cc:359] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.583189 31062 raft_consensus.cc:740] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.583904 31062 consensus_queue.cc:260] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.585556 31062 ts_tablet_manager.cc:1434] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:10:15.586258 31062 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:15.599270 31062 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.600140 31062 tablet_bootstrap.cc:492] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.600833 31062 ts_tablet_manager.cc:1403] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.009s
I20260709 13:10:15.603466 31062 raft_consensus.cc:359] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.604259 31062 raft_consensus.cc:740] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.605217 31062 consensus_queue.cc:260] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
W20260709 13:10:15.607372 30792 consensus_peers.cc:597] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:15.607510 31062 ts_tablet_manager.cc:1434] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:10:15.608705 31062 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
W20260709 13:10:15.618043 30866 consensus_peers.cc:597] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:15.623052 31062 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.623937 31062 tablet_bootstrap.cc:492] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.624672 31062 ts_tablet_manager.cc:1403] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.004s
I20260709 13:10:15.627096 31062 raft_consensus.cc:359] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.627787 31062 raft_consensus.cc:740] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.628562 31062 consensus_queue.cc:260] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.630095 31062 ts_tablet_manager.cc:1434] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:15.630754 31062 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
W20260709 13:10:15.639963 30792 consensus_peers.cc:597] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:15.644704 31062 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.645766 31062 tablet_bootstrap.cc:492] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.646346 31062 ts_tablet_manager.cc:1403] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:10:15.648320 31062 raft_consensus.cc:359] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.648895 31062 raft_consensus.cc:740] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.649556 31062 consensus_queue.cc:260] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.651321 31062 ts_tablet_manager.cc:1434] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:15.652047 31062 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:15.653334 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:35189
I20260709 13:10:15.653456 31124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:35189 every 8 connection(s)
I20260709 13:10:15.657877 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.672534 31062 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.673877 31062 tablet_bootstrap.cc:492] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.674850 31062 ts_tablet_manager.cc:1403] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:10:15.678418 31062 raft_consensus.cc:359] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.679468 31062 raft_consensus.cc:740] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.680685 31062 consensus_queue.cc:260] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.683357 31062 ts_tablet_manager.cc:1434] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:15.685595 31062 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:15.690507 31125 heartbeater.cc:344] Connected to a master server at 127.20.69.62:37073
I20260709 13:10:15.691277 31125 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:15.692549 31125 heartbeater.cc:507] Master 127.20.69.62:37073 requested a full tablet report, sending...
I20260709 13:10:15.699638 30649 ts_manager.cc:194] Re-registered known tserver with Master: 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189)
I20260709 13:10:15.700850 31062 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.701792 31062 tablet_bootstrap.cc:492] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.702950 31062 ts_tablet_manager.cc:1403] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:10:15.705351 30828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00a07a56a421476db11bb72bca539066"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
mode: GRACEFUL
new_leader_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:10:15.705641 31062 raft_consensus.cc:359] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.706099 30828 raft_consensus.cc:606] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Received request to transfer leadership to TS 162c5efd182141119904db2a7071b578
I20260709 13:10:15.706415 31062 raft_consensus.cc:740] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.707239 31062 consensus_queue.cc:260] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.709133 30828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
mode: GRACEFUL
new_leader_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:10:15.709319 31062 ts_tablet_manager.cc:1434] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:15.709731 30828 raft_consensus.cc:606] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Received request to transfer leadership to TS 162c5efd182141119904db2a7071b578
I20260709 13:10:15.710278 31062 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:15.710871 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:15.711432 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:15.711967 30649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36356
I20260709 13:10:15.712040 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.715761 31125 heartbeater.cc:499] Master 127.20.69.62:37073 was elected leader, sending a full tablet report...
I20260709 13:10:15.724022 31062 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.725106 31062 tablet_bootstrap.cc:492] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.725844 31062 ts_tablet_manager.cc:1403] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:10:15.728338 31062 raft_consensus.cc:359] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.729063 31062 raft_consensus.cc:740] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.729779 31062 consensus_queue.cc:260] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.731844 31062 ts_tablet_manager.cc:1434] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:15.732710 31062 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:15.744834 31062 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.745555 31062 tablet_bootstrap.cc:492] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.746065 31062 ts_tablet_manager.cc:1403] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:10:15.747783 31062 raft_consensus.cc:359] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.748262 31062 raft_consensus.cc:740] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.748860 31062 consensus_queue.cc:260] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.750537 31062 ts_tablet_manager.cc:1434] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:15.751557 31062 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Bootstrap starting.
I20260709 13:10:15.764268 31062 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:15.765092 31062 tablet_bootstrap.cc:492] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Bootstrap complete.
I20260709 13:10:15.765617 31062 ts_tablet_manager.cc:1403] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.006s
I20260709 13:10:15.767306 31062 raft_consensus.cc:359] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.767787 31062 raft_consensus.cc:740] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c7cec569f24c72869298ad09030032, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.768365 31062 consensus_queue.cc:260] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.769766 31062 ts_tablet_manager.cc:1434] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:15.848977 31034 raft_consensus.cc:993] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5: : Instructing follower 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:15.849529 31136 raft_consensus.cc:1081] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Signalling peer 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:15.851290 30902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00a07a56a421476db11bb72bca539066"
dest_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:60238
I20260709 13:10:15.851848 30902 raft_consensus.cc:493] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.852169 30902 raft_consensus.cc:3060] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.857390 30902 raft_consensus.cc:515] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.859130 30902 leader_election.cc:290] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:15.861020 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:15.861783 30828 raft_consensus.cc:3055] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.862141 30828 raft_consensus.cc:740] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:15.862985 30828 consensus_queue.cc:260] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.864125 30828 raft_consensus.cc:3060] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.871438 30828 raft_consensus.cc:2468] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 2.
I20260709 13:10:15.872289 31099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a07a56a421476db11bb72bca539066" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:15.872586 30866 leader_election.cc:304] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:15.873096 31099 raft_consensus.cc:3060] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.873595 31138 raft_consensus.cc:2804] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.874178 31138 raft_consensus.cc:697] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:15.875062 31138 consensus_queue.cc:237] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:15.888252 31099 raft_consensus.cc:2468] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 2.
I20260709 13:10:15.889153 30649 catalog_manager.cc:5697] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 1 to 2, leader changed from 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2) to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.897271 31099 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:16.074913 31034 raft_consensus.cc:993] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5: : Instructing follower 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:16.075399 31136 raft_consensus.cc:1081] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Signalling peer 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:16.077071 30902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e"
dest_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:60238
I20260709 13:10:16.077590 30902 raft_consensus.cc:493] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.077853 30902 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.083698 30902 raft_consensus.cc:515] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:16.085721 30902 leader_election.cc:290] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:16.086664 31099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:16.086956 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:16.087407 31099 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.087556 30828 raft_consensus.cc:3055] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.087988 30828 raft_consensus.cc:740] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:16.088881 30828 consensus_queue.cc:260] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:16.090205 30828 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.095335 31099 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 2.
I20260709 13:10:16.096808 30866 leader_election.cc:304] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 
I20260709 13:10:16.097554 31138 raft_consensus.cc:2804] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.097687 30828 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 2.
I20260709 13:10:16.098014 31138 raft_consensus.cc:697] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:16.099130 31138 consensus_queue.cc:237] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:16.105930 30650 catalog_manager.cc:5697] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 1 to 2, leader changed from 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2) to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.289039 31099 raft_consensus.cc:1275] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.290211 31138 consensus_queue.cc:1048] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:16.291110 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:16.302410 30828 raft_consensus.cc:1275] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.303879 31138 consensus_queue.cc:1048] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.492589 30828 raft_consensus.cc:1275] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.493959 31138 consensus_queue.cc:1048] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.503645 31099 raft_consensus.cc:1275] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.505396 31139 consensus_queue.cc:1048] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.722071 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:16.729573 30828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a725a7ea50c4709beeb1f9bb2268e70"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
mode: GRACEFUL
new_leader_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:10:16.730121 30828 raft_consensus.cc:606] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Received request to transfer leadership to TS 162c5efd182141119904db2a7071b578
I20260709 13:10:16.741967 30902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e"
dest_uuid: "162c5efd182141119904db2a7071b578"
mode: GRACEFUL
new_leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:57464
I20260709 13:10:16.742499 30902 raft_consensus.cc:606] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Received request to transfer leadership to TS 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:16.745175 30902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b88778a226fe44e89803191220d955b0"
dest_uuid: "162c5efd182141119904db2a7071b578"
mode: GRACEFUL
new_leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:57464
I20260709 13:10:16.745639 30902 raft_consensus.cc:606] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Received request to transfer leadership to TS 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:16.746616 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:16.747053 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:16.747575 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:16.942395 31046 raft_consensus.cc:993] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578: : Instructing follower 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:16.944386 31138 raft_consensus.cc:1081] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Signalling peer 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:16.946637 30829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b88778a226fe44e89803191220d955b0"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:10:16.947651 30829 raft_consensus.cc:493] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.948186 30829 raft_consensus.cc:3060] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.956804 30829 raft_consensus.cc:515] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:16.959023 30829 leader_election.cc:290] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:16.960769 31098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88778a226fe44e89803191220d955b0" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:16.961519 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88778a226fe44e89803191220d955b0" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:16.961968 31098 raft_consensus.cc:3060] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.962249 30902 raft_consensus.cc:3055] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.962620 30902 raft_consensus.cc:740] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:16.963877 30902 consensus_queue.cc:260] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:16.965886 30902 raft_consensus.cc:3060] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.972430 31098 raft_consensus.cc:2468] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 2.
I20260709 13:10:16.974304 30792 leader_election.cc:304] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:16.975390 31154 raft_consensus.cc:2804] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.975983 31154 raft_consensus.cc:697] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:16.977092 30902 raft_consensus.cc:2468] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 2.
I20260709 13:10:16.977577 31154 consensus_queue.cc:237] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:16.979972 31034 raft_consensus.cc:993] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5: : Instructing follower 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:16.980741 31034 raft_consensus.cc:1081] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Signalling peer 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:16.983222 30902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a725a7ea50c4709beeb1f9bb2268e70"
dest_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:60238
I20260709 13:10:16.983877 30902 raft_consensus.cc:493] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.984304 30902 raft_consensus.cc:3060] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.988576 30650 catalog_manager.cc:5697] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 1 to 2, leader changed from 162c5efd182141119904db2a7071b578 (127.20.69.3) to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.989969 30902 raft_consensus.cc:515] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:16.992003 30902 leader_election.cc:290] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:16.993160 31098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a725a7ea50c4709beeb1f9bb2268e70" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:16.993501 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a725a7ea50c4709beeb1f9bb2268e70" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:16.994305 30829 raft_consensus.cc:3055] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.994755 30829 raft_consensus.cc:740] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:16.994913 31098 raft_consensus.cc:3060] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.996173 30829 consensus_queue.cc:260] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:16.998577 30829 raft_consensus.cc:3060] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.005376 31098 raft_consensus.cc:2468] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 2.
I20260709 13:10:17.007020 30866 leader_election.cc:304] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 
I20260709 13:10:17.007992 31138 raft_consensus.cc:2804] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.008647 31138 raft_consensus.cc:697] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:17.010444 30829 raft_consensus.cc:2468] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 2.
I20260709 13:10:17.010119 31138 consensus_queue.cc:237] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.019678 30650 catalog_manager.cc:5697] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 1 to 2, leader changed from 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2) to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.091846 31139 raft_consensus.cc:993] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578: : Instructing follower 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:17.092391 31138 raft_consensus.cc:1081] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Signalling peer 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:17.094030 30829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:10:17.094550 30829 raft_consensus.cc:493] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.094918 30829 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.101027 30829 raft_consensus.cc:515] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.102695 30829 leader_election.cc:290] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:17.103895 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:17.103746 31098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:17.104547 30902 raft_consensus.cc:3055] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:17.104708 31098 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.104979 30902 raft_consensus.cc:740] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:17.106067 30902 consensus_queue.cc:260] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.107728 30902 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.113462 31098 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 3.
I20260709 13:10:17.114755 30792 leader_election.cc:304] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:17.115077 30902 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 3.
I20260709 13:10:17.115684 31154 raft_consensus.cc:2804] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:17.116261 31154 raft_consensus.cc:697] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:17.117395 31154 consensus_queue.cc:237] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.124126 30650 catalog_manager.cc:5697] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 2 to 3, leader changed from 162c5efd182141119904db2a7071b578 (127.20.69.3) to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:17.292405 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:17.394121 31099 raft_consensus.cc:1275] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.395496 31154 consensus_queue.cc:1048] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.403348 30829 raft_consensus.cc:1275] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.405454 31138 consensus_queue.cc:1048] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.408502 30902 raft_consensus.cc:1275] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.410202 31136 consensus_queue.cc:1048] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:17.433015 31099 raft_consensus.cc:1275] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.434469 31138 consensus_queue.cc:1048] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.539918 31099 raft_consensus.cc:1275] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:17.541500 31136 consensus_queue.cc:1048] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:17.544168 30902 raft_consensus.cc:1275] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:17.546242 31034 consensus_queue.cc:1048] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.754454 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.763813 30829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
mode: GRACEFUL
new_leader_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:10:17.764472 30829 raft_consensus.cc:606] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Received request to transfer leadership to TS 162c5efd182141119904db2a7071b578
I20260709 13:10:17.767486 30829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
mode: GRACEFUL
new_leader_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:10:17.768069 30829 raft_consensus.cc:606] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Received request to transfer leadership to TS 162c5efd182141119904db2a7071b578
I20260709 13:10:17.770923 30902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c"
dest_uuid: "162c5efd182141119904db2a7071b578"
mode: GRACEFUL
new_leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:57464
I20260709 13:10:17.771473 30902 raft_consensus.cc:606] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Received request to transfer leadership to TS 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:17.772991 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:17.773536 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:17.774276 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.794715 31159 raft_consensus.cc:993] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578: : Instructing follower 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:17.795311 31138 raft_consensus.cc:1081] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Signalling peer 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:17.797026 30829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:10:17.797531 30829 raft_consensus.cc:493] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.797847 30829 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.803246 30829 raft_consensus.cc:515] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.805107 30829 leader_election.cc:290] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:17.805861 31099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:17.806083 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:17.806563 31099 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.806639 30902 raft_consensus.cc:3055] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.807041 30902 raft_consensus.cc:740] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:17.807842 30902 consensus_queue.cc:260] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.808856 30902 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.813360 31099 raft_consensus.cc:2468] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 2.
I20260709 13:10:17.813727 30902 raft_consensus.cc:2468] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 2.
I20260709 13:10:17.814679 30792 leader_election.cc:304] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:17.815502 31136 raft_consensus.cc:2804] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.815943 31136 raft_consensus.cc:697] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:17.816812 31136 consensus_queue.cc:237] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.823573 30652 catalog_manager.cc:5697] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 1 to 2, leader changed from 162c5efd182141119904db2a7071b578 (127.20.69.3) to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.851342 31176 raft_consensus.cc:993] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5: : Instructing follower 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:17.851811 31136 raft_consensus.cc:1081] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Signalling peer 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:17.853348 30902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec"
dest_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:60238
I20260709 13:10:17.853837 30902 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.854117 30902 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.860296 30902 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.861953 30902 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 4 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:17.862713 31099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:17.862979 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:17.863547 31099 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.863721 30829 raft_consensus.cc:3055] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:17.864202 30829 raft_consensus.cc:740] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:17.865188 30829 consensus_queue.cc:260] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.866633 30829 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.871950 31099 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 4.
I20260709 13:10:17.873318 30866 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 
I20260709 13:10:17.874249 31138 raft_consensus.cc:2804] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:17.875102 30829 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 4.
I20260709 13:10:17.875581 31138 raft_consensus.cc:697] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 4 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:17.876876 31138 consensus_queue.cc:237] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.884508 30652 catalog_manager.cc:5697] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 3 to 4, leader changed from 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2) to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 4 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.937260 31154 raft_consensus.cc:993] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5: : Instructing follower 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:17.937775 31136 raft_consensus.cc:1081] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Signalling peer 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:17.939452 30902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800"
dest_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:60238
I20260709 13:10:17.939924 30902 raft_consensus.cc:493] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.940209 30902 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.945320 30902 raft_consensus.cc:515] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.946784 30902 leader_election.cc:290] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:17.947762 31099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:17.948016 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:17.948551 31099 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.948706 30829 raft_consensus.cc:3055] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.949108 30829 raft_consensus.cc:740] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:17.949985 30829 consensus_queue.cc:260] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.951094 30829 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.954298 31099 raft_consensus.cc:2468] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 2.
I20260709 13:10:17.955662 30866 leader_election.cc:304] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 
I20260709 13:10:17.956351 31138 raft_consensus.cc:2804] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.956894 31138 raft_consensus.cc:697] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:17.958314 30829 raft_consensus.cc:2468] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 2.
I20260709 13:10:17.957990 31138 consensus_queue.cc:237] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:17.965952 30652 catalog_manager.cc:5697] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 1 to 2, leader changed from 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2) to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:18.293519 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:18.359923 31099 raft_consensus.cc:1275] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.361428 31136 consensus_queue.cc:1048] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.368124 30902 raft_consensus.cc:1275] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.370111 31136 consensus_queue.cc:1048] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:18.393851 31099 raft_consensus.cc:1275] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 4 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:18.395033 31138 consensus_queue.cc:1048] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.405936 30829 raft_consensus.cc:1275] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 4 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:18.408419 31138 consensus_queue.cc:1048] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.432952 30829 raft_consensus.cc:1275] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.434278 31159 consensus_queue.cc:1048] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.443593 31099 raft_consensus.cc:1275] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.445673 31190 consensus_queue.cc:1048] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.780689 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.788125 30902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec"
dest_uuid: "162c5efd182141119904db2a7071b578"
mode: GRACEFUL
new_leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:57464
I20260709 13:10:18.788743 30902 raft_consensus.cc:606] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 4 LEADER]: Received request to transfer leadership to TS 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:18.791455 30829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
mode: GRACEFUL
new_leader_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:10:18.791961 30829 raft_consensus.cc:606] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Received request to transfer leadership to TS 162c5efd182141119904db2a7071b578
I20260709 13:10:18.794659 30902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d"
dest_uuid: "162c5efd182141119904db2a7071b578"
mode: GRACEFUL
new_leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:57464
I20260709 13:10:18.795173 30902 raft_consensus.cc:606] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Received request to transfer leadership to TS 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:18.796294 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:18.796857 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:18.797483 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.854176 31159 raft_consensus.cc:993] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578: : Instructing follower 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:18.854620 31159 raft_consensus.cc:1081] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Signalling peer 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:18.856058 30829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:10:18.856582 30829 raft_consensus.cc:493] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.856895 30829 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.862666 30829 raft_consensus.cc:515] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:18.864698 30829 leader_election.cc:290] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:18.865584 31098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:18.865971 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:18.866262 31098 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.866551 30902 raft_consensus.cc:3055] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.866868 30902 raft_consensus.cc:740] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:18.867630 30902 consensus_queue.cc:260] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:18.868430 30902 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.872740 31098 raft_consensus.cc:2468] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 2.
I20260709 13:10:18.873984 30792 leader_election.cc:304] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:18.874267 30902 raft_consensus.cc:2468] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 2.
I20260709 13:10:18.874744 31136 raft_consensus.cc:2804] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.875298 31136 raft_consensus.cc:697] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:18.876206 31136 consensus_queue.cc:237] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:18.883500 30649 catalog_manager.cc:5697] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 1 to 2, leader changed from 162c5efd182141119904db2a7071b578 (127.20.69.3) to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.979843 31159 raft_consensus.cc:993] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578: : Instructing follower 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:18.982540 31159 raft_consensus.cc:1081] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 4 LEADER]: Signalling peer 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:18.984828 30829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:10:18.985445 30829 raft_consensus.cc:493] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.985801 30829 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.992223 30829 raft_consensus.cc:515] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:18.993953 30829 leader_election.cc:290] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 5 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:18.994653 31098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:18.994974 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b8b40037ae4412bad58fc32afe9dec" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:18.995373 31098 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:18.995590 30902 raft_consensus.cc:3055] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:18.995975 30902 raft_consensus.cc:740] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:18.996580 30902 consensus_queue.cc:260] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:18.997841 30902 raft_consensus.cc:3060] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.001246 31098 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 5.
I20260709 13:10:19.002475 30792 leader_election.cc:304] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:19.002800 30902 raft_consensus.cc:2468] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 5.
I20260709 13:10:19.003492 31199 raft_consensus.cc:2804] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:19.004069 31199 raft_consensus.cc:697] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 5 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:19.004922 31199 consensus_queue.cc:237] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.011116 30652 catalog_manager.cc:5697] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 4 to 5, leader changed from 162c5efd182141119904db2a7071b578 (127.20.69.3) to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 5 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.074200 31176 raft_consensus.cc:993] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5: : Instructing follower 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:19.074651 31199 raft_consensus.cc:1081] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Signalling peer 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:19.076217 30902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e"
dest_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:60238
I20260709 13:10:19.076726 30902 raft_consensus.cc:493] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.077005 30902 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.082010 30902 raft_consensus.cc:515] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.083688 30902 leader_election.cc:290] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 4 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:19.085083 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:19.085189 31098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a22f62a6544f509f4f5a6f1b4ef21e" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:19.085979 30828 raft_consensus.cc:3055] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:19.086246 31098 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.086385 30828 raft_consensus.cc:740] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:19.087357 30828 consensus_queue.cc:260] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.088783 30828 raft_consensus.cc:3060] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.094211 31098 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 4.
I20260709 13:10:19.095707 30866 leader_election.cc:304] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 
I20260709 13:10:19.096416 31159 raft_consensus.cc:2804] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:19.096787 30828 raft_consensus.cc:2468] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 4.
I20260709 13:10:19.096980 31159 raft_consensus.cc:697] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 4 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:19.097910 31159 consensus_queue.cc:237] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.106117 30652 catalog_manager.cc:5697] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 3 to 4, leader changed from 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2) to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 4 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:19.294521 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:19.359658 30902 raft_consensus.cc:1275] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.361107 31199 consensus_queue.cc:1048] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.371870 31098 raft_consensus.cc:1275] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.373473 31199 consensus_queue.cc:1048] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.484683 31098 raft_consensus.cc:1275] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 4 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:19.486004 31159 consensus_queue.cc:1048] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.496348 30828 raft_consensus.cc:1275] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 4 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:19.497875 31159 consensus_queue.cc:1048] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.543443 30902 raft_consensus.cc:1275] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 5 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:19.544899 31136 consensus_queue.cc:1048] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.554670 31098 raft_consensus.cc:1275] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 5 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:19.558804 31199 consensus_queue.cc:1048] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.803817 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.811206 30902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800"
dest_uuid: "162c5efd182141119904db2a7071b578"
mode: GRACEFUL
new_leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:57464
I20260709 13:10:19.811671 30902 raft_consensus.cc:606] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Received request to transfer leadership to TS 5a86c59861274d90944fbf7a5a72b0a5
I20260709 13:10:19.814046 30828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
mode: GRACEFUL
new_leader_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:10:19.814530 30828 raft_consensus.cc:606] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Received request to transfer leadership to TS 162c5efd182141119904db2a7071b578
I20260709 13:10:19.816865 30828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
mode: GRACEFUL
new_leader_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:10:19.817322 30828 raft_consensus.cc:606] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Received request to transfer leadership to TS 162c5efd182141119904db2a7071b578
I20260709 13:10:19.818413 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:19.818861 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:19.819352 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.910653 31176 raft_consensus.cc:993] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5: : Instructing follower 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:19.911087 31199 raft_consensus.cc:1081] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Signalling peer 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:19.912539 30902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c"
dest_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:60238
I20260709 13:10:19.913030 30902 raft_consensus.cc:493] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.913302 30902 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.917966 30902 raft_consensus.cc:515] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.919381 30902 leader_election.cc:290] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 3 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769)
I20260709 13:10:19.920524 30828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:19.920682 31098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd578d9e4422fa529d9722c14b37c" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:19.921140 30828 raft_consensus.cc:3055] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:19.921394 31098 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.921497 30828 raft_consensus.cc:740] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:19.922436 30828 consensus_queue.cc:260] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.923312 30828 raft_consensus.cc:3060] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.927451 31098 raft_consensus.cc:2468] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 3.
I20260709 13:10:19.927664 30828 raft_consensus.cc:2468] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 3.
I20260709 13:10:19.928956 30866 leader_election.cc:304] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 
I20260709 13:10:19.929638 31208 raft_consensus.cc:2804] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:19.930040 31208 raft_consensus.cc:697] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 3 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:19.930773 31208 consensus_queue.cc:237] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.937125 30652 catalog_manager.cc:5697] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 2 to 3, leader changed from 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2) to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.978933 31176 raft_consensus.cc:993] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5: : Instructing follower 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:19.979502 31199 raft_consensus.cc:1081] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Signalling peer 162c5efd182141119904db2a7071b578 to start an election
I20260709 13:10:19.980170 31159 raft_consensus.cc:993] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578: : Instructing follower 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:19.980726 31208 raft_consensus.cc:1081] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Signalling peer 5a86c59861274d90944fbf7a5a72b0a5 to start an election
I20260709 13:10:19.981288 30902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d"
dest_uuid: "162c5efd182141119904db2a7071b578"
 from {username='slave'} at 127.0.0.1:60238
I20260709 13:10:19.981865 30902 raft_consensus.cc:493] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.982156 30828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800"
dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
 from {username='slave'} at 127.0.0.1:41034
I20260709 13:10:19.982152 30902 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.982681 30828 raft_consensus.cc:493] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.982990 30828 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.988698 30902 raft_consensus.cc:515] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.990458 30902 leader_election.cc:290] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 3 election: Requested vote from peers 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769), 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189)
I20260709 13:10:19.990448 30828 raft_consensus.cc:515] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.991818 31098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:19.991881 30829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae411bee00d4a468d3b397059d72d9d" candidate_uuid: "162c5efd182141119904db2a7071b578" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a86c59861274d90944fbf7a5a72b0a5"
I20260709 13:10:19.992496 31098 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.992539 30829 raft_consensus.cc:3055] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:19.993022 30829 raft_consensus.cc:740] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:19.993510 30828 leader_election.cc:290] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 election: Requested vote from peers 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189), 162c5efd182141119904db2a7071b578 (127.20.69.3:39891)
I20260709 13:10:19.993957 30829 consensus_queue.cc:260] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.994562 30902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "162c5efd182141119904db2a7071b578"
I20260709 13:10:19.995162 30902 raft_consensus.cc:3055] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:19.995208 30829 raft_consensus.cc:3060] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.995193 31099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02342efb5241f7aa87b80a37643800" candidate_uuid: "5a86c59861274d90944fbf7a5a72b0a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44c7cec569f24c72869298ad09030032"
I20260709 13:10:19.995654 30902 raft_consensus.cc:740] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:19.996186 31099 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.996683 30902 consensus_queue.cc:260] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:19.997992 30902 raft_consensus.cc:3060] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:20.000237 31098 raft_consensus.cc:2468] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 3.
I20260709 13:10:20.003235 30866 leader_election.cc:304] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162c5efd182141119904db2a7071b578, 44c7cec569f24c72869298ad09030032; no voters: 
I20260709 13:10:20.003747 30829 raft_consensus.cc:2468] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162c5efd182141119904db2a7071b578 in term 3.
I20260709 13:10:20.004071 31208 raft_consensus.cc:2804] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:20.004629 31208 raft_consensus.cc:697] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 3 LEADER]: Becoming Leader. State: Replica: 162c5efd182141119904db2a7071b578, State: Running, Role: LEADER
I20260709 13:10:20.003747 31099 raft_consensus.cc:2468] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 3.
I20260709 13:10:20.005209 30902 raft_consensus.cc:2468] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a86c59861274d90944fbf7a5a72b0a5 in term 3.
I20260709 13:10:20.005522 31208 consensus_queue.cc:237] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:20.006414 30792 leader_election.cc:304] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c7cec569f24c72869298ad09030032, 5a86c59861274d90944fbf7a5a72b0a5; no voters: 
I20260709 13:10:20.007225 31199 raft_consensus.cc:2804] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:20.007766 31199 raft_consensus.cc:697] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Becoming Leader. State: Replica: 5a86c59861274d90944fbf7a5a72b0a5, State: Running, Role: LEADER
I20260709 13:10:20.008533 31199 consensus_queue.cc:237] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } }
I20260709 13:10:20.013762 30652 catalog_manager.cc:5697] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 reported cstate change: term changed from 2 to 3, leader changed from 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2) to 162c5efd182141119904db2a7071b578 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "162c5efd182141119904db2a7071b578" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.016970 30649 catalog_manager.cc:5697] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 reported cstate change: term changed from 2 to 3, leader changed from 162c5efd182141119904db2a7071b578 (127.20.69.3) to 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2). New cstate: current_term: 3 leader_uuid: "5a86c59861274d90944fbf7a5a72b0a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:20.295583 30700 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:20.386077 30829 raft_consensus.cc:1275] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:20.387458 31208 consensus_queue.cc:1048] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.398118 31099 raft_consensus.cc:1275] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:20.400528 31208 consensus_queue.cc:1048] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.480497 30902 raft_consensus.cc:1275] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:20.481832 31199 consensus_queue.cc:1048] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "162c5efd182141119904db2a7071b578" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 39891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.492442 31099 raft_consensus.cc:1275] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Refusing update from remote peer 5a86c59861274d90944fbf7a5a72b0a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:20.494179 31226 consensus_queue.cc:1048] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.531630 31099 raft_consensus.cc:1275] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:20.533051 31208 consensus_queue.cc:1048] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c7cec569f24c72869298ad09030032" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.541923 30829 raft_consensus.cc:1275] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Refusing update from remote peer 162c5efd182141119904db2a7071b578: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:20.544162 31220 consensus_queue.cc:1048] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a86c59861274d90944fbf7a5a72b0a5" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.825348 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:20.857630 20756 tablet_server.cc:179] TabletServer@127.20.69.1:35189 shutting down...
I20260709 13:10:20.885187 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:20.885972 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.886657 20756 raft_consensus.cc:2243] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.887104 20756 raft_consensus.cc:2272] T de3dd578d9e4422fa529d9722c14b37c P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.890177 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.890784 20756 raft_consensus.cc:2243] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.891253 20756 raft_consensus.cc:2272] T 00a07a56a421476db11bb72bca539066 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.893509 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.894091 20756 raft_consensus.cc:2243] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.894457 20756 raft_consensus.cc:2272] T a6f665ec66ea4a8b8bbd6e079e564149 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.896945 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.897460 20756 raft_consensus.cc:2243] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.897848 20756 raft_consensus.cc:2272] T 68b8b40037ae4412bad58fc32afe9dec P 44c7cec569f24c72869298ad09030032 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.900012 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.900484 20756 raft_consensus.cc:2243] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.900991 20756 raft_consensus.cc:2272] T 18f70792f2c048629016c0ff7da82437 P 44c7cec569f24c72869298ad09030032 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.903111 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.903606 20756 raft_consensus.cc:2243] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.903995 20756 raft_consensus.cc:2272] T eae411bee00d4a468d3b397059d72d9d P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.906953 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.907459 20756 raft_consensus.cc:2243] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.907823 20756 raft_consensus.cc:2272] T 0a725a7ea50c4709beeb1f9bb2268e70 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.910007 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.910471 20756 raft_consensus.cc:2243] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.910919 20756 raft_consensus.cc:2272] T b88778a226fe44e89803191220d955b0 P 44c7cec569f24c72869298ad09030032 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.913786 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.914496 20756 raft_consensus.cc:2243] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.914971 20756 raft_consensus.cc:2272] T bc02342efb5241f7aa87b80a37643800 P 44c7cec569f24c72869298ad09030032 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.918370 20756 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:20.918951 20756 raft_consensus.cc:2243] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.919461 20756 raft_consensus.cc:2272] T 82a22f62a6544f509f4f5a6f1b4ef21e P 44c7cec569f24c72869298ad09030032 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:20.925544 30866 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 93 similar messages]
W20260709 13:10:20.930099 30866 consensus_peers.cc:597] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:20.943877 30866 consensus_peers.cc:597] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.949077 20756 tablet_server.cc:196] TabletServer@127.20.69.1:35189 shutdown complete.
I20260709 13:10:20.976435 20756 tablet_server.cc:179] TabletServer@127.20.69.2:0 shutting down...
W20260709 13:10:20.985463 30866 consensus_peers.cc:597] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 -> Peer 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769): Couldn't send request to peer 5a86c59861274d90944fbf7a5a72b0a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.015483 30792 consensus_peers.cc:597] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.016031 30866 consensus_peers.cc:597] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.021763 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:21.022536 20756 tablet_replica.cc:333] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.023267 20756 raft_consensus.cc:2243] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.023697 20756 raft_consensus.cc:2272] T 82a22f62a6544f509f4f5a6f1b4ef21e P 5a86c59861274d90944fbf7a5a72b0a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.026551 20756 tablet_replica.cc:333] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.027303 20756 raft_consensus.cc:2243] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.027779 20756 raft_consensus.cc:2272] T de3dd578d9e4422fa529d9722c14b37c P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.030824 20756 tablet_replica.cc:333] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.031472 20756 raft_consensus.cc:2243] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.031971 20756 raft_consensus.cc:2272] T 00a07a56a421476db11bb72bca539066 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.034482 20756 tablet_replica.cc:333] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.035073 20756 raft_consensus.cc:2243] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.035562 20756 raft_consensus.cc:2272] T 18f70792f2c048629016c0ff7da82437 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.038077 20756 tablet_replica.cc:333] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.038870 20756 raft_consensus.cc:2243] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.039286 20756 raft_consensus.cc:2272] T eae411bee00d4a468d3b397059d72d9d P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.042199 20756 tablet_replica.cc:333] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.042744 20756 raft_consensus.cc:2243] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.043128 20756 raft_consensus.cc:2272] T 0a725a7ea50c4709beeb1f9bb2268e70 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.045353 20756 tablet_replica.cc:333] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.045907 20756 raft_consensus.cc:2243] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.046708 20756 raft_consensus.cc:2272] T bc02342efb5241f7aa87b80a37643800 P 5a86c59861274d90944fbf7a5a72b0a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.049661 20756 tablet_replica.cc:333] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.050202 20756 raft_consensus.cc:2243] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.051050 20756 raft_consensus.cc:2272] T b88778a226fe44e89803191220d955b0 P 5a86c59861274d90944fbf7a5a72b0a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.053974 20756 tablet_replica.cc:333] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
W20260709 13:10:21.054737 30866 consensus_peers.cc:597] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 -> Peer 5a86c59861274d90944fbf7a5a72b0a5 (127.20.69.2:34769): Couldn't send request to peer 5a86c59861274d90944fbf7a5a72b0a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.054745 20756 raft_consensus.cc:2243] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.055760 20756 raft_consensus.cc:2272] T 68b8b40037ae4412bad58fc32afe9dec P 5a86c59861274d90944fbf7a5a72b0a5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.058004 20756 tablet_replica.cc:333] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5: stopping tablet replica
I20260709 13:10:21.058557 20756 raft_consensus.cc:2243] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.059473 20756 raft_consensus.cc:2272] T a6f665ec66ea4a8b8bbd6e079e564149 P 5a86c59861274d90944fbf7a5a72b0a5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.089551 30866 consensus_peers.cc:597] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.093137 20756 tablet_server.cc:196] TabletServer@127.20.69.2:0 shutdown complete.
W20260709 13:10:21.108278 30866 consensus_peers.cc:597] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.111197 30866 consensus_peers.cc:597] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 -> Peer 44c7cec569f24c72869298ad09030032 (127.20.69.1:35189): Couldn't send request to peer 44c7cec569f24c72869298ad09030032. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35189: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.120740 20756 tablet_server.cc:179] TabletServer@127.20.69.3:0 shutting down...
I20260709 13:10:21.157747 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:21.158459 20756 tablet_replica.cc:333] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.159201 20756 raft_consensus.cc:2243] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.160144 20756 raft_consensus.cc:2272] T 82a22f62a6544f509f4f5a6f1b4ef21e P 162c5efd182141119904db2a7071b578 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.162590 20756 tablet_replica.cc:333] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.163198 20756 raft_consensus.cc:2243] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.164122 20756 raft_consensus.cc:2272] T 00a07a56a421476db11bb72bca539066 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.166319 20756 tablet_replica.cc:333] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.166872 20756 raft_consensus.cc:2243] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.167754 20756 raft_consensus.cc:2272] T 18f70792f2c048629016c0ff7da82437 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.170018 20756 tablet_replica.cc:333] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.170644 20756 raft_consensus.cc:2243] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.171437 20756 raft_consensus.cc:2272] T eae411bee00d4a468d3b397059d72d9d P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.174233 20756 tablet_replica.cc:333] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.174798 20756 raft_consensus.cc:2243] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.175557 20756 raft_consensus.cc:2272] T 0a725a7ea50c4709beeb1f9bb2268e70 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.177839 20756 tablet_replica.cc:333] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.178419 20756 raft_consensus.cc:2243] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.178857 20756 raft_consensus.cc:2272] T bc02342efb5241f7aa87b80a37643800 P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.181576 20756 tablet_replica.cc:333] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.182165 20756 raft_consensus.cc:2243] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.182600 20756 raft_consensus.cc:2272] T b88778a226fe44e89803191220d955b0 P 162c5efd182141119904db2a7071b578 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.184696 20756 tablet_replica.cc:333] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.185235 20756 raft_consensus.cc:2243] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.186004 20756 raft_consensus.cc:2272] T de3dd578d9e4422fa529d9722c14b37c P 162c5efd182141119904db2a7071b578 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.188715 20756 tablet_replica.cc:333] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.189270 20756 raft_consensus.cc:2243] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.189716 20756 raft_consensus.cc:2272] T 68b8b40037ae4412bad58fc32afe9dec P 162c5efd182141119904db2a7071b578 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.191781 20756 tablet_replica.cc:333] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578: stopping tablet replica
I20260709 13:10:21.192262 20756 raft_consensus.cc:2243] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.192766 20756 raft_consensus.cc:2272] T a6f665ec66ea4a8b8bbd6e079e564149 P 162c5efd182141119904db2a7071b578 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.227053 20756 tablet_server.cc:196] TabletServer@127.20.69.3:0 shutdown complete.
I20260709 13:10:21.256863 20756 master.cc:562] Master@127.20.69.62:37073 shutting down...
I20260709 13:10:21.282730 20756 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.283313 20756 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.283682 20756 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6a5a876e89024425aec0a827b2b43455: stopping tablet replica
I20260709 13:10:21.320320 20756 master.cc:584] Master@127.20.69.62:37073 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13268 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:10:21.368523 20756 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.69.62:35279
I20260709 13:10:21.369840 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.375552 31238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.376232 31239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.377904 31241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.380084 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:21.381645 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.381863 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.382030 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602621382011 us; error 0 us; skew 500 ppm
I20260709 13:10:21.382576 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.385087 20756 webserver.cc:533] Webserver started at http://127.20.69.62:35021/ using document root <none> and password file <none>
I20260709 13:10:21.385649 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.385850 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.386128 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.387284 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/master-0-root/instance:
uuid: "37dd45196c41404295f9bef8ff628ef6"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-56lb"
I20260709 13:10:21.391878 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:10:21.395416 31246 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.396308 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:21.396657 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/master-0-root
uuid: "37dd45196c41404295f9bef8ff628ef6"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-56lb"
I20260709 13:10:21.396974 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.416072 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.417467 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.457612 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.62:35279
I20260709 13:10:21.457742 31297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.62:35279 every 8 connection(s)
I20260709 13:10:21.461707 31298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.474887 31298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6: Bootstrap starting.
I20260709 13:10:21.481823 31298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.486235 31298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6: No bootstrap required, opened a new log
I20260709 13:10:21.488471 31298 raft_consensus.cc:359] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd45196c41404295f9bef8ff628ef6" member_type: VOTER }
I20260709 13:10:21.489019 31298 raft_consensus.cc:385] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.489262 31298 raft_consensus.cc:740] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37dd45196c41404295f9bef8ff628ef6, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.489830 31298 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd45196c41404295f9bef8ff628ef6" member_type: VOTER }
I20260709 13:10:21.490298 31298 raft_consensus.cc:399] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:21.490540 31298 raft_consensus.cc:493] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:21.490796 31298 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.495775 31298 raft_consensus.cc:515] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd45196c41404295f9bef8ff628ef6" member_type: VOTER }
I20260709 13:10:21.496382 31298 leader_election.cc:304] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37dd45196c41404295f9bef8ff628ef6; no voters: 
I20260709 13:10:21.497552 31298 leader_election.cc:290] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:21.497902 31301 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:21.499346 31301 raft_consensus.cc:697] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 1 LEADER]: Becoming Leader. State: Replica: 37dd45196c41404295f9bef8ff628ef6, State: Running, Role: LEADER
I20260709 13:10:21.499965 31301 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd45196c41404295f9bef8ff628ef6" member_type: VOTER }
I20260709 13:10:21.500747 31298 sys_catalog.cc:565] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:21.504664 31303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37dd45196c41404295f9bef8ff628ef6. Latest consensus state: current_term: 1 leader_uuid: "37dd45196c41404295f9bef8ff628ef6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd45196c41404295f9bef8ff628ef6" member_type: VOTER } }
I20260709 13:10:21.505510 31303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:21.509155 31302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37dd45196c41404295f9bef8ff628ef6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd45196c41404295f9bef8ff628ef6" member_type: VOTER } }
I20260709 13:10:21.509845 31302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:21.513007 31307 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:21.521418 31307 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:21.523310 20756 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:21.530969 31307 catalog_manager.cc:1383] Generated new cluster ID: 866631ce249b4f4eaac2552031eefaf2
I20260709 13:10:21.531296 31307 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:21.568464 31307 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:21.569969 31307 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:21.582899 31307 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6: Generated new TSK 0
I20260709 13:10:21.583582 31307 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:21.590111 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.596089 31319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.597416 31320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.599184 20756 server_base.cc:1061] running on GCE node
W20260709 13:10:21.599985 31322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.601111 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.601308 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.601436 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602621601419 us; error 0 us; skew 500 ppm
I20260709 13:10:21.601974 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.604492 20756 webserver.cc:533] Webserver started at http://127.20.69.1:44471/ using document root <none> and password file <none>
I20260709 13:10:21.605029 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.605199 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.605412 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.606487 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-0-root/instance:
uuid: "801f02741034480fa8178c01ea87163a"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-56lb"
I20260709 13:10:21.611212 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:21.614728 31327 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.615546 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:21.615876 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "801f02741034480fa8178c01ea87163a"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-56lb"
I20260709 13:10:21.616207 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.626837 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.628130 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.629788 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:21.632086 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:21.632356 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.632652 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:21.632863 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:10:21.674105 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:45377
I20260709 13:10:21.674232 31389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:45377 every 8 connection(s)
I20260709 13:10:21.679461 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.687187 31394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.690642 31395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.694233 31397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.694509 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:21.696246 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:21.696276 31390 heartbeater.cc:344] Connected to a master server at 127.20.69.62:35279
W20260709 13:10:21.696508 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.696815 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602621696798 us; error 0 us; skew 500 ppm
I20260709 13:10:21.696818 31390 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:21.697466 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.697757 31390 heartbeater.cc:507] Master 127.20.69.62:35279 requested a full tablet report, sending...
I20260709 13:10:21.700418 31263 ts_manager.cc:194] Registered new tserver with Master: 801f02741034480fa8178c01ea87163a (127.20.69.1:45377)
I20260709 13:10:21.700472 20756 webserver.cc:533] Webserver started at http://127.20.69.2:45525/ using document root <none> and password file <none>
I20260709 13:10:21.701285 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.701532 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.701845 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.702587 31263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44054
I20260709 13:10:21.703325 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-1-root/instance:
uuid: "c4172471398648349704055958e0353b"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-56lb"
I20260709 13:10:21.708412 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:10:21.711790 31402 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.712580 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:21.712936 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-1-root
uuid: "c4172471398648349704055958e0353b"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-56lb"
I20260709 13:10:21.713183 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.767648 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.768959 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.770454 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:21.772768 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:21.772953 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.773301 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:21.773461 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.817512 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.2:33891
I20260709 13:10:21.817632 31464 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.2:33891 every 8 connection(s)
I20260709 13:10:21.822571 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.830760 31468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.831902 31469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.835615 31465 heartbeater.cc:344] Connected to a master server at 127.20.69.62:35279
I20260709 13:10:21.836216 31465 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:21.836946 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:21.837319 31465 heartbeater.cc:507] Master 127.20.69.62:35279 requested a full tablet report, sending...
W20260709 13:10:21.837957 31471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.838950 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.839237 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.839450 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602621839430 us; error 0 us; skew 500 ppm
I20260709 13:10:21.839745 31263 ts_manager.cc:194] Registered new tserver with Master: c4172471398648349704055958e0353b (127.20.69.2:33891)
I20260709 13:10:21.840200 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.841388 31263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44060
I20260709 13:10:21.847729 20756 webserver.cc:533] Webserver started at http://127.20.69.3:44465/ using document root <none> and password file <none>
I20260709 13:10:21.848407 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.848658 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.848937 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.850108 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-2-root/instance:
uuid: "4850b200679441e2a1e339e356206d68"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-56lb"
I20260709 13:10:21.854617 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:21.858021 31476 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.858814 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:21.859133 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-2-root
uuid: "4850b200679441e2a1e339e356206d68"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-56lb"
I20260709 13:10:21.859402 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602306874617-20756-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.881615 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.882900 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.884424 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:21.886801 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:21.887051 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.887306 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:21.887490 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.930249 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.3:34077
I20260709 13:10:21.930403 31538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.3:34077 every 8 connection(s)
I20260709 13:10:21.944406 31539 heartbeater.cc:344] Connected to a master server at 127.20.69.62:35279
I20260709 13:10:21.944844 31539 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:21.945602 31539 heartbeater.cc:507] Master 127.20.69.62:35279 requested a full tablet report, sending...
I20260709 13:10:21.947595 31263 ts_manager.cc:194] Registered new tserver with Master: 4850b200679441e2a1e339e356206d68 (127.20.69.3:34077)
I20260709 13:10:21.948241 20756 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01457763s
I20260709 13:10:21.949110 31263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44070
I20260709 13:10:21.974210 31263 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44082:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:21.976374 31263 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:22.023767 31504 tablet_service.cc:1511] Processing CreateTablet for tablet 54e9265fde264aa1b963283c5b6b1aed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=84503e9c58254a389e94918055210dc4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:22.025388 31504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e9265fde264aa1b963283c5b6b1aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.029183 31503 tablet_service.cc:1511] Processing CreateTablet for tablet b569bfcad5b846ee89289694e3b51390 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=84503e9c58254a389e94918055210dc4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:22.030705 31503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b569bfcad5b846ee89289694e3b51390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.035434 31355 tablet_service.cc:1511] Processing CreateTablet for tablet 54e9265fde264aa1b963283c5b6b1aed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=84503e9c58254a389e94918055210dc4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:22.036983 31355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e9265fde264aa1b963283c5b6b1aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.038614 31354 tablet_service.cc:1511] Processing CreateTablet for tablet b569bfcad5b846ee89289694e3b51390 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=84503e9c58254a389e94918055210dc4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:22.040177 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b569bfcad5b846ee89289694e3b51390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.053485 31430 tablet_service.cc:1511] Processing CreateTablet for tablet 54e9265fde264aa1b963283c5b6b1aed (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=84503e9c58254a389e94918055210dc4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:22.055033 31430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e9265fde264aa1b963283c5b6b1aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.057394 31553 tablet_bootstrap.cc:492] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68: Bootstrap starting.
I20260709 13:10:22.059993 31429 tablet_service.cc:1511] Processing CreateTablet for tablet b569bfcad5b846ee89289694e3b51390 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=84503e9c58254a389e94918055210dc4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:22.061578 31429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b569bfcad5b846ee89289694e3b51390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.065562 31553 tablet_bootstrap.cc:654] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.073403 31554 tablet_bootstrap.cc:492] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a: Bootstrap starting.
I20260709 13:10:22.081880 31553 tablet_bootstrap.cc:492] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68: No bootstrap required, opened a new log
I20260709 13:10:22.082592 31553 ts_tablet_manager.cc:1403] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 13:10:22.081739 31554 tablet_bootstrap.cc:654] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.086793 31553 raft_consensus.cc:359] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.087740 31553 raft_consensus.cc:385] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.088124 31553 raft_consensus.cc:740] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4850b200679441e2a1e339e356206d68, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.089126 31556 tablet_bootstrap.cc:492] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b: Bootstrap starting.
I20260709 13:10:22.089196 31553 consensus_queue.cc:260] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.092094 31554 tablet_bootstrap.cc:492] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a: No bootstrap required, opened a new log
I20260709 13:10:22.092778 31554 ts_tablet_manager.cc:1403] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:10:22.096225 31558 raft_consensus.cc:493] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.097107 31553 ts_tablet_manager.cc:1434] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:10:22.097023 31539 heartbeater.cc:499] Master 127.20.69.62:35279 was elected leader, sending a full tablet report...
I20260709 13:10:22.098197 31554 raft_consensus.cc:359] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.099126 31554 raft_consensus.cc:385] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.097944 31558 raft_consensus.cc:515] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.099234 31556 tablet_bootstrap.cc:654] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.099459 31554 raft_consensus.cc:740] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 801f02741034480fa8178c01ea87163a, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.100970 31554 consensus_queue.cc:260] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.099656 31553 tablet_bootstrap.cc:492] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68: Bootstrap starting.
I20260709 13:10:22.113058 31553 tablet_bootstrap.cc:654] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.155112 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b569bfcad5b846ee89289694e3b51390" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a" is_pre_election: true
I20260709 13:10:22.156255 31365 raft_consensus.cc:2468] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 0.
I20260709 13:10:22.163170 31478 leader_election.cc:304] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4850b200679441e2a1e339e356206d68, 801f02741034480fa8178c01ea87163a; no voters: 
I20260709 13:10:22.164757 31559 raft_consensus.cc:2804] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:22.165297 31559 raft_consensus.cc:493] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.165711 31559 raft_consensus.cc:3060] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.198369 31558 leader_election.cc:290] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), c4172471398648349704055958e0353b (127.20.69.2:33891)
I20260709 13:10:22.208185 31559 raft_consensus.cc:515] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.238431 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b569bfcad5b846ee89289694e3b51390" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a"
I20260709 13:10:22.239322 31365 raft_consensus.cc:3060] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.261623 31559 leader_election.cc:290] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 election: Requested vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), c4172471398648349704055958e0353b (127.20.69.2:33891)
I20260709 13:10:22.262434 31439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b569bfcad5b846ee89289694e3b51390" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4172471398648349704055958e0353b"
I20260709 13:10:22.265295 31554 ts_tablet_manager.cc:1434] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a: Time spent starting tablet: real 0.170s	user 0.044s	sys 0.113s
I20260709 13:10:22.265887 31390 heartbeater.cc:499] Master 127.20.69.62:35279 was elected leader, sending a full tablet report...
W20260709 13:10:22.266263 31477 leader_election.cc:343] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4172471398648349704055958e0353b (127.20.69.2:33891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:22.262830 31365 raft_consensus.cc:2468] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 1.
I20260709 13:10:22.266456 31554 tablet_bootstrap.cc:492] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a: Bootstrap starting.
I20260709 13:10:22.261679 31440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b569bfcad5b846ee89289694e3b51390" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4172471398648349704055958e0353b" is_pre_election: true
I20260709 13:10:22.267311 31556 tablet_bootstrap.cc:492] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b: No bootstrap required, opened a new log
I20260709 13:10:22.267849 31556 ts_tablet_manager.cc:1403] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b: Time spent bootstrapping tablet: real 0.179s	user 0.072s	sys 0.089s
W20260709 13:10:22.268281 31477 leader_election.cc:343] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4172471398648349704055958e0353b (127.20.69.2:33891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:22.271106 31556 raft_consensus.cc:359] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.271965 31556 raft_consensus.cc:385] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.272326 31556 raft_consensus.cc:740] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4172471398648349704055958e0353b, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.268338 31553 tablet_bootstrap.cc:492] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68: No bootstrap required, opened a new log
I20260709 13:10:22.273365 31553 ts_tablet_manager.cc:1403] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68: Time spent bootstrapping tablet: real 0.174s	user 0.062s	sys 0.075s
I20260709 13:10:22.273239 31556 consensus_queue.cc:260] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.274183 31554 tablet_bootstrap.cc:654] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.276842 31553 raft_consensus.cc:359] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.277920 31553 raft_consensus.cc:385] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.278393 31553 raft_consensus.cc:740] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4850b200679441e2a1e339e356206d68, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.279654 31553 consensus_queue.cc:260] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.283267 31553 ts_tablet_manager.cc:1434] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:10:22.286139 31554 tablet_bootstrap.cc:492] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a: No bootstrap required, opened a new log
I20260709 13:10:22.286366 31465 heartbeater.cc:499] Master 127.20.69.62:35279 was elected leader, sending a full tablet report...
I20260709 13:10:22.286556 31478 leader_election.cc:304] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4850b200679441e2a1e339e356206d68, 801f02741034480fa8178c01ea87163a; no voters: c4172471398648349704055958e0353b
I20260709 13:10:22.286875 31554 ts_tablet_manager.cc:1403] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:10:22.286984 31556 ts_tablet_manager.cc:1434] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 13:10:22.288444 31559 raft_consensus.cc:2804] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:22.289469 31556 tablet_bootstrap.cc:492] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b: Bootstrap starting.
I20260709 13:10:22.289592 31559 raft_consensus.cc:697] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Becoming Leader. State: Replica: 4850b200679441e2a1e339e356206d68, State: Running, Role: LEADER
I20260709 13:10:22.290232 31554 raft_consensus.cc:359] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.291057 31554 raft_consensus.cc:385] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.291368 31554 raft_consensus.cc:740] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 801f02741034480fa8178c01ea87163a, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.292271 31554 consensus_queue.cc:260] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.290561 31559 consensus_queue.cc:237] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.296895 31554 ts_tablet_manager.cc:1434] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:22.297189 31556 tablet_bootstrap.cc:654] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.305104 31556 tablet_bootstrap.cc:492] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b: No bootstrap required, opened a new log
I20260709 13:10:22.305794 31556 ts_tablet_manager.cc:1403] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 13:10:22.309157 31556 raft_consensus.cc:359] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.309764 31556 raft_consensus.cc:385] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.310017 31556 raft_consensus.cc:740] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4172471398648349704055958e0353b, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.310665 31556 consensus_queue.cc:260] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.310825 31263 catalog_manager.cc:5697] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4850b200679441e2a1e339e356206d68 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "4850b200679441e2a1e339e356206d68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.312708 31556 ts_tablet_manager.cc:1434] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:22.313707 31559 raft_consensus.cc:493] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.314256 31559 raft_consensus.cc:515] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.317215 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e9265fde264aa1b963283c5b6b1aed" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a" is_pre_election: true
I20260709 13:10:22.316416 31559 leader_election.cc:290] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), c4172471398648349704055958e0353b (127.20.69.2:33891)
I20260709 13:10:22.317931 31365 raft_consensus.cc:2468] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 0.
I20260709 13:10:22.318540 31440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e9265fde264aa1b963283c5b6b1aed" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4172471398648349704055958e0353b" is_pre_election: true
I20260709 13:10:22.319231 31440 raft_consensus.cc:2468] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 0.
I20260709 13:10:22.320426 31478 leader_election.cc:304] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4850b200679441e2a1e339e356206d68, 801f02741034480fa8178c01ea87163a; no voters: 
I20260709 13:10:22.321318 31559 raft_consensus.cc:2804] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:22.322932 31559 raft_consensus.cc:493] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.323300 31559 raft_consensus.cc:3060] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.330543 31559 raft_consensus.cc:515] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.332250 31559 leader_election.cc:290] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 election: Requested vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), c4172471398648349704055958e0353b (127.20.69.2:33891)
I20260709 13:10:22.333274 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e9265fde264aa1b963283c5b6b1aed" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a"
I20260709 13:10:22.333416 31440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e9265fde264aa1b963283c5b6b1aed" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4172471398648349704055958e0353b"
I20260709 13:10:22.334045 31365 raft_consensus.cc:3060] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.334185 31440 raft_consensus.cc:3060] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.335278 31563 raft_consensus.cc:493] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.335805 31563 raft_consensus.cc:515] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.338480 31563 leader_election.cc:290] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), 4850b200679441e2a1e339e356206d68 (127.20.69.3:34077)
I20260709 13:10:22.344172 31440 raft_consensus.cc:2468] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 1.
I20260709 13:10:22.344058 31365 raft_consensus.cc:2468] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 1.
I20260709 13:10:22.346470 31477 leader_election.cc:304] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4850b200679441e2a1e339e356206d68, c4172471398648349704055958e0353b; no voters: 
I20260709 13:10:22.347483 31559 raft_consensus.cc:2804] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:22.348280 31559 raft_consensus.cc:697] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Becoming Leader. State: Replica: 4850b200679441e2a1e339e356206d68, State: Running, Role: LEADER
I20260709 13:10:22.349335 31559 consensus_queue.cc:237] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.356178 31514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b569bfcad5b846ee89289694e3b51390" candidate_uuid: "c4172471398648349704055958e0353b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4850b200679441e2a1e339e356206d68" is_pre_election: true
I20260709 13:10:22.358007 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b569bfcad5b846ee89289694e3b51390" candidate_uuid: "c4172471398648349704055958e0353b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a" is_pre_election: true
I20260709 13:10:22.358804 31365 raft_consensus.cc:2393] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4172471398648349704055958e0353b in current term 1: Already voted for candidate 4850b200679441e2a1e339e356206d68 in this term.
I20260709 13:10:22.359920 31404 leader_election.cc:304] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4172471398648349704055958e0353b; no voters: 4850b200679441e2a1e339e356206d68, 801f02741034480fa8178c01ea87163a
I20260709 13:10:22.360983 31563 raft_consensus.cc:3060] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.360152 31262 catalog_manager.cc:5697] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4850b200679441e2a1e339e356206d68 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "4850b200679441e2a1e339e356206d68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.367183 31563 raft_consensus.cc:2749] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:22.430527 31262 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44090:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:22.432569 31262 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:22.457188 31355 tablet_service.cc:1511] Processing CreateTablet for tablet e207f9fffc474a7fa302807bb4e64894 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f33635d0d0fc48c7ad3a54563748e08b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:22.458542 31355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e207f9fffc474a7fa302807bb4e64894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.458621 31429 tablet_service.cc:1511] Processing CreateTablet for tablet e207f9fffc474a7fa302807bb4e64894 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f33635d0d0fc48c7ad3a54563748e08b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:22.459878 31429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e207f9fffc474a7fa302807bb4e64894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.462085 31354 tablet_service.cc:1511] Processing CreateTablet for tablet 54a32cddb4f742119a6fb09799f8f573 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f33635d0d0fc48c7ad3a54563748e08b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:22.462436 31503 tablet_service.cc:1511] Processing CreateTablet for tablet e207f9fffc474a7fa302807bb4e64894 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f33635d0d0fc48c7ad3a54563748e08b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:22.463470 31354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a32cddb4f742119a6fb09799f8f573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.463768 31503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e207f9fffc474a7fa302807bb4e64894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.467947 31504 tablet_service.cc:1511] Processing CreateTablet for tablet 54a32cddb4f742119a6fb09799f8f573 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f33635d0d0fc48c7ad3a54563748e08b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:22.468861 31430 tablet_service.cc:1511] Processing CreateTablet for tablet 54a32cddb4f742119a6fb09799f8f573 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f33635d0d0fc48c7ad3a54563748e08b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:22.470327 31430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a32cddb4f742119a6fb09799f8f573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.469408 31504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a32cddb4f742119a6fb09799f8f573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.475965 31554 tablet_bootstrap.cc:492] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a: Bootstrap starting.
I20260709 13:10:22.482816 31554 tablet_bootstrap.cc:654] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.486039 31556 tablet_bootstrap.cc:492] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b: Bootstrap starting.
I20260709 13:10:22.493533 31556 tablet_bootstrap.cc:654] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.500681 31554 tablet_bootstrap.cc:492] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a: No bootstrap required, opened a new log
I20260709 13:10:22.501338 31554 ts_tablet_manager.cc:1403] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:10:22.504908 31554 raft_consensus.cc:359] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.505769 31554 raft_consensus.cc:385] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.506140 31554 raft_consensus.cc:740] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 801f02741034480fa8178c01ea87163a, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.507058 31554 consensus_queue.cc:260] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.509889 31554 ts_tablet_manager.cc:1434] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:22.511262 31554 tablet_bootstrap.cc:492] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a: Bootstrap starting.
I20260709 13:10:22.512439 31556 tablet_bootstrap.cc:492] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b: No bootstrap required, opened a new log
I20260709 13:10:22.513089 31556 ts_tablet_manager.cc:1403] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.010s
I20260709 13:10:22.514206 31553 tablet_bootstrap.cc:492] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68: Bootstrap starting.
I20260709 13:10:22.516544 31556 raft_consensus.cc:359] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.517457 31556 raft_consensus.cc:385] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.517843 31556 raft_consensus.cc:740] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4172471398648349704055958e0353b, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.519171 31554 tablet_bootstrap.cc:654] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.518851 31556 consensus_queue.cc:260] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
W20260709 13:10:22.519450 31311 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:22.521636 31556 ts_tablet_manager.cc:1434] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:22.522899 31556 tablet_bootstrap.cc:492] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: Bootstrap starting.
I20260709 13:10:22.526767 31553 tablet_bootstrap.cc:654] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.530273 31556 tablet_bootstrap.cc:654] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.541225 31554 tablet_bootstrap.cc:492] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a: No bootstrap required, opened a new log
I20260709 13:10:22.541839 31554 ts_tablet_manager.cc:1403] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.014s
I20260709 13:10:22.542007 31553 tablet_bootstrap.cc:492] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68: No bootstrap required, opened a new log
I20260709 13:10:22.542665 31553 ts_tablet_manager.cc:1403] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 13:10:22.545204 31556 tablet_bootstrap.cc:492] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: No bootstrap required, opened a new log
I20260709 13:10:22.545068 31554 raft_consensus.cc:359] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.546060 31554 raft_consensus.cc:385] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.545809 31553 raft_consensus.cc:359] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.546479 31554 raft_consensus.cc:740] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 801f02741034480fa8178c01ea87163a, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.546732 31553 raft_consensus.cc:385] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.547114 31553 raft_consensus.cc:740] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4850b200679441e2a1e339e356206d68, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.547372 31554 consensus_queue.cc:260] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.547753 31553 consensus_queue.cc:260] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.549593 31554 ts_tablet_manager.cc:1434] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:10:22.549963 31553 ts_tablet_manager.cc:1434] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:10:22.551116 31553 tablet_bootstrap.cc:492] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68: Bootstrap starting.
I20260709 13:10:22.545850 31556 ts_tablet_manager.cc:1403] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:10:22.555573 31556 raft_consensus.cc:359] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.556169 31556 raft_consensus.cc:385] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.556468 31556 raft_consensus.cc:740] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4172471398648349704055958e0353b, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.557238 31556 consensus_queue.cc:260] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.559406 31556 ts_tablet_manager.cc:1434] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:22.565526 31553 tablet_bootstrap.cc:654] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.571008 31553 tablet_bootstrap.cc:492] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68: No bootstrap required, opened a new log
I20260709 13:10:22.571585 31553 ts_tablet_manager.cc:1403] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 13:10:22.572981 31563 raft_consensus.cc:493] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.573583 31563 raft_consensus.cc:515] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.574329 31553 raft_consensus.cc:359] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.574931 31553 raft_consensus.cc:385] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.575184 31553 raft_consensus.cc:740] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4850b200679441e2a1e339e356206d68, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.575673 31563 leader_election.cc:290] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), 4850b200679441e2a1e339e356206d68 (127.20.69.3:34077)
I20260709 13:10:22.576399 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e207f9fffc474a7fa302807bb4e64894" candidate_uuid: "c4172471398648349704055958e0353b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a" is_pre_election: true
I20260709 13:10:22.575999 31553 consensus_queue.cc:260] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.577250 31365 raft_consensus.cc:2468] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4172471398648349704055958e0353b in term 0.
I20260709 13:10:22.577273 31514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e207f9fffc474a7fa302807bb4e64894" candidate_uuid: "c4172471398648349704055958e0353b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4850b200679441e2a1e339e356206d68" is_pre_election: true
I20260709 13:10:22.578109 31514 raft_consensus.cc:2468] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4172471398648349704055958e0353b in term 0.
I20260709 13:10:22.578640 31404 leader_election.cc:304] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 801f02741034480fa8178c01ea87163a, c4172471398648349704055958e0353b; no voters: 
I20260709 13:10:22.578855 31553 ts_tablet_manager.cc:1434] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:22.579525 31563 raft_consensus.cc:2804] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:22.579887 31563 raft_consensus.cc:493] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.580235 31563 raft_consensus.cc:3060] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.587138 31563 raft_consensus.cc:515] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.589147 31563 leader_election.cc:290] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [CANDIDATE]: Term 1 election: Requested vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), 4850b200679441e2a1e339e356206d68 (127.20.69.3:34077)
I20260709 13:10:22.589809 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e207f9fffc474a7fa302807bb4e64894" candidate_uuid: "c4172471398648349704055958e0353b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a"
I20260709 13:10:22.590137 31514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e207f9fffc474a7fa302807bb4e64894" candidate_uuid: "c4172471398648349704055958e0353b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4850b200679441e2a1e339e356206d68"
I20260709 13:10:22.590507 31365 raft_consensus.cc:3060] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.590771 31514 raft_consensus.cc:3060] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.596896 31514 raft_consensus.cc:2468] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4172471398648349704055958e0353b in term 1.
I20260709 13:10:22.596910 31365 raft_consensus.cc:2468] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4172471398648349704055958e0353b in term 1.
I20260709 13:10:22.597265 31559 raft_consensus.cc:493] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.598006 31559 raft_consensus.cc:515] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.599040 31403 leader_election.cc:304] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4850b200679441e2a1e339e356206d68, c4172471398648349704055958e0353b; no voters: 
I20260709 13:10:22.599941 31563 raft_consensus.cc:2804] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:22.600256 31559 leader_election.cc:290] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), c4172471398648349704055958e0353b (127.20.69.2:33891)
I20260709 13:10:22.601451 31440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4172471398648349704055958e0353b" is_pre_election: true
I20260709 13:10:22.601465 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a" is_pre_election: true
I20260709 13:10:22.601954 31563 raft_consensus.cc:697] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 1 LEADER]: Becoming Leader. State: Replica: c4172471398648349704055958e0353b, State: Running, Role: LEADER
I20260709 13:10:22.602288 31440 raft_consensus.cc:2468] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 0.
I20260709 13:10:22.603029 31365 raft_consensus.cc:2468] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 0.
I20260709 13:10:22.603375 31477 leader_election.cc:304] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4850b200679441e2a1e339e356206d68, c4172471398648349704055958e0353b; no voters: 
I20260709 13:10:22.603076 31563 consensus_queue.cc:237] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.604274 31559 raft_consensus.cc:2804] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:22.604692 31559 raft_consensus.cc:493] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.605043 31559 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.611796 31559 raft_consensus.cc:515] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.614359 31559 leader_election.cc:290] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 election: Requested vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), c4172471398648349704055958e0353b (127.20.69.2:33891)
I20260709 13:10:22.614694 31365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f02741034480fa8178c01ea87163a"
I20260709 13:10:22.615031 31440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573" candidate_uuid: "4850b200679441e2a1e339e356206d68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4172471398648349704055958e0353b"
I20260709 13:10:22.615440 31365 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.615641 31440 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.616204 31263 catalog_manager.cc:5697] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b reported cstate change: term changed from 0 to 1, leader changed from <none> to c4172471398648349704055958e0353b (127.20.69.2). New cstate: current_term: 1 leader_uuid: "c4172471398648349704055958e0353b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.622248 31365 raft_consensus.cc:2468] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 1.
I20260709 13:10:22.622267 31440 raft_consensus.cc:2468] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4850b200679441e2a1e339e356206d68 in term 1.
I20260709 13:10:22.624078 31477 leader_election.cc:304] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4850b200679441e2a1e339e356206d68, c4172471398648349704055958e0353b; no voters: 
I20260709 13:10:22.624805 31559 raft_consensus.cc:2804] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:22.625329 31559 raft_consensus.cc:697] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Becoming Leader. State: Replica: 4850b200679441e2a1e339e356206d68, State: Running, Role: LEADER
I20260709 13:10:22.626703 31559 consensus_queue.cc:237] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:22.633930 31262 catalog_manager.cc:5697] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4850b200679441e2a1e339e356206d68 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "4850b200679441e2a1e339e356206d68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.677462 31514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54e9265fde264aa1b963283c5b6b1aed"
dest_uuid: "4850b200679441e2a1e339e356206d68"
mode: GRACEFUL
new_leader_uuid: "801f02741034480fa8178c01ea87163a"
 from {username='slave'} at 127.0.0.1:48430
I20260709 13:10:22.677949 31514 raft_consensus.cc:606] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Received request to transfer leadership to TS 801f02741034480fa8178c01ea87163a
I20260709 13:10:22.693970 31440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e207f9fffc474a7fa302807bb4e64894"
dest_uuid: "c4172471398648349704055958e0353b"
mode: GRACEFUL
new_leader_uuid: "801f02741034480fa8178c01ea87163a"
 from {username='slave'} at 127.0.0.1:54140
I20260709 13:10:22.694468 31440 raft_consensus.cc:606] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 1 LEADER]: Received request to transfer leadership to TS 801f02741034480fa8178c01ea87163a
I20260709 13:10:22.699622 31514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573"
dest_uuid: "4850b200679441e2a1e339e356206d68"
mode: GRACEFUL
new_leader_uuid: "801f02741034480fa8178c01ea87163a"
 from {username='slave'} at 127.0.0.1:48430
I20260709 13:10:22.700217 31514 raft_consensus.cc:606] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Received request to transfer leadership to TS 801f02741034480fa8178c01ea87163a
I20260709 13:10:22.767678 31559 consensus_queue.cc:1048] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:22.790516 31590 consensus_queue.cc:1048] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:22.810930 31588 consensus_queue.cc:1048] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:22.820591 31588 consensus_queue.cc:1048] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:22.834491 31559 raft_consensus.cc:993] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68: : Instructing follower 801f02741034480fa8178c01ea87163a to start an election
I20260709 13:10:22.835014 31588 raft_consensus.cc:1081] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Signalling peer 801f02741034480fa8178c01ea87163a to start an election
I20260709 13:10:22.837210 31365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54e9265fde264aa1b963283c5b6b1aed"
dest_uuid: "801f02741034480fa8178c01ea87163a"
 from {username='slave'} at 127.0.0.1:45698
I20260709 13:10:22.837838 31365 raft_consensus.cc:493] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.838284 31365 raft_consensus.cc:3060] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.844548 31365 raft_consensus.cc:515] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.846797 31365 leader_election.cc:290] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [CANDIDATE]: Term 2 election: Requested vote from peers 4850b200679441e2a1e339e356206d68 (127.20.69.3:34077), c4172471398648349704055958e0353b (127.20.69.2:33891)
I20260709 13:10:22.858202 31514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e9265fde264aa1b963283c5b6b1aed" candidate_uuid: "801f02741034480fa8178c01ea87163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4850b200679441e2a1e339e356206d68"
I20260709 13:10:22.858807 31514 raft_consensus.cc:3055] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:22.859202 31514 raft_consensus.cc:740] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4850b200679441e2a1e339e356206d68, State: Running, Role: LEADER
I20260709 13:10:22.859783 31440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e9265fde264aa1b963283c5b6b1aed" candidate_uuid: "801f02741034480fa8178c01ea87163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4172471398648349704055958e0353b"
I20260709 13:10:22.860489 31440 raft_consensus.cc:3060] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.860087 31514 consensus_queue.cc:260] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.861588 31514 raft_consensus.cc:3060] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.868763 31440 raft_consensus.cc:2468] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 801f02741034480fa8178c01ea87163a in term 2.
I20260709 13:10:22.869379 31514 raft_consensus.cc:2468] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 801f02741034480fa8178c01ea87163a in term 2.
I20260709 13:10:22.870287 31328 leader_election.cc:304] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 801f02741034480fa8178c01ea87163a, c4172471398648349704055958e0353b; no voters: 
I20260709 13:10:22.871376 31560 raft_consensus.cc:2804] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:22.873492 31560 raft_consensus.cc:697] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Becoming Leader. State: Replica: 801f02741034480fa8178c01ea87163a, State: Running, Role: LEADER
I20260709 13:10:22.874382 31560 consensus_queue.cc:237] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } }
I20260709 13:10:22.881225 31261 catalog_manager.cc:5697] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a reported cstate change: term changed from 1 to 2, leader changed from 4850b200679441e2a1e339e356206d68 (127.20.69.3) to 801f02741034480fa8178c01ea87163a (127.20.69.1). New cstate: current_term: 2 leader_uuid: "801f02741034480fa8178c01ea87163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.103729 31563 consensus_queue.cc:1048] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [LEADER]: Connected to new peer: Peer: permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.111528 31599 raft_consensus.cc:993] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b: : Instructing follower 801f02741034480fa8178c01ea87163a to start an election
I20260709 13:10:23.112515 31563 raft_consensus.cc:1081] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 1 LEADER]: Signalling peer 801f02741034480fa8178c01ea87163a to start an election
I20260709 13:10:23.114344 31364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e207f9fffc474a7fa302807bb4e64894"
dest_uuid: "801f02741034480fa8178c01ea87163a"
 from {username='slave'} at 127.0.0.1:45706
I20260709 13:10:23.114954 31364 raft_consensus.cc:493] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.115340 31364 raft_consensus.cc:3060] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.120429 31601 consensus_queue.cc:1048] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.123790 31364 raft_consensus.cc:515] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:23.126010 31364 leader_election.cc:290] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [CANDIDATE]: Term 2 election: Requested vote from peers c4172471398648349704055958e0353b (127.20.69.2:33891), 4850b200679441e2a1e339e356206d68 (127.20.69.3:34077)
I20260709 13:10:23.127585 31513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e207f9fffc474a7fa302807bb4e64894" candidate_uuid: "801f02741034480fa8178c01ea87163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4850b200679441e2a1e339e356206d68"
I20260709 13:10:23.127689 31440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e207f9fffc474a7fa302807bb4e64894" candidate_uuid: "801f02741034480fa8178c01ea87163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4172471398648349704055958e0353b"
I20260709 13:10:23.129575 31440 raft_consensus.cc:3055] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:23.129884 31440 raft_consensus.cc:740] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4172471398648349704055958e0353b, State: Running, Role: LEADER
I20260709 13:10:23.130720 31440 consensus_queue.cc:260] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
W20260709 13:10:23.131660 31599 consensus_queue.cc:1175] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4850b200679441e2a1e339e356206d68" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:10:23.131830 31440 raft_consensus.cc:3060] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.139289 31440 raft_consensus.cc:2468] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 801f02741034480fa8178c01ea87163a in term 2.
I20260709 13:10:23.140679 31328 leader_election.cc:304] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 801f02741034480fa8178c01ea87163a, c4172471398648349704055958e0353b; no voters: 4850b200679441e2a1e339e356206d68
I20260709 13:10:23.141572 31560 raft_consensus.cc:2804] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:23.142081 31560 raft_consensus.cc:697] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Becoming Leader. State: Replica: 801f02741034480fa8178c01ea87163a, State: Running, Role: LEADER
I20260709 13:10:23.142871 31560 consensus_queue.cc:237] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:23.145565 31588 consensus_queue.cc:1048] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.150104 31261 catalog_manager.cc:5697] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a reported cstate change: term changed from 1 to 2, leader changed from c4172471398648349704055958e0353b (127.20.69.2) to 801f02741034480fa8178c01ea87163a (127.20.69.1). New cstate: current_term: 2 leader_uuid: "801f02741034480fa8178c01ea87163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.166085 31558 consensus_queue.cc:1048] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.177176 31558 raft_consensus.cc:993] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68: : Instructing follower 801f02741034480fa8178c01ea87163a to start an election
I20260709 13:10:23.177704 31588 raft_consensus.cc:1081] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Signalling peer 801f02741034480fa8178c01ea87163a to start an election
I20260709 13:10:23.179450 31364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573"
dest_uuid: "801f02741034480fa8178c01ea87163a"
 from {username='slave'} at 127.0.0.1:45698
I20260709 13:10:23.180160 31364 raft_consensus.cc:493] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.180940 31364 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.187386 31364 raft_consensus.cc:515] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:23.190002 31440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573" candidate_uuid: "801f02741034480fa8178c01ea87163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4172471398648349704055958e0353b"
I20260709 13:10:23.190742 31440 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.191406 31514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573" candidate_uuid: "801f02741034480fa8178c01ea87163a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4850b200679441e2a1e339e356206d68"
I20260709 13:10:23.189090 31364 leader_election.cc:290] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [CANDIDATE]: Term 2 election: Requested vote from peers c4172471398648349704055958e0353b (127.20.69.2:33891), 4850b200679441e2a1e339e356206d68 (127.20.69.3:34077)
I20260709 13:10:23.192075 31514 raft_consensus.cc:3055] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:23.192473 31514 raft_consensus.cc:740] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4850b200679441e2a1e339e356206d68, State: Running, Role: LEADER
I20260709 13:10:23.193298 31514 consensus_queue.cc:260] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:23.194633 31514 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.198284 31440 raft_consensus.cc:2468] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 801f02741034480fa8178c01ea87163a in term 2.
I20260709 13:10:23.199700 31328 leader_election.cc:304] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 801f02741034480fa8178c01ea87163a, c4172471398648349704055958e0353b; no voters: 
I20260709 13:10:23.200419 31560 raft_consensus.cc:2804] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:23.200949 31560 raft_consensus.cc:697] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Becoming Leader. State: Replica: 801f02741034480fa8178c01ea87163a, State: Running, Role: LEADER
I20260709 13:10:23.201524 31514 raft_consensus.cc:2468] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 801f02741034480fa8178c01ea87163a in term 2.
I20260709 13:10:23.201819 31560 consensus_queue.cc:237] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:23.207964 31262 catalog_manager.cc:5697] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a reported cstate change: term changed from 1 to 2, leader changed from 4850b200679441e2a1e339e356206d68 (127.20.69.3) to 801f02741034480fa8178c01ea87163a (127.20.69.1). New cstate: current_term: 2 leader_uuid: "801f02741034480fa8178c01ea87163a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.289446 31514 raft_consensus.cc:1275] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Refusing update from remote peer 801f02741034480fa8178c01ea87163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:23.291142 31560 consensus_queue.cc:1048] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.299463 31440 raft_consensus.cc:1275] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Refusing update from remote peer 801f02741034480fa8178c01ea87163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:23.301796 31605 consensus_queue.cc:1048] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:23.459770 20756 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:10:23.461599 20756 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:10:23.461959 20756 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:10:23.474807 31364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573"
dest_uuid: "801f02741034480fa8178c01ea87163a"
mode: GRACEFUL
new_leader_uuid: "c4172471398648349704055958e0353b"
 from {username='slave'} at 127.0.0.1:45722
I20260709 13:10:23.475406 31364 raft_consensus.cc:606] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Received request to transfer leadership to TS c4172471398648349704055958e0353b
I20260709 13:10:23.476657 20756 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:10:23.614367 31514 raft_consensus.cc:3060] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.622189 31514 raft_consensus.cc:1275] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Refusing update from remote peer 801f02741034480fa8178c01ea87163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:23.623713 31605 consensus_queue.cc:1048] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.631531 31440 raft_consensus.cc:1275] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Refusing update from remote peer 801f02741034480fa8178c01ea87163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:23.633955 31560 consensus_queue.cc:1048] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.681864 31440 raft_consensus.cc:1275] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Refusing update from remote peer 801f02741034480fa8178c01ea87163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:23.683383 31560 consensus_queue.cc:1048] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.689175 31597 raft_consensus.cc:993] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a: : Instructing follower c4172471398648349704055958e0353b to start an election
I20260709 13:10:23.689821 31597 raft_consensus.cc:1081] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Signalling peer c4172471398648349704055958e0353b to start an election
I20260709 13:10:23.691641 31440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573"
dest_uuid: "c4172471398648349704055958e0353b"
 from {username='slave'} at 127.0.0.1:54144
I20260709 13:10:23.692219 31440 raft_consensus.cc:493] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.692756 31440 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.698724 31514 raft_consensus.cc:1275] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Refusing update from remote peer 801f02741034480fa8178c01ea87163a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:23.700734 31440 raft_consensus.cc:515] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:23.700976 31608 consensus_queue.cc:1048] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.701941 31439 raft_consensus.cc:1240] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 3 FOLLOWER]: Rejecting Update request from peer 801f02741034480fa8178c01ea87163a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:23.703864 31440 leader_election.cc:290] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [CANDIDATE]: Term 3 election: Requested vote from peers 801f02741034480fa8178c01ea87163a (127.20.69.1:45377), 4850b200679441e2a1e339e356206d68 (127.20.69.3:34077)
I20260709 13:10:23.703980 31364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573" candidate_uuid: "c4172471398648349704055958e0353b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "801f02741034480fa8178c01ea87163a"
I20260709 13:10:23.704820 31513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a32cddb4f742119a6fb09799f8f573" candidate_uuid: "c4172471398648349704055958e0353b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4850b200679441e2a1e339e356206d68"
I20260709 13:10:23.705590 31364 raft_consensus.cc:3055] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:23.705888 31513 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.705950 31364 raft_consensus.cc:740] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 801f02741034480fa8178c01ea87163a, State: Running, Role: LEADER
I20260709 13:10:23.706502 31608 consensus_queue.cc:1059] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:23.707669 31364 consensus_queue.cc:260] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
I20260709 13:10:23.708868 31364 raft_consensus.cc:3060] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:23.713825 31513 raft_consensus.cc:2468] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4172471398648349704055958e0353b in term 3.
I20260709 13:10:23.714854 31514 raft_consensus.cc:1240] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 3 FOLLOWER]: Rejecting Update request from peer 801f02741034480fa8178c01ea87163a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:23.715314 31403 leader_election.cc:304] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4850b200679441e2a1e339e356206d68, c4172471398648349704055958e0353b; no voters: 
I20260709 13:10:23.716444 31599 raft_consensus.cc:2804] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:23.717531 31599 raft_consensus.cc:697] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 3 LEADER]: Becoming Leader. State: Replica: c4172471398648349704055958e0353b, State: Running, Role: LEADER
I20260709 13:10:23.718559 31364 raft_consensus.cc:2468] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4172471398648349704055958e0353b in term 3.
I20260709 13:10:23.718446 31599 consensus_queue.cc:237] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } }
W20260709 13:10:23.720129 31597 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:23.727274 31263 catalog_manager.cc:5697] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b reported cstate change: term changed from 2 to 3, leader changed from 801f02741034480fa8178c01ea87163a (127.20.69.1) to c4172471398648349704055958e0353b (127.20.69.2). New cstate: current_term: 3 leader_uuid: "c4172471398648349704055958e0353b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "801f02741034480fa8178c01ea87163a" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 45377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4172471398648349704055958e0353b" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 33891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4850b200679441e2a1e339e356206d68" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 34077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.840294 20756 tablet_server.cc:179] TabletServer@127.20.69.1:0 shutting down...
I20260709 13:10:23.860024 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:23.860743 20756 tablet_replica.cc:333] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a: stopping tablet replica
I20260709 13:10:23.861413 20756 raft_consensus.cc:2243] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.861889 20756 raft_consensus.cc:2272] T 54a32cddb4f742119a6fb09799f8f573 P 801f02741034480fa8178c01ea87163a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.864194 20756 tablet_replica.cc:333] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a: stopping tablet replica
I20260709 13:10:23.864789 20756 raft_consensus.cc:2243] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.865599 20756 raft_consensus.cc:2272] T e207f9fffc474a7fa302807bb4e64894 P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.868269 20756 tablet_replica.cc:333] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a: stopping tablet replica
I20260709 13:10:23.868872 20756 raft_consensus.cc:2243] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.869632 20756 raft_consensus.cc:2272] T 54e9265fde264aa1b963283c5b6b1aed P 801f02741034480fa8178c01ea87163a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.871941 20756 tablet_replica.cc:333] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a: stopping tablet replica
I20260709 13:10:23.872577 20756 raft_consensus.cc:2243] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.873077 20756 raft_consensus.cc:2272] T b569bfcad5b846ee89289694e3b51390 P 801f02741034480fa8178c01ea87163a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.896013 20756 tablet_server.cc:196] TabletServer@127.20.69.1:0 shutdown complete.
I20260709 13:10:23.908277 20756 tablet_server.cc:179] TabletServer@127.20.69.2:0 shutting down...
I20260709 13:10:23.926288 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:23.926936 20756 tablet_replica.cc:333] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b: stopping tablet replica
I20260709 13:10:23.927495 20756 raft_consensus.cc:2243] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.927912 20756 raft_consensus.cc:2272] T b569bfcad5b846ee89289694e3b51390 P c4172471398648349704055958e0353b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.929838 20756 tablet_replica.cc:333] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: stopping tablet replica
I20260709 13:10:23.930336 20756 raft_consensus.cc:2243] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:23.930910 20756 pending_rounds.cc:70] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: Trying to abort 2 pending ops.
I20260709 13:10:23.931061 20756 pending_rounds.cc:77] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636346761916416 op_type: NO_OP noop_request { }
I20260709 13:10:23.931387 20756 raft_consensus.cc:2889] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:23.931632 20756 pending_rounds.cc:77] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636344643751936 op_type: NO_OP noop_request { }
I20260709 13:10:23.931881 20756 raft_consensus.cc:2889] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:23.932147 20756 raft_consensus.cc:2272] T 54a32cddb4f742119a6fb09799f8f573 P c4172471398648349704055958e0353b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.934623 20756 tablet_replica.cc:333] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b: stopping tablet replica
I20260709 13:10:23.935158 20756 raft_consensus.cc:2243] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.935586 20756 raft_consensus.cc:2272] T e207f9fffc474a7fa302807bb4e64894 P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.937880 20756 tablet_replica.cc:333] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b: stopping tablet replica
I20260709 13:10:23.938387 20756 raft_consensus.cc:2243] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.938814 20756 raft_consensus.cc:2272] T 54e9265fde264aa1b963283c5b6b1aed P c4172471398648349704055958e0353b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.962463 20756 tablet_server.cc:196] TabletServer@127.20.69.2:0 shutdown complete.
I20260709 13:10:23.975324 20756 tablet_server.cc:179] TabletServer@127.20.69.3:0 shutting down...
I20260709 13:10:23.991706 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:23.992326 20756 tablet_replica.cc:333] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68: stopping tablet replica
I20260709 13:10:23.992928 20756 raft_consensus.cc:2243] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.993407 20756 raft_consensus.cc:2272] T e207f9fffc474a7fa302807bb4e64894 P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.995675 20756 tablet_replica.cc:333] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68: stopping tablet replica
I20260709 13:10:23.996155 20756 raft_consensus.cc:2243] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.996528 20756 raft_consensus.cc:2272] T 54a32cddb4f742119a6fb09799f8f573 P 4850b200679441e2a1e339e356206d68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.998876 20756 tablet_replica.cc:333] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68: stopping tablet replica
I20260709 13:10:23.999364 20756 raft_consensus.cc:2243] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.999749 20756 raft_consensus.cc:2272] T 54e9265fde264aa1b963283c5b6b1aed P 4850b200679441e2a1e339e356206d68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.001902 20756 tablet_replica.cc:333] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68: stopping tablet replica
I20260709 13:10:24.002462 20756 raft_consensus.cc:2243] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.003245 20756 raft_consensus.cc:2272] T b569bfcad5b846ee89289694e3b51390 P 4850b200679441e2a1e339e356206d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.025851 20756 tablet_server.cc:196] TabletServer@127.20.69.3:0 shutdown complete.
I20260709 13:10:24.038448 20756 master.cc:562] Master@127.20.69.62:35279 shutting down...
I20260709 13:10:24.054761 20756 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:24.055342 20756 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.055685 20756 tablet_replica.cc:333] T 00000000000000000000000000000000 P 37dd45196c41404295f9bef8ff628ef6: stopping tablet replica
I20260709 13:10:24.075049 20756 master.cc:584] Master@127.20.69.62:35279 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2735 ms)
[----------] 6 tests from LeaderRebalancerTest (317063 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:10:24.103747 20756 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.69.62:38953
I20260709 13:10:24.105114 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.110415 31614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.110407 31613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.111737 31616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.113157 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:24.114002 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.114219 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.114382 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602624114349 us; error 0 us; skew 500 ppm
I20260709 13:10:24.114933 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.117326 20756 webserver.cc:533] Webserver started at http://127.20.69.62:39895/ using document root <none> and password file <none>
I20260709 13:10:24.117805 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.117998 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.118259 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.119357 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/master-0-root/instance:
uuid: "1e645006546943c88e7eeebf40b05d30"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-56lb"
I20260709 13:10:24.123977 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:24.127535 31621 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.128407 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:24.128758 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/master-0-root
uuid: "1e645006546943c88e7eeebf40b05d30"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-56lb"
I20260709 13:10:24.129069 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.144168 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.145330 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:24.182556 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.62:38953
I20260709 13:10:24.182713 31672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.62:38953 every 8 connection(s)
I20260709 13:10:24.186367 31673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.197474 31673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30: Bootstrap starting.
I20260709 13:10:24.201897 31673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.206058 31673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30: No bootstrap required, opened a new log
I20260709 13:10:24.208400 31673 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e645006546943c88e7eeebf40b05d30" member_type: VOTER }
I20260709 13:10:24.208829 31673 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.209018 31673 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e645006546943c88e7eeebf40b05d30, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.209618 31673 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e645006546943c88e7eeebf40b05d30" member_type: VOTER }
I20260709 13:10:24.210063 31673 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:24.210260 31673 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:24.210503 31673 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:24.215267 31673 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e645006546943c88e7eeebf40b05d30" member_type: VOTER }
I20260709 13:10:24.215751 31673 leader_election.cc:304] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e645006546943c88e7eeebf40b05d30; no voters: 
I20260709 13:10:24.216905 31673 leader_election.cc:290] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:24.217312 31676 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:24.218739 31676 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 1 LEADER]: Becoming Leader. State: Replica: 1e645006546943c88e7eeebf40b05d30, State: Running, Role: LEADER
I20260709 13:10:24.219450 31676 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e645006546943c88e7eeebf40b05d30" member_type: VOTER }
I20260709 13:10:24.219781 31673 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:24.222350 31678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e645006546943c88e7eeebf40b05d30. Latest consensus state: current_term: 1 leader_uuid: "1e645006546943c88e7eeebf40b05d30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e645006546943c88e7eeebf40b05d30" member_type: VOTER } }
I20260709 13:10:24.223206 31678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:24.222350 31677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e645006546943c88e7eeebf40b05d30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e645006546943c88e7eeebf40b05d30" member_type: VOTER } }
I20260709 13:10:24.224040 31677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:24.227442 31682 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:24.235498 31682 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:24.236649 20756 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:24.244462 31682 catalog_manager.cc:1383] Generated new cluster ID: 2a96e1195a7b43c8b06da077c1822daa
I20260709 13:10:24.244818 31682 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:24.267504 31682 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:24.268940 31682 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:24.281057 31682 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30: Generated new TSK 0
I20260709 13:10:24.281723 31682 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:24.303632 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.310437 31694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.311587 31695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.313239 31697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.314332 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:24.315444 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.315646 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.315857 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602624315837 us; error 0 us; skew 500 ppm
I20260709 13:10:24.316412 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.318847 20756 webserver.cc:533] Webserver started at http://127.20.69.1:44357/ using document root <none> and password file <none>
I20260709 13:10:24.319351 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.319550 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.319824 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.321017 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-0-root/instance:
uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-56lb"
I20260709 13:10:24.325656 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:10:24.329200 31702 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.330015 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:24.330411 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-56lb"
I20260709 13:10:24.330741 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.360508 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.361760 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:24.363209 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:24.365620 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:24.365810 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.366147 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:24.366308 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.407474 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:38403
I20260709 13:10:24.407601 31764 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:38403 every 8 connection(s)
I20260709 13:10:24.412865 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.420411 31769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.421177 31770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.426654 31772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.427599 31765 heartbeater.cc:344] Connected to a master server at 127.20.69.62:38953
I20260709 13:10:24.428059 31765 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:24.428908 31765 heartbeater.cc:507] Master 127.20.69.62:38953 requested a full tablet report, sending...
I20260709 13:10:24.429207 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:24.430863 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.431119 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.431336 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602624431312 us; error 0 us; skew 500 ppm
I20260709 13:10:24.431337 31638 ts_manager.cc:194] Registered new tserver with Master: 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403)
I20260709 13:10:24.432430 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.434108 31638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48768
I20260709 13:10:24.435675 20756 webserver.cc:533] Webserver started at http://127.20.69.2:41369/ using document root <none> and password file <none>
I20260709 13:10:24.436347 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.436568 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.436914 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.438019 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-1-root/instance:
uuid: "3295d611a6f945d599723008eb8378a4"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-56lb"
I20260709 13:10:24.442740 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:24.446792 31777 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.447712 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:24.448113 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-1-root
uuid: "3295d611a6f945d599723008eb8378a4"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-56lb"
I20260709 13:10:24.448434 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.462498 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.463774 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:24.465492 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:24.468124 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:24.468402 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.468721 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:24.468920 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.512368 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.2:38565
I20260709 13:10:24.512501 31839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.2:38565 every 8 connection(s)
I20260709 13:10:24.517998 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:24.525722 31843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.526674 31844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:24.530571 31846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:24.531477 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:24.531488 31840 heartbeater.cc:344] Connected to a master server at 127.20.69.62:38953
I20260709 13:10:24.532275 31840 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:24.532766 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:24.533105 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:24.533196 31840 heartbeater.cc:507] Master 127.20.69.62:38953 requested a full tablet report, sending...
I20260709 13:10:24.533301 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602624533283 us; error 0 us; skew 500 ppm
I20260709 13:10:24.534132 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:24.535593 31638 ts_manager.cc:194] Registered new tserver with Master: 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:24.537546 31638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48778
I20260709 13:10:24.538285 20756 webserver.cc:533] Webserver started at http://127.20.69.3:40035/ using document root <none> and password file <none>
I20260709 13:10:24.539016 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:24.539218 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:24.539506 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:24.540737 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-2-root/instance:
uuid: "f7c901a13ca247a39def39190e6d3a50"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-56lb"
I20260709 13:10:24.545601 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:24.549387 31851 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.550421 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:24.550779 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-2-root
uuid: "f7c901a13ca247a39def39190e6d3a50"
format_stamp: "Formatted at 2026-07-09 13:10:24 on dist-test-slave-56lb"
I20260709 13:10:24.551095 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602306874617-20756-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:24.575198 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:24.576509 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:24.578100 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:24.580574 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:24.580853 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.581112 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:24.581288 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:24.623026 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.3:32835
I20260709 13:10:24.623144 31913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.3:32835 every 8 connection(s)
I20260709 13:10:24.638844 31914 heartbeater.cc:344] Connected to a master server at 127.20.69.62:38953
I20260709 13:10:24.639354 31914 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:24.640193 31914 heartbeater.cc:507] Master 127.20.69.62:38953 requested a full tablet report, sending...
I20260709 13:10:24.642416 31638 ts_manager.cc:194] Registered new tserver with Master: f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:24.643036 20756 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016273404s
I20260709 13:10:24.643893 31638 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48788
I20260709 13:10:24.669866 31638 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:24.672487 31638 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:24.748327 31730 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25de9098314aceac44060050fd5029 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:24.748622 31729 tablet_service.cc:1511] Processing CreateTablet for tablet d97e1e5f11964d5cb24be7266a039f26 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:24.749984 31730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25de9098314aceac44060050fd5029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.749715 31727 tablet_service.cc:1511] Processing CreateTablet for tablet 964ae64df61c4594a4a4f87e5da88740 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:24.751214 31727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ae64df61c4594a4a4f87e5da88740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.751945 31729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97e1e5f11964d5cb24be7266a039f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.751745 31879 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25de9098314aceac44060050fd5029 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:24.753276 31879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25de9098314aceac44060050fd5029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.753624 31726 tablet_service.cc:1511] Processing CreateTablet for tablet 702f67aea26943cf9aeabef3d60f3c79 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:24.755231 31726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702f67aea26943cf9aeabef3d60f3c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.757751 31878 tablet_service.cc:1511] Processing CreateTablet for tablet d97e1e5f11964d5cb24be7266a039f26 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:24.759235 31878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97e1e5f11964d5cb24be7266a039f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.760937 31728 tablet_service.cc:1511] Processing CreateTablet for tablet 0804573c212544c380a5e1a41a844ee8 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:24.761737 31877 tablet_service.cc:1511] Processing CreateTablet for tablet 0804573c212544c380a5e1a41a844ee8 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:24.762445 31728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0804573c212544c380a5e1a41a844ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.763154 31877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0804573c212544c380a5e1a41a844ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.765710 31725 tablet_service.cc:1511] Processing CreateTablet for tablet 4586651d3fd347c2933fe6e281b57e10 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:24.767143 31725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4586651d3fd347c2933fe6e281b57e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.769687 31724 tablet_service.cc:1511] Processing CreateTablet for tablet c48d89f3174a427eabe72f945196e91c (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:24.771471 31724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d89f3174a427eabe72f945196e91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.774021 31723 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1999eec34d4884b38d9a1a65f85b06 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:24.776036 31723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1999eec34d4884b38d9a1a65f85b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.765710 31876 tablet_service.cc:1511] Processing CreateTablet for tablet 964ae64df61c4594a4a4f87e5da88740 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:24.778226 31876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ae64df61c4594a4a4f87e5da88740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.784005 31875 tablet_service.cc:1511] Processing CreateTablet for tablet 702f67aea26943cf9aeabef3d60f3c79 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:24.784317 31874 tablet_service.cc:1511] Processing CreateTablet for tablet 4586651d3fd347c2933fe6e281b57e10 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:24.786201 31875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702f67aea26943cf9aeabef3d60f3c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.787220 31874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4586651d3fd347c2933fe6e281b57e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.789105 31722 tablet_service.cc:1511] Processing CreateTablet for tablet 59aeefcdd4294178ba3886088bbcd86c (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:24.790495 31722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59aeefcdd4294178ba3886088bbcd86c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.794643 31873 tablet_service.cc:1511] Processing CreateTablet for tablet c48d89f3174a427eabe72f945196e91c (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:24.796084 31873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d89f3174a427eabe72f945196e91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.797732 31872 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1999eec34d4884b38d9a1a65f85b06 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:24.799237 31872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1999eec34d4884b38d9a1a65f85b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.819679 31871 tablet_service.cc:1511] Processing CreateTablet for tablet 59aeefcdd4294178ba3886088bbcd86c (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:24.821172 31871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59aeefcdd4294178ba3886088bbcd86c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.845355 31929 tablet_bootstrap.cc:492] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:24.869928 31805 tablet_service.cc:1511] Processing CreateTablet for tablet 5c25de9098314aceac44060050fd5029 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:24.871599 31805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c25de9098314aceac44060050fd5029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.872238 31804 tablet_service.cc:1511] Processing CreateTablet for tablet d97e1e5f11964d5cb24be7266a039f26 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:24.873674 31804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97e1e5f11964d5cb24be7266a039f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.878233 31803 tablet_service.cc:1511] Processing CreateTablet for tablet 0804573c212544c380a5e1a41a844ee8 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:24.880363 31803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0804573c212544c380a5e1a41a844ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.896498 31798 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1999eec34d4884b38d9a1a65f85b06 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:24.913251 31798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1999eec34d4884b38d9a1a65f85b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.917896 31929 tablet_bootstrap.cc:654] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.896418 31931 tablet_bootstrap.cc:492] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:24.893278 31799 tablet_service.cc:1511] Processing CreateTablet for tablet c48d89f3174a427eabe72f945196e91c (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:24.920033 31930 tablet_bootstrap.cc:492] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:24.882242 31802 tablet_service.cc:1511] Processing CreateTablet for tablet 964ae64df61c4594a4a4f87e5da88740 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:24.898705 31797 tablet_service.cc:1511] Processing CreateTablet for tablet 59aeefcdd4294178ba3886088bbcd86c (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:24.887898 31801 tablet_service.cc:1511] Processing CreateTablet for tablet 702f67aea26943cf9aeabef3d60f3c79 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:24.886632 31800 tablet_service.cc:1511] Processing CreateTablet for tablet 4586651d3fd347c2933fe6e281b57e10 (DEFAULT_TABLE table=test-workload [id=27109a62e3234309b152491d8bd7fe95]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:24.923427 31799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d89f3174a427eabe72f945196e91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.926190 31802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ae64df61c4594a4a4f87e5da88740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.928169 31930 tablet_bootstrap.cc:654] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.928829 31800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4586651d3fd347c2933fe6e281b57e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.930604 31797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59aeefcdd4294178ba3886088bbcd86c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.930990 31929 tablet_bootstrap.cc:492] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:24.932426 31929 ts_tablet_manager.cc:1403] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.000s
I20260709 13:10:24.932499 31801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702f67aea26943cf9aeabef3d60f3c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:24.936375 31929 raft_consensus.cc:359] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:24.937484 31929 raft_consensus.cc:385] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.937889 31929 raft_consensus.cc:740] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.939138 31929 consensus_queue.cc:260] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:24.940968 31931 tablet_bootstrap.cc:654] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.944007 31930 tablet_bootstrap.cc:492] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:24.944010 31929 ts_tablet_manager.cc:1434] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:10:24.944741 31765 heartbeater.cc:499] Master 127.20.69.62:38953 was elected leader, sending a full tablet report...
I20260709 13:10:24.946485 31929 tablet_bootstrap.cc:492] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:24.948861 31930 ts_tablet_manager.cc:1403] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.015s
I20260709 13:10:24.951973 31930 raft_consensus.cc:359] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:24.952821 31930 raft_consensus.cc:385] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.952960 31929 tablet_bootstrap.cc:654] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.953173 31930 raft_consensus.cc:740] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.954035 31930 consensus_queue.cc:260] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:24.962883 31929 tablet_bootstrap.cc:492] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:24.963755 31929 ts_tablet_manager.cc:1403] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.007s
I20260709 13:10:24.970041 31914 heartbeater.cc:499] Master 127.20.69.62:38953 was elected leader, sending a full tablet report...
I20260709 13:10:24.970607 31930 ts_tablet_manager.cc:1434] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.021s	user 0.016s	sys 0.005s
I20260709 13:10:24.971751 31930 tablet_bootstrap.cc:492] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:24.978062 31930 tablet_bootstrap.cc:654] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:24.967767 31929 raft_consensus.cc:359] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:24.978785 31929 raft_consensus.cc:385] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:24.979127 31929 raft_consensus.cc:740] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:24.980089 31929 consensus_queue.cc:260] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:24.983398 31929 ts_tablet_manager.cc:1434] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:10:24.984845 31929 tablet_bootstrap.cc:492] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:24.995992 31929 tablet_bootstrap.cc:654] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.022804 31929 tablet_bootstrap.cc:492] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:25.023643 31929 ts_tablet_manager.cc:1403] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.000s
I20260709 13:10:25.024119 31930 tablet_bootstrap.cc:492] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:25.024791 31930 ts_tablet_manager.cc:1403] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.026s
I20260709 13:10:25.028057 31929 raft_consensus.cc:359] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:25.029573 31929 raft_consensus.cc:385] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.032200 31930 raft_consensus.cc:359] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.038036 31930 raft_consensus.cc:385] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.038405 31930 raft_consensus.cc:740] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.039243 31930 consensus_queue.cc:260] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.030745 31929 raft_consensus.cc:740] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.040398 31931 tablet_bootstrap.cc:492] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.040968 31931 ts_tablet_manager.cc:1403] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.145s	user 0.038s	sys 0.043s
I20260709 13:10:25.040789 31929 consensus_queue.cc:260] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:25.043563 31929 ts_tablet_manager.cc:1434] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 13:10:25.048347 31930 ts_tablet_manager.cc:1434] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.005s
I20260709 13:10:25.049602 31930 tablet_bootstrap.cc:492] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:25.050580 31929 tablet_bootstrap.cc:492] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:25.043903 31931 raft_consensus.cc:359] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:25.053329 31931 raft_consensus.cc:385] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.053680 31931 raft_consensus.cc:740] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.054471 31931 consensus_queue.cc:260] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:25.064198 31929 tablet_bootstrap.cc:654] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.065428 31840 heartbeater.cc:499] Master 127.20.69.62:38953 was elected leader, sending a full tablet report...
I20260709 13:10:25.065953 31931 ts_tablet_manager.cc:1434] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.005s
I20260709 13:10:25.067095 31931 tablet_bootstrap.cc:492] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:25.073355 31931 tablet_bootstrap.cc:654] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.065598 31930 tablet_bootstrap.cc:654] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.078809 31929 tablet_bootstrap.cc:492] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:25.079723 31929 ts_tablet_manager.cc:1403] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 13:10:25.083847 31929 raft_consensus.cc:359] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.085136 31929 raft_consensus.cc:385] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.085618 31929 raft_consensus.cc:740] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.087867 31929 consensus_queue.cc:260] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.089031 31931 tablet_bootstrap.cc:492] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.089663 31931 ts_tablet_manager.cc:1403] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:10:25.090485 31929 ts_tablet_manager.cc:1434] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:25.091698 31929 tablet_bootstrap.cc:492] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:25.092655 31931 raft_consensus.cc:359] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.093478 31931 raft_consensus.cc:385] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.093794 31931 raft_consensus.cc:740] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.094775 31931 consensus_queue.cc:260] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.097424 31931 ts_tablet_manager.cc:1434] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:10:25.098498 31931 tablet_bootstrap.cc:492] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:25.099197 31929 tablet_bootstrap.cc:654] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.106000 31931 tablet_bootstrap.cc:654] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.113618 31929 tablet_bootstrap.cc:492] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:25.114444 31929 ts_tablet_manager.cc:1403] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:10:25.117264 31931 tablet_bootstrap.cc:492] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.117926 31931 ts_tablet_manager.cc:1403] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:10:25.117741 31929 raft_consensus.cc:359] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.118755 31929 raft_consensus.cc:385] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.119165 31929 raft_consensus.cc:740] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.120146 31929 consensus_queue.cc:260] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.121417 31931 raft_consensus.cc:359] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.122313 31931 raft_consensus.cc:385] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.122612 31931 raft_consensus.cc:740] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.123541 31931 consensus_queue.cc:260] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.125262 31929 ts_tablet_manager.cc:1434] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:25.126196 31931 ts_tablet_manager.cc:1434] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:25.126556 31929 tablet_bootstrap.cc:492] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:25.127307 31931 tablet_bootstrap.cc:492] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:25.129767 31930 tablet_bootstrap.cc:492] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:25.130314 31930 ts_tablet_manager.cc:1403] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.081s	user 0.023s	sys 0.033s
I20260709 13:10:25.133551 31930 raft_consensus.cc:359] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.134078 31931 tablet_bootstrap.cc:654] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.134343 31930 raft_consensus.cc:385] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.134716 31930 raft_consensus.cc:740] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.135704 31930 consensus_queue.cc:260] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.137985 31930 ts_tablet_manager.cc:1434] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:10:25.138815 31929 tablet_bootstrap.cc:654] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.147607 31931 tablet_bootstrap.cc:492] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.148200 31931 ts_tablet_manager.cc:1403] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:10:25.151428 31931 raft_consensus.cc:359] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.152204 31931 raft_consensus.cc:385] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.152524 31931 raft_consensus.cc:740] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.153417 31931 consensus_queue.cc:260] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.155790 31931 ts_tablet_manager.cc:1434] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:25.157069 31930 tablet_bootstrap.cc:492] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:25.159797 31931 tablet_bootstrap.cc:492] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:25.168159 31931 tablet_bootstrap.cc:654] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.170711 31930 tablet_bootstrap.cc:654] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.171303 31929 tablet_bootstrap.cc:492] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:25.171958 31929 ts_tablet_manager.cc:1403] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.019s
I20260709 13:10:25.174484 31934 raft_consensus.cc:493] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.175025 31934 raft_consensus.cc:515] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:25.176380 31930 tablet_bootstrap.cc:492] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:25.176764 31931 tablet_bootstrap.cc:492] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.176986 31930 ts_tablet_manager.cc:1403] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.003s
I20260709 13:10:25.177346 31931 ts_tablet_manager.cc:1403] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:10:25.176832 31929 raft_consensus.cc:359] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.178115 31929 raft_consensus.cc:385] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.178541 31929 raft_consensus.cc:740] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.179566 31929 consensus_queue.cc:260] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.180446 31930 raft_consensus.cc:359] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.180460 31934 leader_election.cc:290] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.180691 31931 raft_consensus.cc:359] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.181401 31930 raft_consensus.cc:385] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.181816 31931 raft_consensus.cc:385] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.181855 31930 raft_consensus.cc:740] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.182253 31931 raft_consensus.cc:740] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.182801 31930 consensus_queue.cc:260] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.182992 31931 consensus_queue.cc:260] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.185215 31930 ts_tablet_manager.cc:1434] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:10:25.185249 31931 ts_tablet_manager.cc:1434] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:25.186381 31930 tablet_bootstrap.cc:492] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:25.186450 31931 tablet_bootstrap.cc:492] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:25.193337 31930 tablet_bootstrap.cc:654] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.193611 31931 tablet_bootstrap.cc:654] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.205891 31930 tablet_bootstrap.cc:492] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:25.206007 31931 tablet_bootstrap.cc:492] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.206502 31930 ts_tablet_manager.cc:1403] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:10:25.206529 31931 ts_tablet_manager.cc:1403] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 13:10:25.209913 31931 raft_consensus.cc:359] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.210813 31931 raft_consensus.cc:385] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.211115 31931 raft_consensus.cc:740] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.211591 31930 raft_consensus.cc:359] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.212414 31930 raft_consensus.cc:385] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.211987 31931 consensus_queue.cc:260] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.212770 31930 raft_consensus.cc:740] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.213706 31930 consensus_queue.cc:260] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.216881 31930 ts_tablet_manager.cc:1434] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:10:25.218027 31930 tablet_bootstrap.cc:492] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:25.218053 31931 ts_tablet_manager.cc:1434] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:25.226877 31934 raft_consensus.cc:493] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.219218 31931 tablet_bootstrap.cc:492] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:25.227512 31934 raft_consensus.cc:515] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.230104 31934 leader_election.cc:290] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.231295 31934 raft_consensus.cc:493] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.231494 31686 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:25.236749 31931 tablet_bootstrap.cc:654] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.231938 31934 raft_consensus.cc:515] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.237797 31930 tablet_bootstrap.cc:654] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.239817 31934 leader_election.cc:290] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.249213 31930 tablet_bootstrap.cc:492] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:25.250378 31930 ts_tablet_manager.cc:1403] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.003s
I20260709 13:10:25.252175 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25de9098314aceac44060050fd5029" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.253575 31815 raft_consensus.cc:2468] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:25.257467 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0804573c212544c380a5e1a41a844ee8" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.259102 31930 raft_consensus.cc:359] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.260119 31930 raft_consensus.cc:385] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.259629 31815 raft_consensus.cc:2468] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:25.260492 31930 raft_consensus.cc:740] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.260811 31814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e1e5f11964d5cb24be7266a039f26" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.262205 31814 raft_consensus.cc:2468] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:25.263101 31936 raft_consensus.cc:493] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.263621 31936 raft_consensus.cc:515] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.267474 31929 ts_tablet_manager.cc:1434] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.095s	user 0.035s	sys 0.041s
I20260709 13:10:25.261502 31930 consensus_queue.cc:260] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.279403 31929 tablet_bootstrap.cc:492] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:25.279922 31931 tablet_bootstrap.cc:492] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.280543 31931 ts_tablet_manager.cc:1403] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.009s
I20260709 13:10:25.280802 31936 leader_election.cc:290] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.283669 31931 raft_consensus.cc:359] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.262096 31706 leader_election.cc:304] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:25.284587 31931 raft_consensus.cc:385] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.285383 31931 raft_consensus.cc:740] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.285854 31951 raft_consensus.cc:2804] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.286332 31951 raft_consensus.cc:493] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.286695 31951 raft_consensus.cc:3060] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.286975 31929 tablet_bootstrap.cc:654] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.287068 31934 raft_consensus.cc:493] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.287663 31934 raft_consensus.cc:515] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.288870 31936 raft_consensus.cc:493] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.290373 31934 leader_election.cc:290] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.286396 31931 consensus_queue.cc:260] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.299607 31931 ts_tablet_manager.cc:1434] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:25.299963 31960 raft_consensus.cc:493] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.302656 31960 raft_consensus.cc:515] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.303560 31931 tablet_bootstrap.cc:492] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:25.300287 31936 raft_consensus.cc:515] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.306710 31936 leader_election.cc:290] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
W20260709 13:10:25.307880 31706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:38565, user_credentials={real_user=slave}} blocked reactor thread for 47527.2us
I20260709 13:10:25.308007 31960 leader_election.cc:290] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.313820 31930 ts_tablet_manager.cc:1434] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.002s
I20260709 13:10:25.316190 31814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0804573c212544c380a5e1a41a844ee8" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.316980 31814 raft_consensus.cc:2468] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.317584 31930 tablet_bootstrap.cc:492] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:25.319437 31706 leader_election.cc:304] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:25.321000 31814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.328159 31814 raft_consensus.cc:2468] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:25.328459 31934 raft_consensus.cc:2804] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.329035 31934 raft_consensus.cc:493] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.329458 31934 raft_consensus.cc:3060] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.321346 31951 raft_consensus.cc:515] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:25.322161 31855 leader_election.cc:304] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:25.329859 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0804573c212544c380a5e1a41a844ee8" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:25.322830 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.330920 31815 raft_consensus.cc:2468] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.331013 31739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:25.331791 31960 raft_consensus.cc:2804] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.323781 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.332183 31855 leader_election.cc:304] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:25.332582 31813 raft_consensus.cc:2468] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.332228 31960 raft_consensus.cc:493] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.332826 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:25.333514 31960 raft_consensus.cc:3060] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.333760 31738 raft_consensus.cc:2468] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.334221 31855 leader_election.cc:304] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
W20260709 13:10:25.335490 31854 leader_election.cc:343] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.336335 31951 leader_election.cc:290] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Requested vote from peers f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.337082 31936 raft_consensus.cc:2804] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.337512 31936 raft_consensus.cc:493] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.337838 31936 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.341276 31934 raft_consensus.cc:515] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.344303 31960 raft_consensus.cc:515] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.342949 31706 leader_election.cc:304] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:25.344666 31740 raft_consensus.cc:2393] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7c901a13ca247a39def39190e6d3a50 in current term 1: Already voted for candidate 81435d91a22f4ce2bd6fdcc808e3322f in this term.
I20260709 13:10:25.346992 31934 leader_election.cc:290] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.327397 31931 tablet_bootstrap.cc:654] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.347425 31936 raft_consensus.cc:515] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.347723 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0804573c212544c380a5e1a41a844ee8" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:25.326995 31930 tablet_bootstrap.cc:654] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.350716 31959 raft_consensus.cc:2804] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.351254 31959 raft_consensus.cc:493] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.351639 31959 raft_consensus.cc:3060] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.353252 31934 raft_consensus.cc:2804] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.353652 31934 raft_consensus.cc:493] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.353456 31706 leader_election.cc:304] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:25.354130 31934 raft_consensus.cc:3060] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.361647 31951 raft_consensus.cc:2804] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.363659 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25de9098314aceac44060050fd5029" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.365942 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.366788 31951 raft_consensus.cc:493] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.366866 31815 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.367312 31951 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.368996 31814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0804573c212544c380a5e1a41a844ee8" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.369661 31814 raft_consensus.cc:3060] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.370087 31963 raft_consensus.cc:493] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.370633 31963 raft_consensus.cc:515] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:25.371457 31887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e1e5f11964d5cb24be7266a039f26" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:25.372272 31887 raft_consensus.cc:2468] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:25.372902 31889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25de9098314aceac44060050fd5029" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:25.373234 31963 leader_election.cc:290] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.367542 31960 leader_election.cc:290] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.373622 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:25.366804 31931 tablet_bootstrap.cc:492] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.374873 31812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0804573c212544c380a5e1a41a844ee8" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.364135 31930 tablet_bootstrap.cc:492] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:25.375380 31885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25de9098314aceac44060050fd5029" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:25.375490 31811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25de9098314aceac44060050fd5029" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.375824 31930 ts_tablet_manager.cc:1403] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.002s
I20260709 13:10:25.373713 31889 raft_consensus.cc:2468] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:25.377018 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0804573c212544c380a5e1a41a844ee8" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:25.377583 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25de9098314aceac44060050fd5029" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:25.377942 31884 raft_consensus.cc:2393] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81435d91a22f4ce2bd6fdcc808e3322f in current term 1: Already voted for candidate f7c901a13ca247a39def39190e6d3a50 in this term.
I20260709 13:10:25.378461 31738 raft_consensus.cc:2393] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7c901a13ca247a39def39190e6d3a50 in current term 1: Already voted for candidate 81435d91a22f4ce2bd6fdcc808e3322f in this term.
I20260709 13:10:25.377983 31855 leader_election.cc:304] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7c901a13ca247a39def39190e6d3a50; no voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:25.374752 31888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0804573c212544c380a5e1a41a844ee8" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:25.380892 31888 raft_consensus.cc:2393] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81435d91a22f4ce2bd6fdcc808e3322f in current term 1: Already voted for candidate f7c901a13ca247a39def39190e6d3a50 in this term.
I20260709 13:10:25.381179 31855 leader_election.cc:304] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7c901a13ca247a39def39190e6d3a50; no voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:25.381496 31815 raft_consensus.cc:2468] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:25.374698 31886 raft_consensus.cc:2393] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81435d91a22f4ce2bd6fdcc808e3322f in current term 1: Already voted for candidate f7c901a13ca247a39def39190e6d3a50 in this term.
I20260709 13:10:25.383258 31855 leader_election.cc:304] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:25.383270 31960 raft_consensus.cc:2749] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.375241 31931 ts_tablet_manager.cc:1403] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.007s
I20260709 13:10:25.366339 31813 raft_consensus.cc:3060] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.385712 31814 raft_consensus.cc:2468] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:25.388787 31706 leader_election.cc:304] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:25.390210 31959 raft_consensus.cc:515] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.390591 31931 raft_consensus.cc:359] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.391331 31931 raft_consensus.cc:385] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.391639 31931 raft_consensus.cc:740] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.383944 31930 raft_consensus.cc:359] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.392176 31930 raft_consensus.cc:385] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.365530 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:25.364624 31936 leader_election.cc:290] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.396250 31930 raft_consensus.cc:740] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.355774 31929 tablet_bootstrap.cc:492] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:25.392465 31963 raft_consensus.cc:3060] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.397145 31929 ts_tablet_manager.cc:1403] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.044s
I20260709 13:10:25.397620 31951 raft_consensus.cc:515] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.392385 31931 consensus_queue.cc:260] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.393746 31813 raft_consensus.cc:2468] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:25.394322 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:25.399530 31740 raft_consensus.cc:2393] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c901a13ca247a39def39190e6d3a50 in current term 1: Already voted for candidate 81435d91a22f4ce2bd6fdcc808e3322f in this term.
W20260709 13:10:25.400911 31854 leader_election.cc:343] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.401360 31931 ts_tablet_manager.cc:1434] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:25.402408 31931 tablet_bootstrap.cc:492] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:25.403770 31951 leader_election.cc:290] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.395334 31967 raft_consensus.cc:2804] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.407305 31963 raft_consensus.cc:2749] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.394073 31959 leader_election.cc:290] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.363852 31934 raft_consensus.cc:515] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.394583 31960 raft_consensus.cc:2804] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.408694 31960 raft_consensus.cc:697] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:25.408877 31931 tablet_bootstrap.cc:654] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.409621 31960 consensus_queue.cc:237] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.410075 31934 leader_election.cc:290] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.397166 31930 consensus_queue.cc:260] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.405658 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:25.412664 31929 raft_consensus.cc:359] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.413499 31936 raft_consensus.cc:493] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.406529 31706 leader_election.cc:304] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:25.412863 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.414036 31936 raft_consensus.cc:515] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.414736 31813 raft_consensus.cc:2393] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81435d91a22f4ce2bd6fdcc808e3322f in current term 1: Already voted for candidate f7c901a13ca247a39def39190e6d3a50 in this term.
I20260709 13:10:25.415648 31951 raft_consensus.cc:2804] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.416239 31951 raft_consensus.cc:697] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:25.417174 31951 consensus_queue.cc:237] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:25.417725 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e1e5f11964d5cb24be7266a039f26" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.418670 31813 raft_consensus.cc:3060] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.420562 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97e1e5f11964d5cb24be7266a039f26" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:25.421044 31706 leader_election.cc:304] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:25.421236 31886 raft_consensus.cc:3060] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.422113 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586651d3fd347c2933fe6e281b57e10" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:25.423066 31740 raft_consensus.cc:2468] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.420326 31940 raft_consensus.cc:493] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.424929 31940 raft_consensus.cc:515] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.420253 31936 leader_election.cc:290] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.428907 31934 raft_consensus.cc:2749] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.431396 31854 leader_election.cc:304] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:25.431823 31886 raft_consensus.cc:2468] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:25.433643 31706 leader_election.cc:304] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:25.434695 31934 raft_consensus.cc:2804] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.435329 31940 leader_election.cc:290] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.435333 31934 raft_consensus.cc:697] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:25.435889 31959 raft_consensus.cc:2804] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.433940 31930 ts_tablet_manager.cc:1434] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:10:25.413673 31929 raft_consensus.cc:385] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.436357 31959 raft_consensus.cc:493] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.437453 31959 raft_consensus.cc:3060] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.436825 31934 consensus_queue.cc:237] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.438313 31929 raft_consensus.cc:740] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.439399 31929 consensus_queue.cc:260] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.437999 31936 raft_consensus.cc:493] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.457803 31930 tablet_bootstrap.cc:492] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:25.466352 31967 raft_consensus.cc:697] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:25.460963 31936 raft_consensus.cc:515] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.468439 31967 consensus_queue.cc:237] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.470948 31936 leader_election.cc:290] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
W20260709 13:10:25.457056 31855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:38565, user_credentials={real_user=slave}} blocked reactor thread for 74225.1us
I20260709 13:10:25.481312 31814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.482116 31814 raft_consensus.cc:3060] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.485318 31930 tablet_bootstrap.cc:654] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.478427 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
W20260709 13:10:25.488471 31854 leader_election.cc:343] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.490809 31931 tablet_bootstrap.cc:492] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:25.491632 31931 ts_tablet_manager.cc:1403] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.008s
I20260709 13:10:25.495122 31959 raft_consensus.cc:515] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.495719 31931 raft_consensus.cc:359] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.496884 31931 raft_consensus.cc:385] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.497347 31931 raft_consensus.cc:740] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.500288 31940 raft_consensus.cc:493] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.500941 31940 raft_consensus.cc:515] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.501824 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:25.503499 31814 raft_consensus.cc:2468] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
W20260709 13:10:25.503613 31780 leader_election.cc:343] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.506322 31855 leader_election.cc:304] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:25.510138 31811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.511204 31811 raft_consensus.cc:2468] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.517776 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586651d3fd347c2933fe6e281b57e10" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.518922 31815 raft_consensus.cc:2468] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.524129 31855 leader_election.cc:304] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:25.499786 31931 consensus_queue.cc:260] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.529785 31936 raft_consensus.cc:2804] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.530316 31936 raft_consensus.cc:493] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.530730 31936 raft_consensus.cc:3060] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.534157 31635 catalog_manager.cc:5697] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.535609 31959 leader_election.cc:290] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.538028 31929 ts_tablet_manager.cc:1434] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.004s
I20260709 13:10:25.538352 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:25.539813 31929 tablet_bootstrap.cc:492] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:25.526875 31960 raft_consensus.cc:2804] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:25.540320 31780 leader_election.cc:343] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.545442 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586651d3fd347c2933fe6e281b57e10" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.546473 31815 raft_consensus.cc:3060] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.543891 31960 raft_consensus.cc:697] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:25.549185 31960 consensus_queue.cc:237] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.543402 31813 raft_consensus.cc:2468] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:25.551636 31637 catalog_manager.cc:5697] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 0 to 1, leader changed from <none> to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 1 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.549201 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586651d3fd347c2933fe6e281b57e10" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:25.555737 31740 raft_consensus.cc:3060] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.557415 31815 raft_consensus.cc:2468] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:25.559034 31940 leader_election.cc:290] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.561437 31855 leader_election.cc:304] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:25.562603 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:25.563758 31888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
W20260709 13:10:25.565757 31781 leader_election.cc:343] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.566280 31781 leader_election.cc:304] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3295d611a6f945d599723008eb8378a4; no voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:25.566674 31936 raft_consensus.cc:515] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.568300 31886 raft_consensus.cc:2393] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3295d611a6f945d599723008eb8378a4 in current term 1: Already voted for candidate f7c901a13ca247a39def39190e6d3a50 in this term.
I20260709 13:10:25.568934 31959 raft_consensus.cc:2804] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.569736 31959 raft_consensus.cc:697] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:25.570648 31781 leader_election.cc:304] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3295d611a6f945d599723008eb8378a4; no voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:25.570703 31959 consensus_queue.cc:237] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.571834 31940 raft_consensus.cc:2749] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.573130 31940 raft_consensus.cc:3060] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.573478 31929 tablet_bootstrap.cc:654] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.577399 31931 ts_tablet_manager.cc:1434] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.085s	user 0.011s	sys 0.007s
I20260709 13:10:25.581017 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:25.581257 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.581872 31930 tablet_bootstrap.cc:492] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:25.582297 31936 leader_election.cc:290] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.582422 31930 ts_tablet_manager.cc:1403] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.133s	user 0.023s	sys 0.028s
I20260709 13:10:25.569702 31740 raft_consensus.cc:2468] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
W20260709 13:10:25.587091 31854 leader_election.cc:343] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.590597 31930 raft_consensus.cc:359] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.591396 31930 raft_consensus.cc:385] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.591702 31930 raft_consensus.cc:740] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.592470 31930 consensus_queue.cc:260] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.594666 31930 ts_tablet_manager.cc:1434] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:10:25.595634 31930 tablet_bootstrap.cc:492] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:25.595999 31940 raft_consensus.cc:2749] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.601001 31967 raft_consensus.cc:493] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.601648 31967 raft_consensus.cc:515] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.602464 31930 tablet_bootstrap.cc:654] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.604054 31967 leader_election.cc:290] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.606158 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aeefcdd4294178ba3886088bbcd86c" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:25.606896 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aeefcdd4294178ba3886088bbcd86c" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.608197 31813 raft_consensus.cc:2468] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
W20260709 13:10:25.608470 31706 leader_election.cc:343] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:25.609781 31706 leader_election.cc:304] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:25.611209 31967 raft_consensus.cc:2804] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.613687 31967 raft_consensus.cc:493] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.614178 31967 raft_consensus.cc:3060] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.622160 31815 raft_consensus.cc:2468] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:25.625097 31855 leader_election.cc:304] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:25.626482 31959 raft_consensus.cc:2804] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.627439 31959 raft_consensus.cc:697] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:25.630988 31959 consensus_queue.cc:237] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.631630 31930 tablet_bootstrap.cc:492] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:25.632630 31930 ts_tablet_manager.cc:1403] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.012s
I20260709 13:10:25.636296 31967 raft_consensus.cc:515] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.636489 31930 raft_consensus.cc:359] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.637495 31930 raft_consensus.cc:385] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.637856 31930 raft_consensus.cc:740] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.638296 31929 tablet_bootstrap.cc:492] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:25.638839 31929 ts_tablet_manager.cc:1403] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.008s
I20260709 13:10:25.640779 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aeefcdd4294178ba3886088bbcd86c" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:25.641027 31930 consensus_queue.cc:260] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.640779 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aeefcdd4294178ba3886088bbcd86c" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.642127 31815 raft_consensus.cc:3060] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.643224 31930 ts_tablet_manager.cc:1434] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:25.639067 31967 leader_election.cc:290] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.644783 31886 raft_consensus.cc:3060] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.650465 31815 raft_consensus.cc:2468] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:25.651918 31706 leader_election.cc:304] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:25.652909 31967 raft_consensus.cc:2804] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.653391 31886 raft_consensus.cc:2468] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:25.653432 31967 raft_consensus.cc:697] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:25.655591 31967 consensus_queue.cc:237] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.656275 31929 raft_consensus.cc:359] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.656997 31929 raft_consensus.cc:385] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.657267 31929 raft_consensus.cc:740] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.661078 31929 consensus_queue.cc:260] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.664484 31929 ts_tablet_manager.cc:1434] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:10:25.665483 31929 tablet_bootstrap.cc:492] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:25.671567 31929 tablet_bootstrap.cc:654] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:25.672164 31637 catalog_manager.cc:5697] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.673903 31637 catalog_manager.cc:5697] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.675940 31637 catalog_manager.cc:5697] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.676551 31929 tablet_bootstrap.cc:492] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:25.677132 31929 ts_tablet_manager.cc:1403] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:10:25.679400 31929 raft_consensus.cc:359] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.680084 31929 raft_consensus.cc:385] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:25.680364 31929 raft_consensus.cc:740] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:25.681196 31929 consensus_queue.cc:260] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.682976 31929 ts_tablet_manager.cc:1434] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:10:25.687144 31959 raft_consensus.cc:493] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.686676 31635 catalog_manager.cc:5697] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 0 to 1, leader changed from <none> to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 1 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.687772 31959 raft_consensus.cc:515] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.689136 31635 catalog_manager.cc:5697] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 0 to 1, leader changed from <none> to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 1 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.690272 31959 leader_election.cc:290] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.691090 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:25.691767 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.691056 31635 catalog_manager.cc:5697] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 0 to 1, leader changed from <none> to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 1 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.692083 31740 raft_consensus.cc:2468] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.692401 31815 raft_consensus.cc:2468] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:25.693429 31854 leader_election.cc:304] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:25.694353 31959 raft_consensus.cc:2804] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:25.694676 31959 raft_consensus.cc:493] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.694952 31959 raft_consensus.cc:3060] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.701571 31959 raft_consensus.cc:515] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.703253 31959 leader_election.cc:290] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:25.704265 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:25.704452 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:25.705010 31740 raft_consensus.cc:3060] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.705140 31815 raft_consensus.cc:3060] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.710510 31740 raft_consensus.cc:2468] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:25.711072 31815 raft_consensus.cc:2468] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:25.711709 31854 leader_election.cc:304] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:25.712723 31959 raft_consensus.cc:2804] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:25.713238 31959 raft_consensus.cc:697] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:25.714056 31959 consensus_queue.cc:237] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.721743 31635 catalog_manager.cc:5697] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.824532 31967 raft_consensus.cc:493] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.825189 31967 raft_consensus.cc:515] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:25.826956 31967 leader_election.cc:290] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:25.827893 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:25.828202 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:25.828732 31815 raft_consensus.cc:2393] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81435d91a22f4ce2bd6fdcc808e3322f in current term 1: Already voted for candidate f7c901a13ca247a39def39190e6d3a50 in this term.
I20260709 13:10:25.829898 31706 leader_election.cc:304] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:25.830615 31967 raft_consensus.cc:3060] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:25.835953 31967 raft_consensus.cc:2749] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:25.864746 31959 consensus_queue.cc:1048] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.876672 31959 consensus_queue.cc:1048] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.889470 31967 consensus_queue.cc:1048] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:25.907071 31934 consensus_queue.cc:1048] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:25.923365 31886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
mode: GRACEFUL
new_leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:34380
I20260709 13:10:25.923978 31886 raft_consensus.cc:606] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Received request to transfer leadership to TS 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:25.929581 31886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
mode: GRACEFUL
new_leader_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:34380
I20260709 13:10:25.930228 31886 raft_consensus.cc:606] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Received request to transfer leadership to TS 3295d611a6f945d599723008eb8378a4
I20260709 13:10:25.935758 31886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4586651d3fd347c2933fe6e281b57e10"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
mode: GRACEFUL
new_leader_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:34380
I20260709 13:10:25.936322 31886 raft_consensus.cc:606] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Received request to transfer leadership to TS 3295d611a6f945d599723008eb8378a4
I20260709 13:10:25.941318 31886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
mode: GRACEFUL
new_leader_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:34380
I20260709 13:10:25.941847 31886 raft_consensus.cc:606] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Received request to transfer leadership to TS 3295d611a6f945d599723008eb8378a4
I20260709 13:10:25.946987 31886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
mode: GRACEFUL
new_leader_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:34380
I20260709 13:10:25.947635 31886 raft_consensus.cc:606] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Received request to transfer leadership to TS 3295d611a6f945d599723008eb8378a4
I20260709 13:10:25.960091 31740 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59aeefcdd4294178ba3886088bbcd86c"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
mode: GRACEFUL
new_leader_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:60230
I20260709 13:10:25.960719 31740 raft_consensus.cc:606] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Received request to transfer leadership to TS f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:25.995939 31934 consensus_queue.cc:1048] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.001806 31934 consensus_queue.cc:1048] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.009910 31974 consensus_queue.cc:1048] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.023093 31934 consensus_queue.cc:1048] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.067364 31959 consensus_queue.cc:1048] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.071802 31959 consensus_queue.cc:1048] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.081933 31959 raft_consensus.cc:993] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50: : Instructing follower 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:26.082449 31959 raft_consensus.cc:1081] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Signalling peer 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:26.084184 31815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:59430
I20260709 13:10:26.084801 31815 raft_consensus.cc:493] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.085173 31815 raft_consensus.cc:3060] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.091526 31815 raft_consensus.cc:515] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.092545 31813 raft_consensus.cc:1240] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Rejecting Update request from peer f7c901a13ca247a39def39190e6d3a50 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:26.094302 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:26.094520 31934 raft_consensus.cc:493] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.095077 31740 raft_consensus.cc:3060] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.095175 31959 consensus_queue.cc:1059] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.095144 31934 raft_consensus.cc:515] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.095432 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1999eec34d4884b38d9a1a65f85b06" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:26.095784 31815 leader_election.cc:290] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:26.096810 31960 raft_consensus.cc:3055] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.097220 31960 raft_consensus.cc:740] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:26.101224 31960 consensus_queue.cc:260] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.102607 31934 leader_election.cc:290] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:26.102607 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:26.103902 31815 raft_consensus.cc:2393] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81435d91a22f4ce2bd6fdcc808e3322f in current term 1: Already voted for candidate f7c901a13ca247a39def39190e6d3a50 in this term.
I20260709 13:10:26.102742 31888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:26.104832 31960 raft_consensus.cc:3060] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.105815 31706 leader_election.cc:304] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:26.106765 31959 consensus_queue.cc:1048] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.107061 31740 raft_consensus.cc:2468] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:26.107107 31934 raft_consensus.cc:3060] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:26.108316 31780 leader_election.cc:304] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:26.110890 31940 raft_consensus.cc:2804] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.115671 31940 raft_consensus.cc:697] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:26.120543 31959 consensus_queue.cc:1048] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.116660 31940 consensus_queue.cc:237] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.125628 31886 raft_consensus.cc:2468] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:26.128662 31934 raft_consensus.cc:2749] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:26.134083 31960 raft_consensus.cc:993] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50: : Instructing follower 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:26.134677 31959 raft_consensus.cc:1081] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Signalling peer 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:26.134845 31637 catalog_manager.cc:5697] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 1 to 2, leader changed from f7c901a13ca247a39def39190e6d3a50 (127.20.69.3) to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.136278 31815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4586651d3fd347c2933fe6e281b57e10"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:59430
I20260709 13:10:26.136870 31815 raft_consensus.cc:493] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.137241 31815 raft_consensus.cc:3060] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.143584 31959 consensus_queue.cc:1048] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.143625 31815 raft_consensus.cc:515] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.146175 31815 leader_election.cc:290] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:26.147305 31886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586651d3fd347c2933fe6e281b57e10" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:26.148010 31886 raft_consensus.cc:3055] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.148245 31886 raft_consensus.cc:740] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:26.147329 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4586651d3fd347c2933fe6e281b57e10" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:26.149369 31740 raft_consensus.cc:3060] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.149085 31886 consensus_queue.cc:260] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.150627 31886 raft_consensus.cc:3060] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.158841 31740 raft_consensus.cc:2468] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:26.161496 31780 leader_election.cc:304] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:26.160149 31959 consensus_queue.cc:1048] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.164516 31940 raft_consensus.cc:2804] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.165423 31940 raft_consensus.cc:697] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:26.166256 31940 consensus_queue.cc:237] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.166961 31886 raft_consensus.cc:2468] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:26.169072 31960 consensus_queue.cc:1048] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.182466 31959 raft_consensus.cc:993] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50: : Instructing follower 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:26.182964 31936 raft_consensus.cc:1081] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Signalling peer 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:26.185719 31815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:59430
I20260709 13:10:26.186398 31815 raft_consensus.cc:493] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.186794 31815 raft_consensus.cc:3060] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.193567 31934 consensus_queue.cc:1048] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.194813 31936 raft_consensus.cc:993] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50: : Instructing follower 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:26.194330 31635 catalog_manager.cc:5697] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 1 to 2, leader changed from f7c901a13ca247a39def39190e6d3a50 (127.20.69.3) to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.195328 31936 raft_consensus.cc:1081] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Signalling peer 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:26.199270 31740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:60206
I20260709 13:10:26.195822 31815 raft_consensus.cc:515] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.203151 31959 consensus_queue.cc:1048] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.203749 31815 leader_election.cc:290] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:26.205238 31888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:26.205894 31888 raft_consensus.cc:3055] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.206262 31888 raft_consensus.cc:740] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:26.206872 31740 raft_consensus.cc:493] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.207108 31888 consensus_queue.cc:260] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.205749 31739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d89f3174a427eabe72f945196e91c" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:26.208923 31739 raft_consensus.cc:3060] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.208456 31888 raft_consensus.cc:3060] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.207582 31740 raft_consensus.cc:3060] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.208309 31813 raft_consensus.cc:1240] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Rejecting Update request from peer f7c901a13ca247a39def39190e6d3a50 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:26.233183 31739 raft_consensus.cc:2468] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:26.237394 31780 leader_election.cc:304] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:26.237462 31888 raft_consensus.cc:2468] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:26.238469 31940 raft_consensus.cc:2804] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.238988 31940 raft_consensus.cc:697] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:26.238837 31740 raft_consensus.cc:515] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.239336 31974 raft_consensus.cc:993] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f: : Instructing follower f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:26.239845 31974 raft_consensus.cc:1081] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Signalling peer f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:26.239979 31940 consensus_queue.cc:237] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.240783 31738 raft_consensus.cc:1240] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Rejecting Update request from peer f7c901a13ca247a39def39190e6d3a50 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:26.241240 31740 leader_election.cc:290] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:26.243393 32011 consensus_queue.cc:1059] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:26.243824 31884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59aeefcdd4294178ba3886088bbcd86c"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:34356
I20260709 13:10:26.244467 32011 raft_consensus.cc:3055] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.244552 31884 raft_consensus.cc:493] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.244961 32011 raft_consensus.cc:740] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:26.245118 31884 raft_consensus.cc:3060] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.245826 32011 consensus_queue.cc:260] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.246801 32011 raft_consensus.cc:3060] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.249501 31889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:26.252130 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ae64df61c4594a4a4f87e5da88740" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:26.262234 31889 raft_consensus.cc:2468] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:26.262379 31934 consensus_queue.cc:1048] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:26.264797 31706 leader_election.cc:304] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 3295d611a6f945d599723008eb8378a4
I20260709 13:10:26.266449 31884 raft_consensus.cc:515] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.269531 31934 raft_consensus.cc:2804] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.271353 31884 leader_election.cc:290] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:26.271502 31934 raft_consensus.cc:697] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:26.272076 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aeefcdd4294178ba3886088bbcd86c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:26.272760 31738 raft_consensus.cc:3055] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.274856 31738 raft_consensus.cc:740] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:26.272516 31934 consensus_queue.cc:237] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.275954 31738 consensus_queue.cc:260] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.277344 31738 raft_consensus.cc:3060] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.277868 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59aeefcdd4294178ba3886088bbcd86c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:26.278501 31815 raft_consensus.cc:3060] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.284050 31738 raft_consensus.cc:2468] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 2.
I20260709 13:10:26.285413 31854 leader_election.cc:304] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:26.285203 31635 catalog_manager.cc:5697] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 1 to 2, leader changed from f7c901a13ca247a39def39190e6d3a50 (127.20.69.3) to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.286351 32011 raft_consensus.cc:2804] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.286900 32011 raft_consensus.cc:697] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 2 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:26.287724 32011 consensus_queue.cc:237] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.288264 31815 raft_consensus.cc:2468] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 2.
I20260709 13:10:26.297063 31637 catalog_manager.cc:5697] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 1 to 2, leader changed from 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1) to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.298198 31638 catalog_manager.cc:5697] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 1 to 2, leader changed from f7c901a13ca247a39def39190e6d3a50 (127.20.69.3) to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 2 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.374459 31936 raft_consensus.cc:993] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50: : Instructing follower 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:26.374967 32011 raft_consensus.cc:1081] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Signalling peer 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:26.376475 31815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:59430
I20260709 13:10:26.377051 31815 raft_consensus.cc:493] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.377359 31815 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.382477 31815 raft_consensus.cc:515] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.384328 31815 leader_election.cc:290] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:26.385540 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:26.385506 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:26.386380 31884 raft_consensus.cc:3055] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.386473 31738 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.386816 31884 raft_consensus.cc:740] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:26.387820 31884 consensus_queue.cc:260] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.389199 31884 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.394485 31738 raft_consensus.cc:2468] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:26.395826 31780 leader_election.cc:304] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:26.396247 31884 raft_consensus.cc:2468] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:26.396564 31940 raft_consensus.cc:2804] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.397179 31940 raft_consensus.cc:697] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:26.398021 31940 consensus_queue.cc:237] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:26.405236 31638 catalog_manager.cc:5697] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 1 to 2, leader changed from f7c901a13ca247a39def39190e6d3a50 (127.20.69.3) to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.550844 31884 raft_consensus.cc:1275] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.552268 31940 consensus_queue.cc:1048] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.563060 31738 raft_consensus.cc:1275] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.564672 32014 consensus_queue.cc:1048] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.576366 31884 raft_consensus.cc:1275] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.577811 31940 consensus_queue.cc:1048] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.581881 31738 raft_consensus.cc:1275] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.583371 31940 consensus_queue.cc:1048] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.672926 31815 raft_consensus.cc:1275] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.674508 32011 consensus_queue.cc:1048] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.682762 31738 raft_consensus.cc:1275] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.684468 31936 consensus_queue.cc:1048] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.724007 31738 raft_consensus.cc:1275] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.725510 32005 consensus_queue.cc:1048] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.737579 31884 raft_consensus.cc:1275] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.739283 32015 consensus_queue.cc:1048] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.749020 31815 raft_consensus.cc:3060] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.757406 31815 raft_consensus.cc:1275] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.759016 31934 consensus_queue.cc:1048] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.768162 31884 raft_consensus.cc:1275] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.770020 31934 consensus_queue.cc:1048] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.780109 31884 raft_consensus.cc:1275] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.782081 32015 consensus_queue.cc:1048] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.790994 31738 raft_consensus.cc:1275] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.792577 32005 consensus_queue.cc:1048] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:28.993095 31637 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34560:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:28.995940 31637 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:29.055081 31727 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7cea8ee6204400814356832e5d509e (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:29.056484 31797 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7cea8ee6204400814356832e5d509e (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:29.057184 31727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7cea8ee6204400814356832e5d509e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.058332 31797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7cea8ee6204400814356832e5d509e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.058707 31871 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7cea8ee6204400814356832e5d509e (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:29.060508 31871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7cea8ee6204400814356832e5d509e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.064951 31724 tablet_service.cc:1511] Processing CreateTablet for tablet ba0c2e375dc94154ae3a5ff7ddcfd68a (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:29.063022 31803 tablet_service.cc:1511] Processing CreateTablet for tablet ba0c2e375dc94154ae3a5ff7ddcfd68a (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:29.066671 31803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0c2e375dc94154ae3a5ff7ddcfd68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.069048 31723 tablet_service.cc:1511] Processing CreateTablet for tablet 50b748e21a90443fa0d605b9b077a815 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:29.070619 31802 tablet_service.cc:1511] Processing CreateTablet for tablet 50b748e21a90443fa0d605b9b077a815 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:29.072280 31802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b748e21a90443fa0d605b9b077a815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.072896 31728 tablet_service.cc:1511] Processing CreateTablet for tablet 232def8a4f384c329edf4e7fea57729c (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:29.074581 31876 tablet_service.cc:1511] Processing CreateTablet for tablet 50b748e21a90443fa0d605b9b077a815 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:29.076231 31876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b748e21a90443fa0d605b9b077a815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.063401 31879 tablet_service.cc:1511] Processing CreateTablet for tablet ba0c2e375dc94154ae3a5ff7ddcfd68a (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:29.078817 31874 tablet_service.cc:1511] Processing CreateTablet for tablet 232def8a4f384c329edf4e7fea57729c (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:29.079730 31800 tablet_service.cc:1511] Processing CreateTablet for tablet 232def8a4f384c329edf4e7fea57729c (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:29.066671 31724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0c2e375dc94154ae3a5ff7ddcfd68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.082190 31728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232def8a4f384c329edf4e7fea57729c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.082010 31722 tablet_service.cc:1511] Processing CreateTablet for tablet b1929fea04b24cedb94ed6ba76ebc54d (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:29.083549 31722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1929fea04b24cedb94ed6ba76ebc54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.084707 31801 tablet_service.cc:1511] Processing CreateTablet for tablet b1929fea04b24cedb94ed6ba76ebc54d (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:29.086301 31723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b748e21a90443fa0d605b9b077a815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.086926 31872 tablet_service.cc:1511] Processing CreateTablet for tablet b1929fea04b24cedb94ed6ba76ebc54d (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:29.088973 31800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232def8a4f384c329edf4e7fea57729c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.092366 31799 tablet_service.cc:1511] Processing CreateTablet for tablet 259dd86364834836a48c6644687537f5 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.094035 31799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259dd86364834836a48c6644687537f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.093854 31725 tablet_service.cc:1511] Processing CreateTablet for tablet 259dd86364834836a48c6644687537f5 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.094722 31873 tablet_service.cc:1511] Processing CreateTablet for tablet 259dd86364834836a48c6644687537f5 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.095347 31725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259dd86364834836a48c6644687537f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.095616 31730 tablet_service.cc:1511] Processing CreateTablet for tablet 4086d9d408b74c72939b000c049d5ab6 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.096938 31730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4086d9d408b74c72939b000c049d5ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.096938 31801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1929fea04b24cedb94ed6ba76ebc54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.100559 31872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1929fea04b24cedb94ed6ba76ebc54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.105057 31874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232def8a4f384c329edf4e7fea57729c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.105800 31873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259dd86364834836a48c6644687537f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.107743 31879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0c2e375dc94154ae3a5ff7ddcfd68a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.120512 31804 tablet_service.cc:1511] Processing CreateTablet for tablet 4086d9d408b74c72939b000c049d5ab6 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.122562 31804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4086d9d408b74c72939b000c049d5ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.126868 31877 tablet_service.cc:1511] Processing CreateTablet for tablet 4086d9d408b74c72939b000c049d5ab6 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.128490 31877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4086d9d408b74c72939b000c049d5ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.143571 31726 tablet_service.cc:1511] Processing CreateTablet for tablet c35d68ecd57b45ee9f52f637978dfdf2 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.145206 31726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35d68ecd57b45ee9f52f637978dfdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.151927 31798 tablet_service.cc:1511] Processing CreateTablet for tablet c35d68ecd57b45ee9f52f637978dfdf2 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.153730 31798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35d68ecd57b45ee9f52f637978dfdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.157626 31878 tablet_service.cc:1511] Processing CreateTablet for tablet c35d68ecd57b45ee9f52f637978dfdf2 (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.159143 31878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35d68ecd57b45ee9f52f637978dfdf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.166805 31729 tablet_service.cc:1511] Processing CreateTablet for tablet 412b367637e14ce0ac374a24a421d2ba (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:29.168377 31729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412b367637e14ce0ac374a24a421d2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.179498 31805 tablet_service.cc:1511] Processing CreateTablet for tablet 412b367637e14ce0ac374a24a421d2ba (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:29.184569 31875 tablet_service.cc:1511] Processing CreateTablet for tablet 412b367637e14ce0ac374a24a421d2ba (DEFAULT_TABLE table=soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:29.186693 31875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412b367637e14ce0ac374a24a421d2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.193921 31805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412b367637e14ce0ac374a24a421d2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.236156 32029 tablet_bootstrap.cc:492] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.273123 32030 tablet_bootstrap.cc:492] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.281435 32029 tablet_bootstrap.cc:654] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.299525 32030 tablet_bootstrap.cc:654] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:29.301159 31686 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:29.308800 32031 tablet_bootstrap.cc:492] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.312121 32029 tablet_bootstrap.cc:492] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.312757 32029 ts_tablet_manager.cc:1403] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.008s
I20260709 13:10:29.315395 32029 raft_consensus.cc:359] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.316150 32029 raft_consensus.cc:385] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.316493 32029 raft_consensus.cc:740] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.318810 32031 tablet_bootstrap.cc:654] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.319167 32030 tablet_bootstrap.cc:492] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.320148 32030 ts_tablet_manager.cc:1403] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.012s
I20260709 13:10:29.317410 32029 consensus_queue.cc:260] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.322875 32029 ts_tablet_manager.cc:1434] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:10:29.324012 32029 tablet_bootstrap.cc:492] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.324877 32030 raft_consensus.cc:359] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.325709 32030 raft_consensus.cc:385] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.326027 32030 raft_consensus.cc:740] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.326922 32030 consensus_queue.cc:260] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.329124 32031 tablet_bootstrap.cc:492] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.329757 32031 ts_tablet_manager.cc:1403] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:10:29.329861 32030 ts_tablet_manager.cc:1434] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:10:29.333688 32031 raft_consensus.cc:359] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.334308 32029 tablet_bootstrap.cc:654] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.334517 32031 raft_consensus.cc:385] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.334848 32031 raft_consensus.cc:740] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.335819 32031 consensus_queue.cc:260] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.338488 32031 ts_tablet_manager.cc:1434] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:29.339588 32031 tablet_bootstrap.cc:492] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.340932 32030 tablet_bootstrap.cc:492] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.349067 32031 tablet_bootstrap.cc:654] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.352139 32030 tablet_bootstrap.cc:654] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.360109 32030 tablet_bootstrap.cc:492] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.360737 32030 ts_tablet_manager.cc:1403] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:10:29.362246 32029 tablet_bootstrap.cc:492] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.362937 32029 ts_tablet_manager.cc:1403] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.018s
I20260709 13:10:29.364188 32030 raft_consensus.cc:359] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.364923 32005 raft_consensus.cc:493] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.365188 32030 raft_consensus.cc:385] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.365254 32031 tablet_bootstrap.cc:492] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.365516 32030 raft_consensus.cc:740] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.365902 32031 ts_tablet_manager.cc:1403] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.007s
I20260709 13:10:29.365517 32005 raft_consensus.cc:515] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.366221 32029 raft_consensus.cc:359] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.367041 32029 raft_consensus.cc:385] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.366564 32030 consensus_queue.cc:260] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.367369 32029 raft_consensus.cc:740] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.369482 32030 ts_tablet_manager.cc:1434] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:10:29.369927 32029 consensus_queue.cc:260] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.370538 32030 tablet_bootstrap.cc:492] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.370201 32031 raft_consensus.cc:359] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.370920 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:29.371340 32031 raft_consensus.cc:385] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.371948 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.372045 32031 raft_consensus.cc:740] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
W20260709 13:10:29.373174 31781 leader_election.cc:343] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:29.373864 31780 leader_election.cc:343] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.373713 32031 consensus_queue.cc:260] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.374419 31780 leader_election.cc:304] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3295d611a6f945d599723008eb8378a4; no voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:29.377091 32031 ts_tablet_manager.cc:1434] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:10:29.377836 32005 leader_election.cc:290] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.380848 32030 tablet_bootstrap.cc:654] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.379529 32031 tablet_bootstrap.cc:492] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.389427 32031 tablet_bootstrap.cc:654] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.379709 32029 ts_tablet_manager.cc:1434] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.005s
I20260709 13:10:29.379884 32038 raft_consensus.cc:2749] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.392901 32029 tablet_bootstrap.cc:492] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.403371 32029 tablet_bootstrap.cc:654] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.418457 32029 tablet_bootstrap.cc:492] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.419008 32029 ts_tablet_manager.cc:1403] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.009s
I20260709 13:10:29.420703 32031 tablet_bootstrap.cc:492] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.421406 32031 ts_tablet_manager.cc:1403] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.016s
I20260709 13:10:29.422566 32030 tablet_bootstrap.cc:492] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.422281 32029 raft_consensus.cc:359] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.423094 32029 raft_consensus.cc:385] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.423456 32029 raft_consensus.cc:740] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.423127 32030 ts_tablet_manager.cc:1403] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.034s
I20260709 13:10:29.424247 32029 consensus_queue.cc:260] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.424919 32031 raft_consensus.cc:359] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.426080 32031 raft_consensus.cc:385] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.426426 32031 raft_consensus.cc:740] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.426834 32029 ts_tablet_manager.cc:1434] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:29.427055 32030 raft_consensus.cc:359] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.427297 32031 consensus_queue.cc:260] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.427870 32030 raft_consensus.cc:385] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.427976 32029 tablet_bootstrap.cc:492] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.428202 32030 raft_consensus.cc:740] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.429122 32030 consensus_queue.cc:260] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.429932 32031 ts_tablet_manager.cc:1434] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:10:29.431044 32031 tablet_bootstrap.cc:492] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.435724 32030 ts_tablet_manager.cc:1434] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:10:29.436965 32030 tablet_bootstrap.cc:492] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.438222 32029 tablet_bootstrap.cc:654] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.439718 32031 tablet_bootstrap.cc:654] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.444283 32030 tablet_bootstrap.cc:654] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.450371 32029 tablet_bootstrap.cc:492] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.450915 32029 ts_tablet_manager.cc:1403] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:10:29.454108 32029 raft_consensus.cc:359] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.454849 32029 raft_consensus.cc:385] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.455147 32029 raft_consensus.cc:740] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.455842 32029 consensus_queue.cc:260] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.459733 32031 tablet_bootstrap.cc:492] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.460340 32031 ts_tablet_manager.cc:1403] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.030s	user 0.003s	sys 0.021s
I20260709 13:10:29.463598 32031 raft_consensus.cc:359] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.464375 32031 raft_consensus.cc:385] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.464628 32029 ts_tablet_manager.cc:1434] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:10:29.464708 32031 raft_consensus.cc:740] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.465888 32031 consensus_queue.cc:260] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.466487 32029 tablet_bootstrap.cc:492] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.468573 32031 ts_tablet_manager.cc:1434] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:10:29.469671 32031 tablet_bootstrap.cc:492] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.476883 32031 tablet_bootstrap.cc:654] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.486567 32030 tablet_bootstrap.cc:492] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.486660 32029 tablet_bootstrap.cc:654] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.486783 32031 tablet_bootstrap.cc:492] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.487427 32031 ts_tablet_manager.cc:1403] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.005s
I20260709 13:10:29.488067 32038 raft_consensus.cc:493] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.488576 32038 raft_consensus.cc:515] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.489871 32030 ts_tablet_manager.cc:1403] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.024s
I20260709 13:10:29.490898 32038 leader_election.cc:290] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.492110 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:29.493222 32029 tablet_bootstrap.cc:492] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.493947 32029 ts_tablet_manager.cc:1403] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.002s
I20260709 13:10:29.493217 32030 raft_consensus.cc:359] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.494199 32031 raft_consensus.cc:359] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.494652 32030 raft_consensus.cc:385] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.495036 32031 raft_consensus.cc:385] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.495076 32030 raft_consensus.cc:740] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.495445 32031 raft_consensus.cc:740] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.496029 32030 consensus_queue.cc:260] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.496356 32031 consensus_queue.cc:260] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.497110 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.497859 32029 raft_consensus.cc:359] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.498551 32030 ts_tablet_manager.cc:1434] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:29.498703 32031 ts_tablet_manager.cc:1434] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:29.498642 32029 raft_consensus.cc:385] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.499445 32029 raft_consensus.cc:740] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.499750 32030 tablet_bootstrap.cc:492] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.499909 32031 tablet_bootstrap.cc:492] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.500376 32029 consensus_queue.cc:260] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.503335 32029 ts_tablet_manager.cc:1434] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:29.506788 31936 raft_consensus.cc:493] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.507344 32030 tablet_bootstrap.cc:654] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:29.507582 31780 leader_election.cc:343] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.508189 31936 raft_consensus.cc:515] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.513396 32029 tablet_bootstrap.cc:492] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.514150 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b748e21a90443fa0d605b9b077a815" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.514948 31738 raft_consensus.cc:2468] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:29.516458 31854 leader_election.cc:304] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.518421 31936 leader_election.cc:290] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.519052 31936 raft_consensus.cc:2804] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.519428 31936 raft_consensus.cc:493] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.519819 31936 raft_consensus.cc:3060] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.522558 32029 tablet_bootstrap.cc:654] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.522715 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b748e21a90443fa0d605b9b077a815" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:29.525599 31813 raft_consensus.cc:2468] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:29.525982 32030 tablet_bootstrap.cc:492] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.526603 32030 ts_tablet_manager.cc:1403] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.015s
I20260709 13:10:29.507520 32031 tablet_bootstrap.cc:654] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:29.523434 31781 leader_election.cc:343] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.529982 32030 raft_consensus.cc:359] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.530958 32030 raft_consensus.cc:385] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.531322 32030 raft_consensus.cc:740] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.532318 32030 consensus_queue.cc:260] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.534963 32030 ts_tablet_manager.cc:1434] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:10:29.536098 32030 tablet_bootstrap.cc:492] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.535890 31781 leader_election.cc:304] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3295d611a6f945d599723008eb8378a4; no voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:29.541668 32038 raft_consensus.cc:2749] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.543774 32029 tablet_bootstrap.cc:492] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.544463 32029 ts_tablet_manager.cc:1403] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.011s
I20260709 13:10:29.547809 32029 raft_consensus.cc:359] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.552639 32030 tablet_bootstrap.cc:654] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.554658 31936 raft_consensus.cc:515] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.548547 32029 raft_consensus.cc:385] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.555944 32029 raft_consensus.cc:740] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.556856 31936 leader_election.cc:290] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.556819 32029 consensus_queue.cc:260] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.557518 31936 raft_consensus.cc:493] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.557977 31936 raft_consensus.cc:515] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.558075 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b748e21a90443fa0d605b9b077a815" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:29.558802 31813 raft_consensus.cc:3060] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.559303 32029 ts_tablet_manager.cc:1434] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:10:29.559830 31936 leader_election.cc:290] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.560479 32029 tablet_bootstrap.cc:492] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.561299 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:29.561954 31815 raft_consensus.cc:2468] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:29.562139 32031 tablet_bootstrap.cc:492] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.562690 32031 ts_tablet_manager.cc:1403] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.008s
I20260709 13:10:29.563534 31855 leader_election.cc:304] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.564541 31936 raft_consensus.cc:2804] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.568320 32030 tablet_bootstrap.cc:492] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.564996 31936 raft_consensus.cc:493] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.569015 32030 ts_tablet_manager.cc:1403] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:10:29.569113 31936 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.569926 31813 raft_consensus.cc:2468] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:29.571058 32031 raft_consensus.cc:359] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.571866 32031 raft_consensus.cc:385] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.572342 32030 raft_consensus.cc:359] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.573125 32030 raft_consensus.cc:385] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.573415 32030 raft_consensus.cc:740] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.572170 32031 raft_consensus.cc:740] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.574159 32030 consensus_queue.cc:260] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.575119 32031 consensus_queue.cc:260] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.576529 32030 ts_tablet_manager.cc:1434] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:29.568257 32029 tablet_bootstrap.cc:654] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.577535 32031 ts_tablet_manager.cc:1434] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:10:29.578603 32031 tablet_bootstrap.cc:492] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.580811 32030 tablet_bootstrap.cc:492] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.583124 31967 raft_consensus.cc:493] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.583735 31967 raft_consensus.cc:515] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.586390 31967 leader_election.cc:290] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.588162 31936 raft_consensus.cc:515] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.588517 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4086d9d408b74c72939b000c049d5ab6" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:29.593348 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
W20260709 13:10:29.593622 31706 leader_election.cc:343] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.594213 31815 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.594928 32030 tablet_bootstrap.cc:654] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.595672 31814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4086d9d408b74c72939b000c049d5ab6" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
W20260709 13:10:29.597692 31706 leader_election.cc:343] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.598302 31706 leader_election.cc:304] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:29.605257 32031 tablet_bootstrap.cc:654] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.606895 31936 leader_election.cc:290] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.609200 31815 raft_consensus.cc:2468] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:29.609998 31967 raft_consensus.cc:2749] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.611178 31855 leader_election.cc:304] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.615433 32031 tablet_bootstrap.cc:492] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.616014 32031 ts_tablet_manager.cc:1403] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.007s
I20260709 13:10:29.619307 32031 raft_consensus.cc:359] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.620078 32031 raft_consensus.cc:385] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.619724 31855 leader_election.cc:304] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.620107 31936 raft_consensus.cc:2804] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:29.621709 31854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.1:38403, user_credentials={real_user=slave}} blocked reactor thread for 105459us
I20260709 13:10:29.624131 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b748e21a90443fa0d605b9b077a815" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:29.625000 31738 raft_consensus.cc:3060] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.630324 31936 raft_consensus.cc:697] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:29.631714 31936 consensus_queue.cc:237] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.634065 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.634864 31740 raft_consensus.cc:2468] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:29.638890 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:29.639629 31740 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.630116 32056 raft_consensus.cc:2804] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.641111 31738 raft_consensus.cc:2468] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:29.642119 32056 raft_consensus.cc:697] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:29.637048 32031 raft_consensus.cc:740] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.643708 32056 consensus_queue.cc:237] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.644127 32031 consensus_queue.cc:260] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.646910 32031 ts_tablet_manager.cc:1434] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:10:29.650413 32031 tablet_bootstrap.cc:492] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.654277 32029 tablet_bootstrap.cc:492] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.654670 31740 raft_consensus.cc:2468] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:29.654978 32029 ts_tablet_manager.cc:1403] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.095s	user 0.025s	sys 0.015s
I20260709 13:10:29.657536 32031 tablet_bootstrap.cc:654] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.658574 32029 raft_consensus.cc:359] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.659976 32029 raft_consensus.cc:385] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.660284 32029 raft_consensus.cc:740] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.661405 32029 consensus_queue.cc:260] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.664911 32030 tablet_bootstrap.cc:492] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.665486 32030 ts_tablet_manager.cc:1403] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.025s
I20260709 13:10:29.666225 32031 tablet_bootstrap.cc:492] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.667537 32031 ts_tablet_manager.cc:1403] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 13:10:29.667927 32029 ts_tablet_manager.cc:1434] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:10:29.669091 32029 tablet_bootstrap.cc:492] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.668565 32030 raft_consensus.cc:359] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.670586 32031 raft_consensus.cc:359] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.671741 32031 raft_consensus.cc:385] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.670639 32030 raft_consensus.cc:385] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.672195 32030 raft_consensus.cc:740] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.673084 32030 consensus_queue.cc:260] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.675628 32030 ts_tablet_manager.cc:1434] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:10:29.675205 31637 catalog_manager.cc:5697] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.677316 32030 tablet_bootstrap.cc:492] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.677155 31637 catalog_manager.cc:5697] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.676007 32031 raft_consensus.cc:740] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.681033 32031 consensus_queue.cc:260] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.684073 32031 ts_tablet_manager.cc:1434] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:10:29.685460 32031 tablet_bootstrap.cc:492] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50: Bootstrap starting.
I20260709 13:10:29.710414 32029 tablet_bootstrap.cc:654] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.711686 32030 tablet_bootstrap.cc:654] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.713538 32031 tablet_bootstrap.cc:654] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.723999 32030 tablet_bootstrap.cc:492] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.724849 32030 ts_tablet_manager.cc:1403] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.027s
I20260709 13:10:29.728860 32030 raft_consensus.cc:359] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.729763 32030 raft_consensus.cc:385] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.730233 32030 raft_consensus.cc:740] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.731361 32030 consensus_queue.cc:260] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.734284 32030 ts_tablet_manager.cc:1434] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:29.735711 32039 raft_consensus.cc:493] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.736332 32039 raft_consensus.cc:515] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.738813 32030 tablet_bootstrap.cc:492] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f: Bootstrap starting.
I20260709 13:10:29.739995 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0c2e375dc94154ae3a5ff7ddcfd68a" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.740747 31740 raft_consensus.cc:2468] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 0.
I20260709 13:10:29.741896 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0c2e375dc94154ae3a5ff7ddcfd68a" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:29.742908 31884 raft_consensus.cc:2468] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 0.
I20260709 13:10:29.744028 32039 leader_election.cc:290] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.744537 31781 leader_election.cc:304] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.745141 32056 raft_consensus.cc:493] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.745574 32039 raft_consensus.cc:2804] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.746127 32039 raft_consensus.cc:493] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.745657 32056 raft_consensus.cc:515] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.746475 32039 raft_consensus.cc:3060] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.748445 32031 tablet_bootstrap.cc:492] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50: No bootstrap required, opened a new log
I20260709 13:10:29.749010 32031 ts_tablet_manager.cc:1403] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.014s
I20260709 13:10:29.750180 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:29.750928 31813 raft_consensus.cc:2468] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:29.751941 32031 raft_consensus.cc:359] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.752739 32031 raft_consensus.cc:385] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.752210 31855 leader_election.cc:304] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.753018 32031 raft_consensus.cc:740] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.753963 32056 leader_election.cc:290] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.753844 32031 consensus_queue.cc:260] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.753875 31936 raft_consensus.cc:2804] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.754864 31936 raft_consensus.cc:493] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.755203 31936 raft_consensus.cc:3060] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.756212 32031 ts_tablet_manager.cc:1434] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:29.757786 32029 tablet_bootstrap.cc:492] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.758401 32029 ts_tablet_manager.cc:1403] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.012s
I20260709 13:10:29.753036 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.760285 31740 raft_consensus.cc:2468] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:29.761458 32030 tablet_bootstrap.cc:654] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.761374 32029 raft_consensus.cc:359] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.762239 32029 raft_consensus.cc:385] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.762605 32029 raft_consensus.cc:740] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.763433 32029 consensus_queue.cc:260] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.764567 32039 raft_consensus.cc:515] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.765133 31936 raft_consensus.cc:515] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.769013 32029 ts_tablet_manager.cc:1434] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:10:29.769505 31967 raft_consensus.cc:493] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.770020 31936 leader_election.cc:290] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.770049 31967 raft_consensus.cc:515] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.774022 31967 leader_election.cc:290] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.774814 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:29.775113 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dd86364834836a48c6644687537f5" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:29.775537 31740 raft_consensus.cc:3060] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.775789 31884 raft_consensus.cc:2468] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:29.777856 31706 leader_election.cc:304] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.777915 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0c2e375dc94154ae3a5ff7ddcfd68a" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:29.778734 31738 raft_consensus.cc:3060] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.779268 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dd86364834836a48c6644687537f5" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:29.779959 31815 raft_consensus.cc:2468] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:29.781410 32029 tablet_bootstrap.cc:492] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4: Bootstrap starting.
I20260709 13:10:29.782898 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0c2e375dc94154ae3a5ff7ddcfd68a" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:29.783522 31884 raft_consensus.cc:3060] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.783867 31740 raft_consensus.cc:2468] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:29.785110 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:29.785513 31967 raft_consensus.cc:2804] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.785820 31813 raft_consensus.cc:3060] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.786074 32038 raft_consensus.cc:493] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.786161 31967 raft_consensus.cc:493] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.786796 31967 raft_consensus.cc:3060] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.786739 32038 raft_consensus.cc:515] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.777985 32039 leader_election.cc:290] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.799690 31936 raft_consensus.cc:493] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.800436 31936 raft_consensus.cc:515] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.804029 31738 raft_consensus.cc:2468] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 1.
I20260709 13:10:29.813397 31780 leader_election.cc:304] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:29.814461 32039 raft_consensus.cc:2804] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.804332 32029 tablet_bootstrap.cc:654] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.815249 32030 tablet_bootstrap.cc:492] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f: No bootstrap required, opened a new log
I20260709 13:10:29.815891 32030 ts_tablet_manager.cc:1403] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.004s
I20260709 13:10:29.813318 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35d68ecd57b45ee9f52f637978dfdf2" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.805750 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:29.806252 31936 leader_election.cc:290] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.807765 32038 leader_election.cc:290] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.807735 31813 raft_consensus.cc:2468] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 1.
I20260709 13:10:29.817425 31815 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:29.811337 31854 leader_election.cc:304] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
W20260709 13:10:29.822844 31780 leader_election.cc:343] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.818864 31884 raft_consensus.cc:2468] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 1.
I20260709 13:10:29.817350 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.828850 32056 raft_consensus.cc:2804] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.829454 32056 raft_consensus.cc:697] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:29.830505 32056 consensus_queue.cc:237] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.831811 32029 tablet_bootstrap.cc:492] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4: No bootstrap required, opened a new log
I20260709 13:10:29.832329 32029 ts_tablet_manager.cc:1403] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.012s
I20260709 13:10:29.817359 32067 raft_consensus.cc:493] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.833233 32067 raft_consensus.cc:515] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.834432 31738 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 0.
I20260709 13:10:29.835268 32029 raft_consensus.cc:359] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.835887 32067 leader_election.cc:290] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.835997 32029 raft_consensus.cc:385] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.836555 32029 raft_consensus.cc:740] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.836879 32049 raft_consensus.cc:493] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.837380 32049 raft_consensus.cc:515] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.815812 32039 raft_consensus.cc:697] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:29.838057 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:29.838719 31815 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:29.839061 31855 leader_election.cc:304] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.838819 32039 consensus_queue.cc:237] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.839884 32049 leader_election.cc:290] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.810053 31888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35d68ecd57b45ee9f52f637978dfdf2" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:29.839771 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:29.840916 31888 raft_consensus.cc:2468] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 0.
I20260709 13:10:29.837414 32029 consensus_queue.cc:260] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.842901 31781 leader_election.cc:304] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:29.843688 32038 raft_consensus.cc:2804] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.840802 31706 leader_election.cc:304] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:29.844074 32038 raft_consensus.cc:493] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.844537 32038 raft_consensus.cc:3060] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.844832 32067 raft_consensus.cc:2804] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.845305 32067 raft_consensus.cc:493] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.824249 32030 raft_consensus.cc:359] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.845678 32067 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.845916 32030 raft_consensus.cc:385] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.846225 32030 raft_consensus.cc:740] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.846944 32030 consensus_queue.cc:260] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.853487 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35d68ecd57b45ee9f52f637978dfdf2" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:29.856976 32029 ts_tablet_manager.cc:1434] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:10:29.859683 32067 raft_consensus.cc:515] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.862296 32049 raft_consensus.cc:2804] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.862972 31884 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:29.862541 32038 raft_consensus.cc:515] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.864185 31815 raft_consensus.cc:2393] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7c901a13ca247a39def39190e6d3a50 in current term 1: Already voted for candidate 3295d611a6f945d599723008eb8378a4 in this term.
I20260709 13:10:29.864526 32049 raft_consensus.cc:493] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.865047 32049 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.866545 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35d68ecd57b45ee9f52f637978dfdf2" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:29.867158 31884 raft_consensus.cc:3060] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.863513 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:29.868206 31813 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.869391 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35d68ecd57b45ee9f52f637978dfdf2" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:29.870060 31738 raft_consensus.cc:3060] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.872968 31637 catalog_manager.cc:5697] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.875324 32038 leader_election.cc:290] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.876273 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35d68ecd57b45ee9f52f637978dfdf2" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:29.877907 31854 leader_election.cc:304] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7c901a13ca247a39def39190e6d3a50; no voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:29.879197 31884 raft_consensus.cc:2468] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 1.
I20260709 13:10:29.879944 32070 raft_consensus.cc:2749] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.880059 32030 ts_tablet_manager.cc:1434] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:10:29.883329 31781 leader_election.cc:304] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.884121 32038 raft_consensus.cc:2804] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.884950 32038 raft_consensus.cc:697] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:29.885869 32038 consensus_queue.cc:237] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.886332 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:29.877934 31738 raft_consensus.cc:2468] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 1.
I20260709 13:10:29.889734 32067 leader_election.cc:290] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.890298 32072 raft_consensus.cc:493] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.890872 32072 raft_consensus.cc:515] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.897464 32072 leader_election.cc:290] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.898675 31889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412b367637e14ce0ac374a24a421d2ba" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:29.899428 31889 raft_consensus.cc:2468] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:29.900051 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412b367637e14ce0ac374a24a421d2ba" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4" is_pre_election: true
I20260709 13:10:29.900702 31706 leader_election.cc:304] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.900921 31815 raft_consensus.cc:2468] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 0.
I20260709 13:10:29.901619 32072 raft_consensus.cc:2804] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.902037 32072 raft_consensus.cc:493] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.901235 31636 catalog_manager.cc:5697] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 1 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.902388 32072 raft_consensus.cc:3060] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.912287 31637 catalog_manager.cc:5697] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.916329 32049 raft_consensus.cc:515] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.917835 31884 raft_consensus.cc:2393] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81435d91a22f4ce2bd6fdcc808e3322f in current term 1: Already voted for candidate f7c901a13ca247a39def39190e6d3a50 in this term.
I20260709 13:10:29.919967 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:29.920063 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:29.921061 31740 raft_consensus.cc:2393] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c901a13ca247a39def39190e6d3a50 in current term 1: Already voted for candidate 81435d91a22f4ce2bd6fdcc808e3322f in this term.
I20260709 13:10:29.922771 31854 leader_election.cc:304] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7c901a13ca247a39def39190e6d3a50; no voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:29.923628 32056 raft_consensus.cc:2749] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.927373 31813 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:29.927642 32072 raft_consensus.cc:515] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.928898 31706 leader_election.cc:304] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:29.929575 32072 leader_election.cc:290] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.929828 32067 raft_consensus.cc:2804] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.811463 31967 raft_consensus.cc:515] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.930351 32067 raft_consensus.cc:697] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:29.931458 32049 leader_election.cc:290] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:29.931277 32067 consensus_queue.cc:237] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.932700 31967 leader_election.cc:290] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:29.933467 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dd86364834836a48c6644687537f5" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:29.934144 31815 raft_consensus.cc:3060] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.934365 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412b367637e14ce0ac374a24a421d2ba" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:29.934995 31884 raft_consensus.cc:3060] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.941547 31889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dd86364834836a48c6644687537f5" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:29.942008 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412b367637e14ce0ac374a24a421d2ba" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:29.942319 31889 raft_consensus.cc:3060] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.942781 31815 raft_consensus.cc:2468] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:29.942931 31813 raft_consensus.cc:3060] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.944137 31706 leader_election.cc:304] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:29.945039 32072 raft_consensus.cc:2804] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.945538 32072 raft_consensus.cc:697] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:29.946408 32072 consensus_queue.cc:237] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.950816 31889 raft_consensus.cc:2468] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:29.954643 31884 raft_consensus.cc:2468] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:29.956271 31706 leader_election.cc:304] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:29.958776 32072 raft_consensus.cc:2804] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.958941 31813 raft_consensus.cc:2468] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 1.
I20260709 13:10:29.959383 32072 raft_consensus.cc:697] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:29.960537 32072 consensus_queue.cc:237] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:29.962165 31637 catalog_manager.cc:5697] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 0 to 1, leader changed from <none> to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 1 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.978972 31637 catalog_manager.cc:5697] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 0 to 1, leader changed from <none> to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 1 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.980901 31637 catalog_manager.cc:5697] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 0 to 1, leader changed from <none> to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 1 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.100332 32049 consensus_queue.cc:1048] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.116257 32049 consensus_queue.cc:1048] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.126149 32038 raft_consensus.cc:493] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.126693 32038 raft_consensus.cc:515] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.128552 32038 leader_election.cc:290] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:30.129261 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4086d9d408b74c72939b000c049d5ab6" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" is_pre_election: true
I20260709 13:10:30.129755 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4086d9d408b74c72939b000c049d5ab6" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50" is_pre_election: true
I20260709 13:10:30.130033 31738 raft_consensus.cc:2468] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 0.
I20260709 13:10:30.130455 31884 raft_consensus.cc:2468] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 0.
I20260709 13:10:30.131233 31780 leader_election.cc:304] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:30.132212 32038 raft_consensus.cc:2804] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:30.132589 32038 raft_consensus.cc:493] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.132957 32038 raft_consensus.cc:3060] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.140301 32038 raft_consensus.cc:515] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.141979 32038 leader_election.cc:290] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:30.142839 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4086d9d408b74c72939b000c049d5ab6" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:30.143039 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4086d9d408b74c72939b000c049d5ab6" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:30.143565 31738 raft_consensus.cc:3060] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.143618 31884 raft_consensus.cc:3060] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.150944 31884 raft_consensus.cc:2468] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 1.
I20260709 13:10:30.150944 31738 raft_consensus.cc:2468] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 1.
I20260709 13:10:30.152310 31781 leader_election.cc:304] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:30.153167 32038 raft_consensus.cc:2804] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:30.153643 32038 raft_consensus.cc:697] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:30.154374 32038 consensus_queue.cc:237] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.163348 31636 catalog_manager.cc:5697] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 1 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.197646 32070 consensus_queue.cc:1048] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.209123 31936 consensus_queue.cc:1048] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.223603 32039 consensus_queue.cc:1048] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.238163 32039 consensus_queue.cc:1048] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.248112 31936 consensus_queue.cc:1048] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.261051 31936 consensus_queue.cc:1048] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.349563 32039 consensus_queue.cc:1048] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.359089 31889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
mode: GRACEFUL
new_leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:34380
I20260709 13:10:30.360358 31889 raft_consensus.cc:606] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Received request to transfer leadership to TS 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:30.364431 32038 consensus_queue.cc:1048] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.386484 31813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba0c2e375dc94154ae3a5ff7ddcfd68a"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
mode: GRACEFUL
new_leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:34880
I20260709 13:10:30.387023 31813 raft_consensus.cc:606] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Received request to transfer leadership to TS 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:30.392185 31884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50b748e21a90443fa0d605b9b077a815"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
mode: GRACEFUL
new_leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:34380
I20260709 13:10:30.392755 31884 raft_consensus.cc:606] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Received request to transfer leadership to TS 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:30.397396 31884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
mode: GRACEFUL
new_leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:34380
I20260709 13:10:30.397917 31884 raft_consensus.cc:606] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Received request to transfer leadership to TS 81435d91a22f4ce2bd6fdcc808e3322f
I20260709 13:10:30.402557 31738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
mode: GRACEFUL
new_leader_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:60230
I20260709 13:10:30.403188 31738 raft_consensus.cc:606] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Received request to transfer leadership to TS 3295d611a6f945d599723008eb8378a4
I20260709 13:10:30.408522 31738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "259dd86364834836a48c6644687537f5"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
mode: GRACEFUL
new_leader_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:60230
I20260709 13:10:30.409181 31738 raft_consensus.cc:606] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Received request to transfer leadership to TS 3295d611a6f945d599723008eb8378a4
I20260709 13:10:30.419697 31738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412b367637e14ce0ac374a24a421d2ba"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
mode: GRACEFUL
new_leader_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:60230
I20260709 13:10:30.420315 31738 raft_consensus.cc:606] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Received request to transfer leadership to TS f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:30.443418 32067 consensus_queue.cc:1048] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.454499 32067 consensus_queue.cc:1048] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.459195 32067 consensus_queue.cc:1048] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.468335 32095 raft_consensus.cc:993] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f: : Instructing follower 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:30.468873 32072 raft_consensus.cc:1081] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Signalling peer 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:30.470616 31815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "259dd86364834836a48c6644687537f5"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:59416
I20260709 13:10:30.471237 31815 raft_consensus.cc:493] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.471577 31815 raft_consensus.cc:3060] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.475909 32067 consensus_queue.cc:1048] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.478092 31815 raft_consensus.cc:515] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.482508 31815 leader_election.cc:290] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:30.482666 31738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dd86364834836a48c6644687537f5" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:30.483312 31738 raft_consensus.cc:3055] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.483637 31738 raft_consensus.cc:740] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:30.484403 31738 consensus_queue.cc:260] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.485550 31738 raft_consensus.cc:3060] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.487039 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dd86364834836a48c6644687537f5" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:30.487737 31884 raft_consensus.cc:3060] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.489566 32067 raft_consensus.cc:993] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: : Instructing follower f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:30.490774 32067 raft_consensus.cc:1081] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Signalling peer f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:30.492357 31889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "412b367637e14ce0ac374a24a421d2ba"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:34356
I20260709 13:10:30.492934 31889 raft_consensus.cc:493] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.493305 31889 raft_consensus.cc:3060] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.497907 31738 raft_consensus.cc:2468] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:30.499428 31780 leader_election.cc:304] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:30.500340 32039 raft_consensus.cc:2804] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.500901 32039 raft_consensus.cc:697] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:30.500944 31889 raft_consensus.cc:515] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.501868 32039 consensus_queue.cc:237] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.504716 31889 leader_election.cc:290] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:30.506269 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412b367637e14ce0ac374a24a421d2ba" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:30.504346 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412b367637e14ce0ac374a24a421d2ba" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:30.506958 31740 raft_consensus.cc:3055] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.507186 31815 raft_consensus.cc:3060] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.507372 31740 raft_consensus.cc:740] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:30.508306 31740 consensus_queue.cc:260] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.509656 31740 raft_consensus.cc:3060] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.509692 32072 consensus_queue.cc:1048] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.511909 32095 consensus_queue.cc:1048] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.517760 31740 raft_consensus.cc:2468] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 2.
I20260709 13:10:30.519107 31854 leader_election.cc:304] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:30.519851 32070 raft_consensus.cc:2804] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.519686 31636 catalog_manager.cc:5697] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 1 to 2, leader changed from 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1) to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.520478 32070 raft_consensus.cc:697] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 2 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:30.521533 32070 consensus_queue.cc:237] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.523953 31884 raft_consensus.cc:2468] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:30.530894 32067 raft_consensus.cc:993] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f: : Instructing follower 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:30.531391 32067 raft_consensus.cc:1081] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Signalling peer 3295d611a6f945d599723008eb8378a4 to start an election
I20260709 13:10:30.533849 31813 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
 from {username='slave'} at 127.0.0.1:59416
I20260709 13:10:30.536219 31813 raft_consensus.cc:493] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.536742 31813 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.541760 31638 catalog_manager.cc:5697] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 1 to 2, leader changed from 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1) to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.544356 31815 raft_consensus.cc:2468] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 2.
I20260709 13:10:30.544996 31813 raft_consensus.cc:515] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.548415 31740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:30.549129 31740 raft_consensus.cc:3055] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.549460 31740 raft_consensus.cc:740] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:30.550104 31813 leader_election.cc:290] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:30.550326 31740 consensus_queue.cc:260] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.551760 31740 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.553213 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "3295d611a6f945d599723008eb8378a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:30.553860 31884 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.560366 31884 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:30.562126 31740 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3295d611a6f945d599723008eb8378a4 in term 2.
I20260709 13:10:30.562837 31781 leader_election.cc:304] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:30.563817 32039 raft_consensus.cc:2804] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.564297 32039 raft_consensus.cc:697] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Becoming Leader. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:30.565130 32039 consensus_queue.cc:237] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.572145 31638 catalog_manager.cc:5697] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 reported cstate change: term changed from 1 to 2, leader changed from 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1) to 3295d611a6f945d599723008eb8378a4 (127.20.69.2). New cstate: current_term: 2 leader_uuid: "3295d611a6f945d599723008eb8378a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.638979 32005 raft_consensus.cc:993] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4: : Instructing follower 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:30.639492 32039 raft_consensus.cc:1081] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Signalling peer 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:30.640995 31740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba0c2e375dc94154ae3a5ff7ddcfd68a"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:60214
I20260709 13:10:30.641594 31740 raft_consensus.cc:493] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.641985 31740 raft_consensus.cc:3060] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.648512 31740 raft_consensus.cc:515] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.651077 31740 leader_election.cc:290] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:30.652845 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0c2e375dc94154ae3a5ff7ddcfd68a" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:30.652685 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0c2e375dc94154ae3a5ff7ddcfd68a" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:30.653586 31884 raft_consensus.cc:3060] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.653766 31813 raft_consensus.cc:3055] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.654241 31813 raft_consensus.cc:740] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:30.655114 31936 raft_consensus.cc:993] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: : Instructing follower 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:30.655601 31936 raft_consensus.cc:1081] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Signalling peer 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:30.655627 31813 consensus_queue.cc:260] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.657011 31813 raft_consensus.cc:3060] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.657498 31740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:60206
I20260709 13:10:30.658138 31740 raft_consensus.cc:493] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.658491 31740 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.659705 31884 raft_consensus.cc:2468] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:30.660729 31706 leader_election.cc:304] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:30.661376 32101 raft_consensus.cc:2804] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.661811 32101 raft_consensus.cc:697] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:30.662526 32101 consensus_queue.cc:237] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.664672 31813 raft_consensus.cc:2468] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:30.667348 31740 raft_consensus.cc:515] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.669267 31740 leader_election.cc:290] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:30.670069 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:30.670433 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:30.670632 31638 catalog_manager.cc:5697] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 1 to 2, leader changed from 3295d611a6f945d599723008eb8378a4 (127.20.69.2) to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 2 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.671363 31813 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.671449 31884 raft_consensus.cc:3055] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.671911 31884 raft_consensus.cc:740] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:30.672670 31884 consensus_queue.cc:260] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.673739 31884 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.677824 31813 raft_consensus.cc:2468] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:30.678965 31706 leader_election.cc:304] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:30.679605 32101 raft_consensus.cc:2804] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.680096 32101 raft_consensus.cc:697] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:30.680918 32101 consensus_queue.cc:237] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.680919 31884 raft_consensus.cc:2468] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:30.687345 31638 catalog_manager.cc:5697] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 1 to 2, leader changed from f7c901a13ca247a39def39190e6d3a50 (127.20.69.3) to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 2 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.712738 32039 consensus_queue.cc:1048] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.721390 32070 raft_consensus.cc:993] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: : Instructing follower 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:30.721900 32070 raft_consensus.cc:1081] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Signalling peer 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:30.723629 31738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50b748e21a90443fa0d605b9b077a815"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:60206
I20260709 13:10:30.724188 31738 raft_consensus.cc:493] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.724516 31738 raft_consensus.cc:3060] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.726809 32005 consensus_queue.cc:1048] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.734066 31738 raft_consensus.cc:515] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.737202 31738 leader_election.cc:290] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:30.737368 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b748e21a90443fa0d605b9b077a815" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:30.738004 31813 raft_consensus.cc:3060] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.738276 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b748e21a90443fa0d605b9b077a815" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:30.738898 31884 raft_consensus.cc:3055] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.739187 31884 raft_consensus.cc:740] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:30.739923 31884 consensus_queue.cc:260] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.741650 31884 raft_consensus.cc:3060] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.744503 32056 raft_consensus.cc:993] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50: : Instructing follower 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:30.745087 32056 raft_consensus.cc:1081] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Signalling peer 81435d91a22f4ce2bd6fdcc808e3322f to start an election
I20260709 13:10:30.747187 31738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
 from {username='slave'} at 127.0.0.1:60206
I20260709 13:10:30.747714 31738 raft_consensus.cc:493] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.748699 31813 raft_consensus.cc:2468] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:30.749033 31884 raft_consensus.cc:2468] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:30.749912 31706 leader_election.cc:304] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:30.750725 32101 raft_consensus.cc:2804] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.751224 32101 raft_consensus.cc:697] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:30.751425 31738 raft_consensus.cc:3060] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.752086 32101 consensus_queue.cc:237] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.757562 31738 raft_consensus.cc:515] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.759410 31738 leader_election.cc:290] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Requested vote from peers 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565), f7c901a13ca247a39def39190e6d3a50 (127.20.69.3:32835)
I20260709 13:10:30.760165 31813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:30.759783 31638 catalog_manager.cc:5697] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 1 to 2, leader changed from f7c901a13ca247a39def39190e6d3a50 (127.20.69.3) to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 2 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.760820 31813 raft_consensus.cc:3060] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.760848 31884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7cea8ee6204400814356832e5d509e" candidate_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
I20260709 13:10:30.761680 31884 raft_consensus.cc:3055] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.761934 31884 raft_consensus.cc:740] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:30.762589 31884 consensus_queue.cc:260] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.763587 31884 raft_consensus.cc:3060] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.766930 31813 raft_consensus.cc:2468] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:30.768229 31706 leader_election.cc:304] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, 81435d91a22f4ce2bd6fdcc808e3322f; no voters: 
I20260709 13:10:30.769073 32101 raft_consensus.cc:2804] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.769551 32101 raft_consensus.cc:697] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Becoming Leader. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:30.769562 31884 raft_consensus.cc:2468] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81435d91a22f4ce2bd6fdcc808e3322f in term 2.
I20260709 13:10:30.770408 32101 consensus_queue.cc:237] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:30.777844 31638 catalog_manager.cc:5697] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f reported cstate change: term changed from 1 to 2, leader changed from f7c901a13ca247a39def39190e6d3a50 (127.20.69.3) to 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1). New cstate: current_term: 2 leader_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.909752 31813 raft_consensus.cc:1275] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.910985 32070 consensus_queue.cc:1048] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.921074 31738 raft_consensus.cc:1275] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.922900 32056 consensus_queue.cc:1048] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.009059 31738 raft_consensus.cc:1275] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.010515 32039 consensus_queue.cc:1048] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.018293 31884 raft_consensus.cc:1275] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.020016 32039 consensus_queue.cc:1048] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:31.099095 31738 raft_consensus.cc:1275] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.100469 32039 consensus_queue.cc:1048] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.101301 31884 raft_consensus.cc:1275] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 3295d611a6f945d599723008eb8378a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.102835 32039 consensus_queue.cc:1048] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.142387 31884 raft_consensus.cc:1275] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.143463 32101 consensus_queue.cc:1048] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.151440 31813 raft_consensus.cc:1275] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.153321 32101 consensus_queue.cc:1048] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.160485 31813 raft_consensus.cc:1275] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.161881 32105 consensus_queue.cc:1048] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.171006 31884 raft_consensus.cc:1275] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.172783 32101 consensus_queue.cc:1048] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.241485 31889 raft_consensus.cc:1275] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.242795 32101 consensus_queue.cc:1048] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.252457 31813 raft_consensus.cc:1275] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.253813 32107 consensus_queue.cc:1048] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.307205 31813 raft_consensus.cc:1275] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.308481 32107 consensus_queue.cc:1048] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.317412 31889 raft_consensus.cc:1275] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Refusing update from remote peer 81435d91a22f4ce2bd6fdcc808e3322f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.319559 32107 consensus_queue.cc:1048] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.423874 31636 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34560:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:33.443884 31636 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34560:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:33.478255 20756 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:33.556355 32152 tablet.cc:1724] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:33.560004 31780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:38403, user_credentials={real_user=slave}} blocked reactor thread for 60896.3us
I20260709 13:10:33.579577 32155 tablet.cc:1724] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.617255 32148 tablet.cc:1724] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.643055 32156 tablet.cc:1724] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.678731 32158 tablet.cc:1724] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.692745 32161 tablet.cc:1724] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.705790 32166 tablet.cc:1724] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:33.723948 31841 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:259dd86364834836a48c6644687537f5)
W20260709 13:10:33.731078 31841 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:259dd86364834836a48c6644687537f5)
W20260709 13:10:33.741583 31841 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:259dd86364834836a48c6644687537f5)
I20260709 13:10:33.753016 31735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
mode: GRACEFUL
new_leader_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:37080
I20260709 13:10:33.771493 32155 tablet.cc:1724] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.782500 32156 tablet.cc:1724] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:33.803468 32163 log.cc:927] Time spent T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:10:33.804432 32171 log.cc:927] Time spent T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:10:33.861805 32150 log.cc:927] Time spent T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: Append to log took a long time: real 0.222s	user 0.001s	sys 0.003s
I20260709 13:10:33.871238 32152 tablet.cc:1724] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.873605 32179 tablet.cc:1724] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.877910 32161 tablet.cc:1724] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.864960 32158 tablet.cc:1724] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.872237 32177 tablet.cc:1724] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:33.886715 32168 log.cc:927] Time spent T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:33.891296 32184 tablet.cc:1724] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.899793 32175 tablet.cc:1724] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.882388 31735 raft_consensus.cc:606] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Received request to transfer leadership to TS f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:33.911423 32182 tablet.cc:1724] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.922055 32166 tablet.cc:1724] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:33.924978 31855 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.2:38565, user_credentials={real_user=slave}} blocked reactor thread for 88009.3us
I20260709 13:10:33.925623 32141 raft_consensus.cc:993] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f: : Instructing follower f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:33.926133 32141 raft_consensus.cc:1081] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Signalling peer f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:33.930032 32156 tablet.cc:1724] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.934259 31884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:34356
I20260709 13:10:33.934967 31884 raft_consensus.cc:493] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.935491 31884 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.942298 32156 tablet.cc:1724] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.895488 32148 tablet.cc:1724] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.944811 31884 raft_consensus.cc:515] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:33.946848 31884 leader_election.cc:290] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 3 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:33.947821 31736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:33.948423 31736 raft_consensus.cc:3055] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.948700 31736 raft_consensus.cc:740] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:33.949610 31736 consensus_queue.cc:260] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:33.956332 31736 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.969333 32182 tablet.cc:1724] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.974727 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232def8a4f384c329edf4e7fea57729c" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:33.975492 31815 raft_consensus.cc:3060] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.988408 32182 tablet.cc:1724] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.008168 32177 tablet.cc:1724] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.015270 31815 raft_consensus.cc:2468] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 3.
I20260709 13:10:34.017706 31855 leader_election.cc:304] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:34.019383 32182 tablet.cc:1724] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.026351 31815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
mode: GRACEFUL
new_leader_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:34884
I20260709 13:10:34.027199 31815 raft_consensus.cc:606] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Received request to transfer leadership to TS f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:34.029821 20756 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:34.030494 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:33.950443 32155 tablet.cc:1724] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.050199 32185 raft_consensus.cc:2804] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.050855 32185 raft_consensus.cc:697] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 3 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:34.052150 31735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c25de9098314aceac44060050fd5029"
dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
mode: GRACEFUL
new_leader_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:37080
I20260709 13:10:34.052925 31735 raft_consensus.cc:606] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Received request to transfer leadership to TS f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:34.052204 32185 consensus_queue.cc:237] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:34.031360 32179 tablet.cc:1724] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:34.079077 31815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79"
dest_uuid: "3295d611a6f945d599723008eb8378a4"
mode: GRACEFUL
new_leader_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:34884
I20260709 13:10:34.079905 31736 raft_consensus.cc:2468] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 3.
I20260709 13:10:34.079948 31815 raft_consensus.cc:606] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Received request to transfer leadership to TS f7c901a13ca247a39def39190e6d3a50
I20260709 13:10:34.083662 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:34.084447 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:34.085690 31636 catalog_manager.cc:5697] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 2 to 3, leader changed from 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1) to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.104372 31636 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30: soft_deleted_table [id=dd358a9b3edb451ba877356a53c14c44] alter complete (version 1)
I20260709 13:10:34.395195 32135 raft_consensus.cc:993] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4: : Instructing follower f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:34.395768 32160 raft_consensus.cc:1081] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Signalling peer f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:34.397368 31884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:34364
I20260709 13:10:34.397836 31884 raft_consensus.cc:493] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.398119 31884 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.402817 31884 raft_consensus.cc:515] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:34.404520 31884 leader_election.cc:290] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 3 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:34.405483 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:34.406243 31815 raft_consensus.cc:3055] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.405460 31736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1929fea04b24cedb94ed6ba76ebc54d" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:34.406636 31815 raft_consensus.cc:740] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:34.406905 31736 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.407405 31815 consensus_queue.cc:260] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:34.409621 31815 raft_consensus.cc:3060] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.413138 31736 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 3.
I20260709 13:10:34.414532 31815 raft_consensus.cc:2468] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 3.
I20260709 13:10:34.414450 31854 leader_election.cc:304] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:34.415400 32185 raft_consensus.cc:2804] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.415877 32185 raft_consensus.cc:697] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 3 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:34.416704 32185 consensus_queue.cc:237] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:34.423506 31637 catalog_manager.cc:5697] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 2 to 3, leader changed from 3295d611a6f945d599723008eb8378a4 (127.20.69.2) to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.494469 32135 raft_consensus.cc:993] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4: : Instructing follower f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:34.494966 32160 raft_consensus.cc:1081] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Signalling peer f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:34.496690 31884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:34364
I20260709 13:10:34.497130 31884 raft_consensus.cc:493] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.497403 31884 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.502977 31884 raft_consensus.cc:515] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:34.504422 31884 leader_election.cc:290] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 3 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:34.505554 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:34.505496 31736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702f67aea26943cf9aeabef3d60f3c79" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:34.506410 31815 raft_consensus.cc:3055] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.506496 31736 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.506685 31815 raft_consensus.cc:740] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3295d611a6f945d599723008eb8378a4, State: Running, Role: LEADER
I20260709 13:10:34.507457 31815 consensus_queue.cc:260] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:34.508381 31815 raft_consensus.cc:3060] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.512825 31736 raft_consensus.cc:2468] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 3.
I20260709 13:10:34.513054 31815 raft_consensus.cc:2468] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 3.
I20260709 13:10:34.514246 31854 leader_election.cc:304] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81435d91a22f4ce2bd6fdcc808e3322f, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:34.515209 32185 raft_consensus.cc:2804] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.515707 32185 raft_consensus.cc:697] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 3 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:34.516577 32185 consensus_queue.cc:237] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } }
I20260709 13:10:34.525154 31637 catalog_manager.cc:5697] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 2 to 3, leader changed from 3295d611a6f945d599723008eb8378a4 (127.20.69.2) to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 3 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.562737 31815 raft_consensus.cc:1275] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:34.564044 32185 consensus_queue.cc:1048] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.569247 32191 raft_consensus.cc:993] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f: : Instructing follower f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:34.569746 32191 raft_consensus.cc:1081] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Signalling peer f7c901a13ca247a39def39190e6d3a50 to start an election
I20260709 13:10:34.572247 31884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c25de9098314aceac44060050fd5029"
dest_uuid: "f7c901a13ca247a39def39190e6d3a50"
 from {username='slave'} at 127.0.0.1:34356
I20260709 13:10:34.572852 31884 raft_consensus.cc:493] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.573264 31884 raft_consensus.cc:3060] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.579983 31884 raft_consensus.cc:515] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:34.585093 31736 raft_consensus.cc:1275] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:34.588299 32185 consensus_queue.cc:1048] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:34.590457 31736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25de9098314aceac44060050fd5029" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81435d91a22f4ce2bd6fdcc808e3322f"
I20260709 13:10:34.591149 31736 raft_consensus.cc:3055] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.591472 31736 raft_consensus.cc:740] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81435d91a22f4ce2bd6fdcc808e3322f, State: Running, Role: LEADER
I20260709 13:10:34.593441 31884 leader_election.cc:290] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 2 election: Requested vote from peers 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403), 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565)
I20260709 13:10:34.594826 31815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c25de9098314aceac44060050fd5029" candidate_uuid: "f7c901a13ca247a39def39190e6d3a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3295d611a6f945d599723008eb8378a4"
I20260709 13:10:34.595573 31815 raft_consensus.cc:3060] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.592443 31736 consensus_queue.cc:260] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:34.599404 31736 raft_consensus.cc:3060] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.602826 31815 raft_consensus.cc:2468] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 2.
I20260709 13:10:34.604148 31855 leader_election.cc:304] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3295d611a6f945d599723008eb8378a4, f7c901a13ca247a39def39190e6d3a50; no voters: 
I20260709 13:10:34.605116 32185 raft_consensus.cc:2804] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.605665 32185 raft_consensus.cc:697] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 2 LEADER]: Becoming Leader. State: Replica: f7c901a13ca247a39def39190e6d3a50, State: Running, Role: LEADER
I20260709 13:10:34.606657 31736 raft_consensus.cc:2468] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7c901a13ca247a39def39190e6d3a50 in term 2.
I20260709 13:10:34.606555 32185 consensus_queue.cc:237] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } }
I20260709 13:10:34.616328 31636 catalog_manager.cc:5697] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 reported cstate change: term changed from 1 to 2, leader changed from 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1) to f7c901a13ca247a39def39190e6d3a50 (127.20.69.3). New cstate: current_term: 2 leader_uuid: "f7c901a13ca247a39def39190e6d3a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7c901a13ca247a39def39190e6d3a50" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.962481 31735 raft_consensus.cc:1275] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.963900 32185 consensus_queue.cc:1048] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.975842 31813 raft_consensus.cc:1275] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:34.977512 32185 consensus_queue.cc:1048] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.982276 31736 raft_consensus.cc:1275] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:34.983858 31815 raft_consensus.cc:1275] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.983749 32198 consensus_queue.cc:1048] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.988652 32194 consensus_queue.cc:1048] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:35.070811 31736 raft_consensus.cc:1275] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.072345 32198 consensus_queue.cc:1048] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81435d91a22f4ce2bd6fdcc808e3322f" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 38403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.083539 31813 raft_consensus.cc:1275] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Refusing update from remote peer f7c901a13ca247a39def39190e6d3a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.085626 32194 consensus_queue.cc:1048] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3295d611a6f945d599723008eb8378a4" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.151710 20756 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:35.157449 20756 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:35.157981 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:35.163415 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:35.163784 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:36.192571 20756 tablet_server.cc:179] TabletServer@127.20.69.1:0 shutting down...
W20260709 13:10:36.221662 31780 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 13:10:36.222672 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:36.223606 20756 tablet_replica.cc:333] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.224349 20756 raft_consensus.cc:2243] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.225219 20756 raft_consensus.cc:2272] T 5e7cea8ee6204400814356832e5d509e P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.225502 31780 consensus_peers.cc:597] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 -> Peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Couldn't send request to peer 81435d91a22f4ce2bd6fdcc808e3322f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.227540 20756 tablet_replica.cc:333] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
W20260709 13:10:36.228106 31780 consensus_peers.cc:597] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 -> Peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Couldn't send request to peer 81435d91a22f4ce2bd6fdcc808e3322f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.228463 20756 raft_consensus.cc:2243] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.229215 20756 raft_consensus.cc:2272] T 232def8a4f384c329edf4e7fea57729c P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.231302 20756 tablet_replica.cc:333] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.231940 20756 raft_consensus.cc:2243] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.232899 20756 raft_consensus.cc:2272] T 964ae64df61c4594a4a4f87e5da88740 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.235126 20756 tablet_replica.cc:333] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.235742 20756 raft_consensus.cc:2243] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.236584 20756 raft_consensus.cc:2272] T 50b748e21a90443fa0d605b9b077a815 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.238591 20756 tablet_replica.cc:333] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.239162 20756 raft_consensus.cc:2243] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.239626 20756 raft_consensus.cc:2272] T 4086d9d408b74c72939b000c049d5ab6 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.241612 20756 tablet_replica.cc:333] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.242235 20756 raft_consensus.cc:2243] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.242697 20756 raft_consensus.cc:2272] T c48d89f3174a427eabe72f945196e91c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.244860 20756 tablet_replica.cc:333] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.245419 20756 raft_consensus.cc:2243] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.246310 20756 raft_consensus.cc:2272] T 0804573c212544c380a5e1a41a844ee8 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.248677 20756 tablet_replica.cc:333] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.249280 20756 raft_consensus.cc:2243] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.249794 20756 raft_consensus.cc:2272] T c35d68ecd57b45ee9f52f637978dfdf2 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.251945 20756 tablet_replica.cc:333] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.252851 20756 raft_consensus.cc:2243] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.253388 20756 raft_consensus.cc:2272] T 5e1999eec34d4884b38d9a1a65f85b06 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.254032 31780 consensus_peers.cc:597] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 -> Peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Couldn't send request to peer 81435d91a22f4ce2bd6fdcc808e3322f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.255671 20756 tablet_replica.cc:333] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.256309 20756 raft_consensus.cc:2243] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.257045 20756 raft_consensus.cc:2272] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.258832 20756 tablet_replica.cc:333] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.259328 20756 raft_consensus.cc:2243] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.259722 20756 raft_consensus.cc:2272] T 259dd86364834836a48c6644687537f5 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.261766 20756 tablet_replica.cc:333] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.262264 20756 raft_consensus.cc:2243] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.262640 20756 raft_consensus.cc:2272] T 4586651d3fd347c2933fe6e281b57e10 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.264659 20756 tablet_replica.cc:333] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.265182 20756 raft_consensus.cc:2243] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.265538 20756 raft_consensus.cc:2272] T 5c25de9098314aceac44060050fd5029 P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.267742 20756 tablet_replica.cc:333] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.268229 20756 raft_consensus.cc:2243] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.268621 20756 raft_consensus.cc:2272] T 412b367637e14ce0ac374a24a421d2ba P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.270314 20756 tablet_replica.cc:333] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.270818 20756 raft_consensus.cc:2243] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.271565 20756 raft_consensus.cc:2272] T d97e1e5f11964d5cb24be7266a039f26 P 81435d91a22f4ce2bd6fdcc808e3322f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.273504 20756 tablet_replica.cc:333] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.274075 20756 raft_consensus.cc:2243] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.274537 20756 raft_consensus.cc:2272] T 59aeefcdd4294178ba3886088bbcd86c P 81435d91a22f4ce2bd6fdcc808e3322f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.276465 20756 tablet_replica.cc:333] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.276973 20756 raft_consensus.cc:2243] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.277338 20756 raft_consensus.cc:2272] T b1929fea04b24cedb94ed6ba76ebc54d P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.278998 20756 tablet_replica.cc:333] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f: stopping tablet replica
I20260709 13:10:36.279538 20756 raft_consensus.cc:2243] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.279903 20756 raft_consensus.cc:2272] T 702f67aea26943cf9aeabef3d60f3c79 P 81435d91a22f4ce2bd6fdcc808e3322f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.321559 20756 tablet_server.cc:196] TabletServer@127.20.69.1:0 shutdown complete.
I20260709 13:10:36.353586 20756 tablet_server.cc:179] TabletServer@127.20.69.2:0 shutting down...
I20260709 13:10:36.383270 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:36.383924 20756 tablet_replica.cc:333] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.384546 20756 raft_consensus.cc:2243] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.385133 20756 raft_consensus.cc:2272] T 232def8a4f384c329edf4e7fea57729c P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.387051 20756 tablet_replica.cc:333] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.387676 20756 raft_consensus.cc:2243] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.388142 20756 raft_consensus.cc:2272] T 50b748e21a90443fa0d605b9b077a815 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.390110 20756 tablet_replica.cc:333] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.390705 20756 raft_consensus.cc:2243] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.391176 20756 raft_consensus.cc:2272] T 5e7cea8ee6204400814356832e5d509e P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.393294 20756 tablet_replica.cc:333] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.393842 20756 raft_consensus.cc:2243] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.394304 20756 raft_consensus.cc:2272] T 59aeefcdd4294178ba3886088bbcd86c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.396371 20756 tablet_replica.cc:333] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.396975 20756 raft_consensus.cc:2243] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.397401 20756 raft_consensus.cc:2272] T 702f67aea26943cf9aeabef3d60f3c79 P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.399766 20756 tablet_replica.cc:333] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.400334 20756 raft_consensus.cc:2243] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.400820 20756 raft_consensus.cc:2272] T b1929fea04b24cedb94ed6ba76ebc54d P 3295d611a6f945d599723008eb8378a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.402647 20756 tablet_replica.cc:333] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.403226 20756 raft_consensus.cc:2243] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.403698 20756 raft_consensus.cc:2272] T 964ae64df61c4594a4a4f87e5da88740 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.404531 31855 consensus_peers.cc:597] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 -> Peer 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565): Couldn't send request to peer 3295d611a6f945d599723008eb8378a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.406097 20756 tablet_replica.cc:333] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.406948 20756 raft_consensus.cc:2243] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.407423 20756 raft_consensus.cc:2272] T 0804573c212544c380a5e1a41a844ee8 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.409566 31855 consensus_peers.cc:597] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 -> Peer 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565): Couldn't send request to peer 3295d611a6f945d599723008eb8378a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.410161 20756 tablet_replica.cc:333] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.410778 20756 raft_consensus.cc:2243] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.411530 20756 raft_consensus.cc:2272] T 4086d9d408b74c72939b000c049d5ab6 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.413321 20756 tablet_replica.cc:333] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.413916 20756 raft_consensus.cc:2243] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.414670 20756 raft_consensus.cc:2272] T c48d89f3174a427eabe72f945196e91c P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.416822 20756 tablet_replica.cc:333] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.417383 20756 raft_consensus.cc:2243] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.417809 20756 raft_consensus.cc:2272] T 5c25de9098314aceac44060050fd5029 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.419970 20756 tablet_replica.cc:333] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.420506 20756 raft_consensus.cc:2243] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.420956 20756 raft_consensus.cc:2272] T 412b367637e14ce0ac374a24a421d2ba P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.422905 20756 tablet_replica.cc:333] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.423612 20756 raft_consensus.cc:2243] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.424149 20756 raft_consensus.cc:2272] T d97e1e5f11964d5cb24be7266a039f26 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.427556 20756 tablet_replica.cc:333] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.428352 20756 raft_consensus.cc:2243] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.428964 20756 raft_consensus.cc:2272] T ba0c2e375dc94154ae3a5ff7ddcfd68a P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.431813 20756 tablet_replica.cc:333] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
W20260709 13:10:36.432291 31780 consensus_peers.cc:597] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 -> Peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Couldn't send request to peer 81435d91a22f4ce2bd6fdcc808e3322f. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.432446 20756 raft_consensus.cc:2243] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.433403 20756 raft_consensus.cc:2272] T 259dd86364834836a48c6644687537f5 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.435981 20756 tablet_replica.cc:333] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.436548 20756 raft_consensus.cc:2243] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.437414 20756 raft_consensus.cc:2272] T 4586651d3fd347c2933fe6e281b57e10 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.440853 20756 tablet_replica.cc:333] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.441388 20756 raft_consensus.cc:2243] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.442138 20756 raft_consensus.cc:2272] T c35d68ecd57b45ee9f52f637978dfdf2 P 3295d611a6f945d599723008eb8378a4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.442308 31854 consensus_peers.cc:597] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 -> Peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Couldn't send request to peer 81435d91a22f4ce2bd6fdcc808e3322f. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.444092 20756 tablet_replica.cc:333] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4: stopping tablet replica
I20260709 13:10:36.444752 20756 raft_consensus.cc:2243] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.445556 20756 raft_consensus.cc:2272] T 5e1999eec34d4884b38d9a1a65f85b06 P 3295d611a6f945d599723008eb8378a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.486812 20756 tablet_server.cc:196] TabletServer@127.20.69.2:0 shutdown complete.
I20260709 13:10:36.521611 20756 tablet_server.cc:179] TabletServer@127.20.69.3:0 shutting down...
W20260709 13:10:36.536244 31854 consensus_peers.cc:597] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 -> Peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Couldn't send request to peer 81435d91a22f4ce2bd6fdcc808e3322f. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.544953 31854 consensus_peers.cc:597] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 -> Peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Couldn't send request to peer 81435d91a22f4ce2bd6fdcc808e3322f. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.558277 31854 consensus_peers.cc:597] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 -> Peer 81435d91a22f4ce2bd6fdcc808e3322f (127.20.69.1:38403): Couldn't send request to peer 81435d91a22f4ce2bd6fdcc808e3322f. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:38403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.559923 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:36.560824 20756 tablet_replica.cc:333] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
W20260709 13:10:36.561295 31855 consensus_peers.cc:597] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 -> Peer 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565): Couldn't send request to peer 3295d611a6f945d599723008eb8378a4. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:38565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.561427 20756 raft_consensus.cc:2243] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.562062 20756 raft_consensus.cc:2272] T 5e7cea8ee6204400814356832e5d509e P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.563934 20756 tablet_replica.cc:333] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.564512 20756 raft_consensus.cc:2243] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.565371 20756 raft_consensus.cc:2272] T 232def8a4f384c329edf4e7fea57729c P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.567348 20756 tablet_replica.cc:333] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.567911 20756 raft_consensus.cc:2243] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.568747 20756 raft_consensus.cc:2272] T 59aeefcdd4294178ba3886088bbcd86c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.570703 20756 tablet_replica.cc:333] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.571228 20756 raft_consensus.cc:2243] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.571691 20756 raft_consensus.cc:2272] T 964ae64df61c4594a4a4f87e5da88740 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.573659 20756 tablet_replica.cc:333] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.574180 20756 raft_consensus.cc:2243] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.574599 20756 raft_consensus.cc:2272] T ba0c2e375dc94154ae3a5ff7ddcfd68a P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.576370 20756 tablet_replica.cc:333] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.576958 20756 raft_consensus.cc:2243] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.577400 20756 raft_consensus.cc:2272] T 259dd86364834836a48c6644687537f5 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.579336 20756 tablet_replica.cc:333] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.579952 20756 raft_consensus.cc:2243] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.580464 20756 raft_consensus.cc:2272] T 4586651d3fd347c2933fe6e281b57e10 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.582677 20756 tablet_replica.cc:333] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.583233 20756 raft_consensus.cc:2243] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.583738 20756 raft_consensus.cc:2272] T c35d68ecd57b45ee9f52f637978dfdf2 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:36.583678 31855 consensus_peers.cc:597] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 -> Peer 3295d611a6f945d599723008eb8378a4 (127.20.69.2:38565): Couldn't send request to peer 3295d611a6f945d599723008eb8378a4. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:38565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.586076 20756 tablet_replica.cc:333] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.586596 20756 raft_consensus.cc:2243] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.586994 20756 raft_consensus.cc:2272] T 5e1999eec34d4884b38d9a1a65f85b06 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.588992 20756 tablet_replica.cc:333] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.589485 20756 raft_consensus.cc:2243] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.590201 20756 raft_consensus.cc:2272] T b1929fea04b24cedb94ed6ba76ebc54d P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.592118 20756 tablet_replica.cc:333] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.592721 20756 raft_consensus.cc:2243] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.593452 20756 raft_consensus.cc:2272] T 702f67aea26943cf9aeabef3d60f3c79 P f7c901a13ca247a39def39190e6d3a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.595543 20756 tablet_replica.cc:333] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.596073 20756 raft_consensus.cc:2243] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.596454 20756 raft_consensus.cc:2272] T 50b748e21a90443fa0d605b9b077a815 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.598305 20756 tablet_replica.cc:333] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.598799 20756 raft_consensus.cc:2243] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.599164 20756 raft_consensus.cc:2272] T 4086d9d408b74c72939b000c049d5ab6 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.601058 20756 tablet_replica.cc:333] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.601594 20756 raft_consensus.cc:2243] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.602026 20756 raft_consensus.cc:2272] T c48d89f3174a427eabe72f945196e91c P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.604118 20756 tablet_replica.cc:333] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.604636 20756 raft_consensus.cc:2243] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.605379 20756 raft_consensus.cc:2272] T 5c25de9098314aceac44060050fd5029 P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.607426 20756 tablet_replica.cc:333] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.607900 20756 raft_consensus.cc:2243] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.608662 20756 raft_consensus.cc:2272] T 412b367637e14ce0ac374a24a421d2ba P f7c901a13ca247a39def39190e6d3a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.610487 20756 tablet_replica.cc:333] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.610930 20756 raft_consensus.cc:2243] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.611303 20756 raft_consensus.cc:2272] T d97e1e5f11964d5cb24be7266a039f26 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.613240 20756 tablet_replica.cc:333] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50: stopping tablet replica
I20260709 13:10:36.613658 20756 raft_consensus.cc:2243] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.614002 20756 raft_consensus.cc:2272] T 0804573c212544c380a5e1a41a844ee8 P f7c901a13ca247a39def39190e6d3a50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.652069 20756 tablet_server.cc:196] TabletServer@127.20.69.3:0 shutdown complete.
I20260709 13:10:36.685487 20756 master.cc:562] Master@127.20.69.62:38953 shutting down...
I20260709 13:10:36.724895 20756 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.725623 20756 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.726130 20756 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1e645006546943c88e7eeebf40b05d30: stopping tablet replica
I20260709 13:10:36.748939 20756 master.cc:584] Master@127.20.69.62:38953 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12696 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:36.800872 20756 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.69.62:41817
I20260709 13:10:36.802040 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:36.807701 32208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.807765 32209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:36.809490 32211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:36.810537 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:36.811481 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:36.811692 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:36.811861 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602636811827 us; error 0 us; skew 500 ppm
I20260709 13:10:36.812408 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:36.814881 20756 webserver.cc:533] Webserver started at http://127.20.69.62:46587/ using document root <none> and password file <none>
I20260709 13:10:36.815380 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:36.815568 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:36.815857 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:36.817368 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/master-0-root/instance:
uuid: "aafc98a4e2384f0cbd28865a18664e63"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-56lb"
I20260709 13:10:36.821969 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:36.825492 32216 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:36.826316 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:10:36.826643 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/master-0-root
uuid: "aafc98a4e2384f0cbd28865a18664e63"
format_stamp: "Formatted at 2026-07-09 13:10:36 on dist-test-slave-56lb"
I20260709 13:10:36.826941 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:36.852986 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:36.854250 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:36.893613 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.62:41817
I20260709 13:10:36.893745 32267 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.62:41817 every 8 connection(s)
I20260709 13:10:36.897532 32268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:36.908852 32268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63: Bootstrap starting.
I20260709 13:10:36.913731 32268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:36.918318 32268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63: No bootstrap required, opened a new log
I20260709 13:10:36.920571 32268 raft_consensus.cc:359] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aafc98a4e2384f0cbd28865a18664e63" member_type: VOTER }
I20260709 13:10:36.921083 32268 raft_consensus.cc:385] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:36.921277 32268 raft_consensus.cc:740] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aafc98a4e2384f0cbd28865a18664e63, State: Initialized, Role: FOLLOWER
I20260709 13:10:36.921949 32268 consensus_queue.cc:260] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aafc98a4e2384f0cbd28865a18664e63" member_type: VOTER }
I20260709 13:10:36.922436 32268 raft_consensus.cc:399] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:36.922678 32268 raft_consensus.cc:493] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:36.922967 32268 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:36.928025 32268 raft_consensus.cc:515] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aafc98a4e2384f0cbd28865a18664e63" member_type: VOTER }
I20260709 13:10:36.928732 32268 leader_election.cc:304] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aafc98a4e2384f0cbd28865a18664e63; no voters: 
I20260709 13:10:36.929924 32268 leader_election.cc:290] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:36.930352 32271 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:36.931768 32271 raft_consensus.cc:697] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 1 LEADER]: Becoming Leader. State: Replica: aafc98a4e2384f0cbd28865a18664e63, State: Running, Role: LEADER
I20260709 13:10:36.932446 32271 consensus_queue.cc:237] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aafc98a4e2384f0cbd28865a18664e63" member_type: VOTER }
I20260709 13:10:36.933008 32268 sys_catalog.cc:565] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:36.937041 32273 sys_catalog.cc:455] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aafc98a4e2384f0cbd28865a18664e63. Latest consensus state: current_term: 1 leader_uuid: "aafc98a4e2384f0cbd28865a18664e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aafc98a4e2384f0cbd28865a18664e63" member_type: VOTER } }
I20260709 13:10:36.937683 32273 sys_catalog.cc:458] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:36.942799 32272 sys_catalog.cc:455] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aafc98a4e2384f0cbd28865a18664e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aafc98a4e2384f0cbd28865a18664e63" member_type: VOTER } }
I20260709 13:10:36.943361 32272 sys_catalog.cc:458] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:36.951059 20756 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260709 13:10:36.953948 32287 catalog_manager.cc:1594] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260709 13:10:36.954200 32287 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260709 13:10:36.954479 32279 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:36.958873 32279 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:36.967687 32279 catalog_manager.cc:1383] Generated new cluster ID: f47da649748a4170bc1646de9f2460b1
I20260709 13:10:36.968019 32279 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:36.999909 32279 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:37.001822 32279 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:37.044516 32279 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63: Generated new TSK 0
I20260709 13:10:37.045450 32279 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:37.094135 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:37.102912 32290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.103842 32291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:37.108227 20756 server_base.cc:1061] running on GCE node
W20260709 13:10:37.108271 32293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:37.110024 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:37.110267 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:37.110466 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602637110450 us; error 0 us; skew 500 ppm
I20260709 13:10:37.111171 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:37.114157 20756 webserver.cc:533] Webserver started at http://127.20.69.1:36611/ using document root <none> and password file <none>
I20260709 13:10:37.114763 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:37.114982 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:37.115302 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:37.116984 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-0-root/instance:
uuid: "036a73fc2e744989b2d6be1020a7143d"
format_stamp: "Formatted at 2026-07-09 13:10:37 on dist-test-slave-56lb"
I20260709 13:10:37.122251 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:10:37.126210 32298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.127012 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:37.127352 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-0-root
uuid: "036a73fc2e744989b2d6be1020a7143d"
format_stamp: "Formatted at 2026-07-09 13:10:37 on dist-test-slave-56lb"
I20260709 13:10:37.127655 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:37.143772 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:37.145263 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:37.146881 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:37.149513 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:37.149755 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.150015 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:37.150214 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.194506 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.1:35077
I20260709 13:10:37.194612 32360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.1:35077 every 8 connection(s)
I20260709 13:10:37.200848 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:37.209932 32365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.211599 32366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.214725 32368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:37.215902 20756 server_base.cc:1061] running on GCE node
I20260709 13:10:37.216356 32361 heartbeater.cc:344] Connected to a master server at 127.20.69.62:41817
I20260709 13:10:37.216861 32361 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:37.217567 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:37.217892 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:37.217739 32361 heartbeater.cc:507] Master 127.20.69.62:41817 requested a full tablet report, sending...
I20260709 13:10:37.218236 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602637218218 us; error 0 us; skew 500 ppm
I20260709 13:10:37.219010 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:37.221040 32233 ts_manager.cc:194] Registered new tserver with Master: 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077)
I20260709 13:10:37.222193 20756 webserver.cc:533] Webserver started at http://127.20.69.2:38759/ using document root <none> and password file <none>
I20260709 13:10:37.223047 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:37.223305 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:37.223641 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:37.224288 32233 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42760
I20260709 13:10:37.225586 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-1-root/instance:
uuid: "78099f91879a4fac821e248e77afbd0f"
format_stamp: "Formatted at 2026-07-09 13:10:37 on dist-test-slave-56lb"
I20260709 13:10:37.231210 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:37.235270 32373 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.236186 20756 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:37.236552 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-1-root
uuid: "78099f91879a4fac821e248e77afbd0f"
format_stamp: "Formatted at 2026-07-09 13:10:37 on dist-test-slave-56lb"
I20260709 13:10:37.236961 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:37.259562 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:37.260975 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:37.262591 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:37.265166 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:37.265419 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.265677 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:37.265873 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.308293 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.2:40877
I20260709 13:10:37.308409 32435 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.2:40877 every 8 connection(s)
I20260709 13:10:37.313735 20756 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:37.321955 32439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:37.322928 32440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:37.326946 20756 server_base.cc:1061] running on GCE node
W20260709 13:10:37.327277 32443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:37.328421 20756 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:37.328720 20756 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:37.328900 20756 hybrid_clock.cc:648] HybridClock initialized: now 1783602637328884 us; error 0 us; skew 500 ppm
I20260709 13:10:37.329596 20756 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:37.332535 20756 webserver.cc:533] Webserver started at http://127.20.69.3:42013/ using document root <none> and password file <none>
I20260709 13:10:37.333312 20756 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:37.333559 20756 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:37.333884 32436 heartbeater.cc:344] Connected to a master server at 127.20.69.62:41817
I20260709 13:10:37.333917 20756 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:37.334390 32436 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:37.335245 32436 heartbeater.cc:507] Master 127.20.69.62:41817 requested a full tablet report, sending...
I20260709 13:10:37.335481 20756 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-2-root/instance:
uuid: "ecfc475fc7344b56984a0936a43b831b"
format_stamp: "Formatted at 2026-07-09 13:10:37 on dist-test-slave-56lb"
I20260709 13:10:37.337440 32233 ts_manager.cc:194] Registered new tserver with Master: 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:37.339465 32233 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42762
I20260709 13:10:37.341849 20756 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:10:37.345920 32447 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.346736 20756 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:37.347069 20756 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-2-root
uuid: "ecfc475fc7344b56984a0936a43b831b"
format_stamp: "Formatted at 2026-07-09 13:10:37 on dist-test-slave-56lb"
I20260709 13:10:37.347388 20756 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskwCFaU0/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602306874617-20756-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:37.372542 20756 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:37.373900 20756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:37.375460 20756 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:37.377882 20756 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:37.378119 20756 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.378364 20756 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:37.378540 20756 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:37.421142 20756 rpc_server.cc:307] RPC server started. Bound to: 127.20.69.3:42077
I20260709 13:10:37.421240 32509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.69.3:42077 every 8 connection(s)
I20260709 13:10:37.436286 32510 heartbeater.cc:344] Connected to a master server at 127.20.69.62:41817
I20260709 13:10:37.436717 32510 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:37.437551 32510 heartbeater.cc:507] Master 127.20.69.62:41817 requested a full tablet report, sending...
I20260709 13:10:37.439673 32233 ts_manager.cc:194] Registered new tserver with Master: ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:37.440516 20756 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015854065s
I20260709 13:10:37.441213 32233 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42766
I20260709 13:10:37.469539 32233 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42778:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:37.472529 32233 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:37.553805 32326 tablet_service.cc:1511] Processing CreateTablet for tablet 22257a12f6e040709c74744a0a217635 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:37.554828 32325 tablet_service.cc:1511] Processing CreateTablet for tablet 3d3a433578c1432ca8ddc36094708b16 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:37.555687 32326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22257a12f6e040709c74744a0a217635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.556568 32325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3a433578c1432ca8ddc36094708b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.562191 32324 tablet_service.cc:1511] Processing CreateTablet for tablet a3b20b75a2b24d619d7b7c190a19e591 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:37.564220 32324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b20b75a2b24d619d7b7c190a19e591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.566675 32323 tablet_service.cc:1511] Processing CreateTablet for tablet cff08ecb1bf24a3aa812cbcfd2889fa8 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:37.573372 32322 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4ba051e42149f5a5e24e8129e735b5 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:37.575275 32322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4ba051e42149f5a5e24e8129e735b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.577000 32323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff08ecb1bf24a3aa812cbcfd2889fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.581830 32401 tablet_service.cc:1511] Processing CreateTablet for tablet 22257a12f6e040709c74744a0a217635 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:37.582768 32399 tablet_service.cc:1511] Processing CreateTablet for tablet a3b20b75a2b24d619d7b7c190a19e591 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:37.583585 32401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22257a12f6e040709c74744a0a217635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.585431 32400 tablet_service.cc:1511] Processing CreateTablet for tablet 3d3a433578c1432ca8ddc36094708b16 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:37.586184 32398 tablet_service.cc:1511] Processing CreateTablet for tablet cff08ecb1bf24a3aa812cbcfd2889fa8 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:37.586341 32396 tablet_service.cc:1511] Processing CreateTablet for tablet ae711578b5fb49a4a884c3c7c15a4eb9 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:37.584445 32399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b20b75a2b24d619d7b7c190a19e591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.590268 32321 tablet_service.cc:1511] Processing CreateTablet for tablet ae711578b5fb49a4a884c3c7c15a4eb9 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:37.588307 32397 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4ba051e42149f5a5e24e8129e735b5 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:37.592263 32320 tablet_service.cc:1511] Processing CreateTablet for tablet 117c41c87d814f27bbd17ebf7b0d2ad5 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:37.589970 32395 tablet_service.cc:1511] Processing CreateTablet for tablet 117c41c87d814f27bbd17ebf7b0d2ad5 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:37.594300 32397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4ba051e42149f5a5e24e8129e735b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.595011 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3a433578c1432ca8ddc36094708b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.597034 32395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117c41c87d814f27bbd17ebf7b0d2ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.601078 32396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae711578b5fb49a4a884c3c7c15a4eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.604974 32398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff08ecb1bf24a3aa812cbcfd2889fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.605532 32321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae711578b5fb49a4a884c3c7c15a4eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.608644 32320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117c41c87d814f27bbd17ebf7b0d2ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.629534 32326 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea241c8fe8746498950fdc7e74a22b0 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:37.637430 32326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea241c8fe8746498950fdc7e74a22b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.663278 32394 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea241c8fe8746498950fdc7e74a22b0 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:37.664930 32394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea241c8fe8746498950fdc7e74a22b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.666471 32319 tablet_service.cc:1511] Processing CreateTablet for tablet 53502e0413404888895b5f18672ad837 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:37.668007 32319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53502e0413404888895b5f18672ad837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.673489 32475 tablet_service.cc:1511] Processing CreateTablet for tablet 22257a12f6e040709c74744a0a217635 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:37.675032 32475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22257a12f6e040709c74744a0a217635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.675786 32472 tablet_service.cc:1511] Processing CreateTablet for tablet cff08ecb1bf24a3aa812cbcfd2889fa8 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:37.677649 32472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff08ecb1bf24a3aa812cbcfd2889fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.677870 32474 tablet_service.cc:1511] Processing CreateTablet for tablet 3d3a433578c1432ca8ddc36094708b16 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:37.679286 32474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3a433578c1432ca8ddc36094708b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.681808 32473 tablet_service.cc:1511] Processing CreateTablet for tablet a3b20b75a2b24d619d7b7c190a19e591 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:37.683250 32473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b20b75a2b24d619d7b7c190a19e591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.683336 32469 tablet_service.cc:1511] Processing CreateTablet for tablet 117c41c87d814f27bbd17ebf7b0d2ad5 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:37.685815 32471 tablet_service.cc:1511] Processing CreateTablet for tablet 7f4ba051e42149f5a5e24e8129e735b5 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:37.681849 32470 tablet_service.cc:1511] Processing CreateTablet for tablet ae711578b5fb49a4a884c3c7c15a4eb9 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:37.687556 32393 tablet_service.cc:1511] Processing CreateTablet for tablet 53502e0413404888895b5f18672ad837 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:37.689230 32393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53502e0413404888895b5f18672ad837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.699919 32469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117c41c87d814f27bbd17ebf7b0d2ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.701004 32470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae711578b5fb49a4a884c3c7c15a4eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.705147 32471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f4ba051e42149f5a5e24e8129e735b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.707019 32468 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea241c8fe8746498950fdc7e74a22b0 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:37.710973 32467 tablet_service.cc:1511] Processing CreateTablet for tablet 53502e0413404888895b5f18672ad837 (DEFAULT_TABLE table=test-workload [id=0e9e0a7e8b334ceaa5f95824110079c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:37.713219 32468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea241c8fe8746498950fdc7e74a22b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.715277 32467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53502e0413404888895b5f18672ad837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.807403 32524 tablet_bootstrap.cc:492] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:37.819389 32525 tablet_bootstrap.cc:492] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:37.836513 32526 tablet_bootstrap.cc:492] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:37.844764 32524 tablet_bootstrap.cc:654] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.851605 32526 tablet_bootstrap.cc:654] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.853896 32525 tablet_bootstrap.cc:654] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.858814 32524 tablet_bootstrap.cc:492] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:37.859527 32524 ts_tablet_manager.cc:1403] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.007s
I20260709 13:10:37.863049 32526 tablet_bootstrap.cc:492] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:37.863786 32526 ts_tablet_manager.cc:1403] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 13:10:37.863013 32524 raft_consensus.cc:359] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.864217 32525 tablet_bootstrap.cc:492] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:37.864217 32524 raft_consensus.cc:385] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.864833 32525 ts_tablet_manager.cc:1403] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.000s
I20260709 13:10:37.864881 32524 raft_consensus.cc:740] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.866005 32524 consensus_queue.cc:260] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.867170 32526 raft_consensus.cc:359] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:37.867339 32525 raft_consensus.cc:359] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:37.868165 32526 raft_consensus.cc:385] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.868291 32525 raft_consensus.cc:385] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.868558 32526 raft_consensus.cc:740] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.868709 32525 raft_consensus.cc:740] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.868709 32361 heartbeater.cc:499] Master 127.20.69.62:41817 was elected leader, sending a full tablet report...
I20260709 13:10:37.869203 32524 ts_tablet_manager.cc:1434] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.001s
I20260709 13:10:37.869581 32526 consensus_queue.cc:260] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:37.869901 32525 consensus_queue.cc:260] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:37.870446 32524 tablet_bootstrap.cc:492] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:37.875897 32526 ts_tablet_manager.cc:1434] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.005s
I20260709 13:10:37.876287 32510 heartbeater.cc:499] Master 127.20.69.62:41817 was elected leader, sending a full tablet report...
I20260709 13:10:37.876927 32525 ts_tablet_manager.cc:1434] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.005s
I20260709 13:10:37.877038 32526 tablet_bootstrap.cc:492] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:37.880035 32436 heartbeater.cc:499] Master 127.20.69.62:41817 was elected leader, sending a full tablet report...
I20260709 13:10:37.881124 32525 tablet_bootstrap.cc:492] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:37.888300 32525 tablet_bootstrap.cc:654] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.888670 32526 tablet_bootstrap.cc:654] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.889008 32524 tablet_bootstrap.cc:654] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.897959 32526 tablet_bootstrap.cc:492] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:37.898147 32531 raft_consensus.cc:493] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.898577 32526 ts_tablet_manager.cc:1403] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:10:37.898798 32531 raft_consensus.cc:515] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:37.901979 32526 raft_consensus.cc:359] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.902783 32526 raft_consensus.cc:385] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.903091 32526 raft_consensus.cc:740] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.905773 32531 leader_election.cc:290] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:37.908694 32525 tablet_bootstrap.cc:492] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:37.908830 32524 tablet_bootstrap.cc:492] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:37.909530 32524 ts_tablet_manager.cc:1403] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.018s
I20260709 13:10:37.909525 32525 ts_tablet_manager.cc:1403] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.016s
I20260709 13:10:37.912923 32524 raft_consensus.cc:359] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:37.913695 32524 raft_consensus.cc:385] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.913988 32524 raft_consensus.cc:740] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.914776 32524 consensus_queue.cc:260] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:37.917347 32524 ts_tablet_manager.cc:1434] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:10:37.905421 32526 consensus_queue.cc:260] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.918371 32524 tablet_bootstrap.cc:492] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:37.919483 32525 raft_consensus.cc:359] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.920423 32525 raft_consensus.cc:385] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.920918 32525 raft_consensus.cc:740] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.922185 32526 ts_tablet_manager.cc:1434] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:10:37.921841 32525 consensus_queue.cc:260] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.923162 32336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22257a12f6e040709c74744a0a217635" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:37.924185 32336 raft_consensus.cc:2468] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:37.925725 32525 ts_tablet_manager.cc:1434] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:10:37.926059 32449 leader_election.cc:304] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:37.927080 32531 raft_consensus.cc:2804] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:37.927428 32531 raft_consensus.cc:493] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.927783 32531 raft_consensus.cc:3060] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.927856 32524 tablet_bootstrap.cc:654] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.928295 32525 tablet_bootstrap.cc:492] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:37.936239 32525 tablet_bootstrap.cc:654] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:37.943655 32281 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:37.924316 32526 tablet_bootstrap.cc:492] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:37.956141 32524 tablet_bootstrap.cc:492] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:37.956887 32524 ts_tablet_manager.cc:1403] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.005s
I20260709 13:10:37.957226 32525 tablet_bootstrap.cc:492] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:37.957857 32525 ts_tablet_manager.cc:1403] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.011s
I20260709 13:10:37.957979 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22257a12f6e040709c74744a0a217635" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:37.958781 32411 raft_consensus.cc:2468] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:37.956303 32531 raft_consensus.cc:515] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:37.961416 32524 raft_consensus.cc:359] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.962193 32531 leader_election.cc:290] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:37.962318 32524 raft_consensus.cc:385] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.962819 32524 raft_consensus.cc:740] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.963460 32336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22257a12f6e040709c74744a0a217635" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:37.964016 32336 raft_consensus.cc:3060] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.963622 32524 consensus_queue.cc:260] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.966092 32524 ts_tablet_manager.cc:1434] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:10:37.964303 32525 raft_consensus.cc:359] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.967103 32525 raft_consensus.cc:385] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:37.967212 32524 tablet_bootstrap.cc:492] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:37.967538 32525 raft_consensus.cc:740] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:37.968540 32525 consensus_queue.cc:260] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:37.969542 32526 tablet_bootstrap.cc:654] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.974992 32524 tablet_bootstrap.cc:654] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:37.976644 32525 ts_tablet_manager.cc:1434] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:10:37.977118 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22257a12f6e040709c74744a0a217635" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:37.977972 32525 tablet_bootstrap.cc:492] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:37.977995 32411 raft_consensus.cc:3060] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:37.988054 32525 tablet_bootstrap.cc:654] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.003183 32336 raft_consensus.cc:2468] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.005272 32449 leader_election.cc:304] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.006393 32531 raft_consensus.cc:2804] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.015852 32532 raft_consensus.cc:493] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.016790 32532 raft_consensus.cc:515] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.030336 32530 raft_consensus.cc:493] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.030651 32532 leader_election.cc:290] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.030995 32530 raft_consensus.cc:515] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.031411 32532 raft_consensus.cc:493] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.035737 32524 tablet_bootstrap.cc:492] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:38.036527 32524 ts_tablet_manager.cc:1403] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.070s	user 0.028s	sys 0.027s
I20260709 13:10:38.016518 32411 raft_consensus.cc:2468] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.037604 32532 raft_consensus.cc:515] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.053679 32532 leader_election.cc:290] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.056730 32530 leader_election.cc:290] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.059077 32524 raft_consensus.cc:359] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.060021 32524 raft_consensus.cc:385] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.060352 32524 raft_consensus.cc:740] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.061204 32524 consensus_queue.cc:260] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.062708 32525 tablet_bootstrap.cc:492] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:38.063511 32525 ts_tablet_manager.cc:1403] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.086s	user 0.030s	sys 0.033s
I20260709 13:10:38.068950 32526 tablet_bootstrap.cc:492] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:38.056568 32531 raft_consensus.cc:697] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:38.069578 32526 ts_tablet_manager.cc:1403] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.146s	user 0.034s	sys 0.035s
I20260709 13:10:38.070360 32531 consensus_queue.cc:237] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:38.073269 32526 raft_consensus.cc:359] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.074122 32526 raft_consensus.cc:385] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.074433 32526 raft_consensus.cc:740] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.074590 32336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4ba051e42149f5a5e24e8129e735b5" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.075320 32336 raft_consensus.cc:2468] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:38.075388 32526 consensus_queue.cc:260] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.076032 32524 ts_tablet_manager.cc:1434] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 13:10:38.076727 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53502e0413404888895b5f18672ad837" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.077481 32375 leader_election.cc:304] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:38.078225 32525 raft_consensus.cc:359] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
W20260709 13:10:38.079106 32375 leader_election.cc:343] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.079699 32525 raft_consensus.cc:385] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.080175 32524 tablet_bootstrap.cc:492] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:38.080255 32532 raft_consensus.cc:2804] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.080843 32532 raft_consensus.cc:493] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.081451 32532 raft_consensus.cc:3060] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.080469 32525 raft_consensus.cc:740] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.098628 32524 tablet_bootstrap.cc:654] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.107030 32530 raft_consensus.cc:493] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.109464 32530 raft_consensus.cc:515] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.110318 32526 ts_tablet_manager.cc:1434] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.012s
I20260709 13:10:38.111479 32526 tablet_bootstrap.cc:492] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:38.111711 32530 leader_election.cc:290] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.107559 32525 consensus_queue.cc:260] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.106069 32532 raft_consensus.cc:515] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.115389 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4ba051e42149f5a5e24e8129e735b5" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.116254 32411 raft_consensus.cc:2393] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 036a73fc2e744989b2d6be1020a7143d in current term 1: Already voted for candidate 78099f91879a4fac821e248e77afbd0f in this term.
I20260709 13:10:38.115219 32232 catalog_manager.cc:5697] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 0 to 1, leader changed from <none> to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 1 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.117343 32532 leader_election.cc:290] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.118031 32410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.119333 32526 tablet_bootstrap.cc:654] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.119769 32525 ts_tablet_manager.cc:1434] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.001s
I20260709 13:10:38.119947 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4ba051e42149f5a5e24e8129e735b5" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:38.120744 32335 raft_consensus.cc:3060] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.120950 32525 tablet_bootstrap.cc:492] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:38.140452 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4ba051e42149f5a5e24e8129e735b5" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
W20260709 13:10:38.124468 32301 leader_election.cc:343] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.142256 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53502e0413404888895b5f18672ad837" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:38.143780 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4ba051e42149f5a5e24e8129e735b5" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
W20260709 13:10:38.145815 32376 leader_election.cc:343] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.146165 32335 raft_consensus.cc:2468] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:38.147488 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f4ba051e42149f5a5e24e8129e735b5" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:38.147397 32375 leader_election.cc:304] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:38.149121 32532 raft_consensus.cc:2804] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:38.146862 32376 leader_election.cc:343] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.149792 32532 raft_consensus.cc:697] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:38.149879 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:38.149907 32376 leader_election.cc:304] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f; no voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:38.150695 32484 raft_consensus.cc:2468] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:38.151090 32532 consensus_queue.cc:237] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
W20260709 13:10:38.151847 32301 leader_election.cc:343] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.151974 32543 raft_consensus.cc:2749] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.152413 32301 leader_election.cc:304] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d; no voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:38.153357 32530 raft_consensus.cc:2749] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.155823 32301 leader_election.cc:304] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:38.156787 32530 raft_consensus.cc:2804] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.157294 32530 raft_consensus.cc:493] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.157739 32530 raft_consensus.cc:3060] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.159126 32525 tablet_bootstrap.cc:654] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.159727 32526 tablet_bootstrap.cc:492] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:38.160285 32526 ts_tablet_manager.cc:1403] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.029s
I20260709 13:10:38.163659 32526 raft_consensus.cc:359] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.157305 32524 tablet_bootstrap.cc:492] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:38.164426 32526 raft_consensus.cc:385] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.165114 32526 raft_consensus.cc:740] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.165231 32524 ts_tablet_manager.cc:1403] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.018s
I20260709 13:10:38.166091 32526 consensus_queue.cc:260] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.168239 32543 raft_consensus.cc:493] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.168512 32526 ts_tablet_manager.cc:1434] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:38.168843 32543 raft_consensus.cc:515] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.170173 32526 tablet_bootstrap.cc:492] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:38.171976 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
W20260709 13:10:38.173702 32375 leader_election.cc:343] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.174885 32543 leader_election.cc:290] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.177798 32526 tablet_bootstrap.cc:654] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.186311 32530 raft_consensus.cc:515] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.192912 32410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
W20260709 13:10:38.195123 32301 leader_election.cc:343] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.188448 32524 raft_consensus.cc:359] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
W20260709 13:10:38.196871 32376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.3:42077, user_credentials={real_user=slave}} blocked reactor thread for 50042.7us
I20260709 13:10:38.197103 32524 raft_consensus.cc:385] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:38.197891 32376 leader_election.cc:343] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.197335 32233 catalog_manager.cc:5697] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 1 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.199378 32530 leader_election.cc:290] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.200078 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:38.200856 32484 raft_consensus.cc:3060] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.207652 32525 tablet_bootstrap.cc:492] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:38.208477 32525 ts_tablet_manager.cc:1403] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.009s
I20260709 13:10:38.197902 32524 raft_consensus.cc:740] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.209741 32524 consensus_queue.cc:260] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.211400 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:38.212546 32484 raft_consensus.cc:2468] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
W20260709 13:10:38.213351 32376 leader_election.cc:343] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.213918 32301 leader_election.cc:304] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:38.215556 32376 leader_election.cc:304] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f; no voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:38.216189 32530 raft_consensus.cc:2804] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.216578 32555 raft_consensus.cc:2749] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.215134 32524 ts_tablet_manager.cc:1434] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:10:38.218218 32524 tablet_bootstrap.cc:492] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:38.221166 32530 raft_consensus.cc:697] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:38.222385 32530 consensus_queue.cc:237] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.224587 32525 raft_consensus.cc:359] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.225489 32525 raft_consensus.cc:385] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.225813 32525 raft_consensus.cc:740] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.226385 32524 tablet_bootstrap.cc:654] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.228040 32525 consensus_queue.cc:260] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.229625 32526 tablet_bootstrap.cc:492] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:38.230295 32526 ts_tablet_manager.cc:1403] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.025s
I20260709 13:10:38.231086 32525 ts_tablet_manager.cc:1434] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:10:38.232266 32525 tablet_bootstrap.cc:492] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:38.233446 32526 raft_consensus.cc:359] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.234331 32526 raft_consensus.cc:385] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.234771 32526 raft_consensus.cc:740] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.235702 32526 consensus_queue.cc:260] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.238992 32524 tablet_bootstrap.cc:492] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:38.239675 32524 ts_tablet_manager.cc:1403] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.001s
I20260709 13:10:38.239897 32525 tablet_bootstrap.cc:654] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.243649 32524 raft_consensus.cc:359] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.244495 32524 raft_consensus.cc:385] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.244102 32526 ts_tablet_manager.cc:1434] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:38.244957 32524 raft_consensus.cc:740] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.245946 32524 consensus_queue.cc:260] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.246351 32526 tablet_bootstrap.cc:492] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:38.250385 32524 ts_tablet_manager.cc:1434] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:10:38.251483 32524 tablet_bootstrap.cc:492] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:38.257308 32526 tablet_bootstrap.cc:654] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.261492 32525 tablet_bootstrap.cc:492] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:38.262121 32525 ts_tablet_manager.cc:1403] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260709 13:10:38.263052 32524 tablet_bootstrap.cc:654] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.262727 32233 catalog_manager.cc:5697] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 1 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.265780 32525 raft_consensus.cc:359] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.266834 32525 raft_consensus.cc:385] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.267212 32525 raft_consensus.cc:740] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.268402 32525 consensus_queue.cc:260] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.274611 32524 tablet_bootstrap.cc:492] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:38.275146 32524 ts_tablet_manager.cc:1403] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:10:38.277858 32524 raft_consensus.cc:359] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.278564 32524 raft_consensus.cc:385] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.278856 32524 raft_consensus.cc:740] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.279026 32525 ts_tablet_manager.cc:1434] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:10:38.279701 32524 consensus_queue.cc:260] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.280526 32525 tablet_bootstrap.cc:492] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:38.282160 32524 ts_tablet_manager.cc:1434] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:38.283308 32524 tablet_bootstrap.cc:492] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:38.287432 32526 tablet_bootstrap.cc:492] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:38.288089 32526 ts_tablet_manager.cc:1403] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.015s
I20260709 13:10:38.289906 32524 tablet_bootstrap.cc:654] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.290102 32525 tablet_bootstrap.cc:654] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.290721 32549 raft_consensus.cc:493] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.291293 32549 raft_consensus.cc:515] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.294633 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.295440 32410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.296398 32410 raft_consensus.cc:2468] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
W20260709 13:10:38.296118 32449 leader_election.cc:343] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.298452 32450 leader_election.cc:304] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d
I20260709 13:10:38.299640 32531 raft_consensus.cc:2804] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.300064 32531 raft_consensus.cc:493] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.300441 32531 raft_consensus.cc:3060] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.302274 32525 tablet_bootstrap.cc:492] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:38.302861 32525 ts_tablet_manager.cc:1403] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:10:38.306260 32524 tablet_bootstrap.cc:492] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:38.306810 32549 leader_election.cc:290] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.306823 32524 ts_tablet_manager.cc:1403] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 13:10:38.307631 32531 raft_consensus.cc:515] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.308869 32526 raft_consensus.cc:359] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.309691 32526 raft_consensus.cc:385] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.310025 32526 raft_consensus.cc:740] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.310103 32524 raft_consensus.cc:359] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.310854 32524 raft_consensus.cc:385] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.310745 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:38.311275 32524 raft_consensus.cc:740] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.311014 32526 consensus_queue.cc:260] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.312546 32542 raft_consensus.cc:493] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.312561 32525 raft_consensus.cc:359] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.313149 32542 raft_consensus.cc:515] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.313778 32525 raft_consensus.cc:385] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.314081 32526 ts_tablet_manager.cc:1434] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 13:10:38.315447 32526 tablet_bootstrap.cc:492] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:38.315732 32542 leader_election.cc:290] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.314134 32525 raft_consensus.cc:740] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.317090 32410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.312151 32524 consensus_queue.cc:260] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
W20260709 13:10:38.312580 32449 leader_election.cc:343] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.317203 32525 consensus_queue.cc:260] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.319473 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.320158 32335 raft_consensus.cc:2468] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:38.321518 32449 leader_election.cc:304] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.323283 32525 ts_tablet_manager.cc:1434] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:10:38.324323 32526 tablet_bootstrap.cc:654] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.324517 32525 tablet_bootstrap.cc:492] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:38.324636 32549 raft_consensus.cc:2804] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.325132 32549 raft_consensus.cc:493] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.325487 32524 ts_tablet_manager.cc:1434] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:10:38.325462 32549 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.325934 32410 raft_consensus.cc:2468] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:38.332267 32542 raft_consensus.cc:493] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.332909 32542 raft_consensus.cc:515] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.335155 32549 raft_consensus.cc:515] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.336450 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3a433578c1432ca8ddc36094708b16" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.337200 32411 raft_consensus.cc:2468] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:38.338577 32450 leader_election.cc:304] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.340026 32525 tablet_bootstrap.cc:654] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.340956 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3a433578c1432ca8ddc36094708b16" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.342160 32524 tablet_bootstrap.cc:492] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:38.342630 32335 raft_consensus.cc:2468] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:38.348320 32525 tablet_bootstrap.cc:492] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:38.349053 32525 ts_tablet_manager.cc:1403] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.005s
I20260709 13:10:38.350162 32524 tablet_bootstrap.cc:654] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.350346 32526 tablet_bootstrap.cc:492] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:38.350948 32526 ts_tablet_manager.cc:1403] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.021s
I20260709 13:10:38.352268 32525 raft_consensus.cc:359] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.353139 32525 raft_consensus.cc:385] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.353470 32525 raft_consensus.cc:740] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.354547 32542 leader_election.cc:290] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.354382 32525 consensus_queue.cc:260] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.354839 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:38.355218 32542 raft_consensus.cc:2804] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.355778 32542 raft_consensus.cc:493] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.355180 32526 raft_consensus.cc:359] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.355542 32335 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.356241 32526 raft_consensus.cc:385] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.357403 32526 raft_consensus.cc:740] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.358155 32526 consensus_queue.cc:260] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.360314 32525 ts_tablet_manager.cc:1434] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:38.360455 32526 ts_tablet_manager.cc:1434] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:38.356304 32549 leader_election.cc:290] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.361624 32525 tablet_bootstrap.cc:492] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:38.361631 32526 tablet_bootstrap.cc:492] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:38.365877 32530 raft_consensus.cc:493] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.366555 32530 raft_consensus.cc:515] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.368870 32530 leader_election.cc:290] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.370173 32526 tablet_bootstrap.cc:654] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.371121 32525 tablet_bootstrap.cc:654] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.370949 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:38.356154 32542 raft_consensus.cc:3060] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:38.372822 32301 leader_election.cc:343] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.378633 32410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.379402 32410 raft_consensus.cc:2468] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:38.382856 32301 leader_election.cc:304] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:38.384079 32530 raft_consensus.cc:2804] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.384500 32530 raft_consensus.cc:493] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.384883 32530 raft_consensus.cc:3060] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.391146 32524 tablet_bootstrap.cc:492] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:38.391969 32524 ts_tablet_manager.cc:1403] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 13:10:38.393362 32335 raft_consensus.cc:2468] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.395089 32449 leader_election.cc:304] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.396292 32549 raft_consensus.cc:2804] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.396978 32549 raft_consensus.cc:697] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:38.398125 32549 consensus_queue.cc:237] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
W20260709 13:10:38.401990 32450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.69.2:40877, user_credentials={real_user=slave}} blocked reactor thread for 63500.1us
I20260709 13:10:38.404362 32410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:38.405596 32410 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.410626 32531 leader_election.cc:290] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.412290 32524 raft_consensus.cc:359] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.412926 32525 tablet_bootstrap.cc:492] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:38.413149 32524 raft_consensus.cc:385] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.413667 32525 ts_tablet_manager.cc:1403] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.015s
I20260709 13:10:38.413543 32524 raft_consensus.cc:740] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.415897 32542 raft_consensus.cc:515] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.417531 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:38.417302 32525 raft_consensus.cc:359] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.418237 32411 raft_consensus.cc:3060] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.418262 32525 raft_consensus.cc:385] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.418896 32525 raft_consensus.cc:740] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.419296 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3a433578c1432ca8ddc36094708b16" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:38.420007 32335 raft_consensus.cc:3060] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.420193 32525 consensus_queue.cc:260] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.422046 32542 leader_election.cc:290] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.425448 32409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3a433578c1432ca8ddc36094708b16" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:38.425817 32525 ts_tablet_manager.cc:1434] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:10:38.426237 32409 raft_consensus.cc:3060] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.408737 32530 raft_consensus.cc:515] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.438966 32409 raft_consensus.cc:2468] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.443491 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:38.440032 32524 consensus_queue.cc:260] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.444667 32408 raft_consensus.cc:3060] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.444756 32411 raft_consensus.cc:2468] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.445499 32450 leader_election.cc:304] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.440083 32410 raft_consensus.cc:2468] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.446563 32450 leader_election.cc:304] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d
I20260709 13:10:38.447849 32531 raft_consensus.cc:2804] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.438040 32335 raft_consensus.cc:2468] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.440454 32542 raft_consensus.cc:493] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.451924 32542 raft_consensus.cc:515] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.454023 32408 raft_consensus.cc:2468] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
I20260709 13:10:38.454314 32542 leader_election.cc:290] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.456084 32301 leader_election.cc:304] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:38.442615 32570 raft_consensus.cc:493] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.457247 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53502e0413404888895b5f18672ad837" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.457406 32561 raft_consensus.cc:2804] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.457675 32570 raft_consensus.cc:515] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.458211 32409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53502e0413404888895b5f18672ad837" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.458371 32335 raft_consensus.cc:2468] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:38.458940 32409 raft_consensus.cc:2468] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:38.459851 32449 leader_election.cc:304] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.448664 32530 leader_election.cc:290] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.462067 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea241c8fe8746498950fdc7e74a22b0" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.462718 32335 raft_consensus.cc:2468] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:38.460829 32542 raft_consensus.cc:2804] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.463356 32542 raft_consensus.cc:493] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.463666 32449 leader_election.cc:304] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.463984 32542 raft_consensus.cc:3060] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.468289 32570 leader_election.cc:290] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.468734 32561 raft_consensus.cc:697] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:38.469095 32570 raft_consensus.cc:2804] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:38.469599 32570 raft_consensus.cc:493] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.469866 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea241c8fe8746498950fdc7e74a22b0" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.451113 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:38.442080 32526 tablet_bootstrap.cc:492] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
W20260709 13:10:38.472946 32301 leader_election.cc:343] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:38.473361 32526 ts_tablet_manager.cc:1403] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.020s
I20260709 13:10:38.450582 32576 raft_consensus.cc:2804] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.474895 32576 raft_consensus.cc:697] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:38.475198 32542 raft_consensus.cc:515] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.475937 32576 consensus_queue.cc:237] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.478502 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53502e0413404888895b5f18672ad837" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:38.469929 32561 consensus_queue.cc:237] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.478389 32526 raft_consensus.cc:359] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.479245 32335 raft_consensus.cc:3060] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.479460 32526 raft_consensus.cc:385] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.479987 32526 raft_consensus.cc:740] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.470678 32408 raft_consensus.cc:2468] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:38.481086 32526 consensus_queue.cc:260] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.481132 32233 catalog_manager.cc:5697] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 0 to 1, leader changed from <none> to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 1 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.483705 32526 ts_tablet_manager.cc:1434] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:10:38.484323 32542 leader_election.cc:290] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.470932 32531 raft_consensus.cc:697] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:38.485261 32526 tablet_bootstrap.cc:492] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:38.485890 32531 consensus_queue.cc:237] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.486832 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53502e0413404888895b5f18672ad837" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:38.487682 32408 raft_consensus.cc:3060] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.448905 32524 ts_tablet_manager.cc:1434] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 13:10:38.493029 32526 tablet_bootstrap.cc:654] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:38.498731 32335 raft_consensus.cc:2468] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.470008 32570 raft_consensus.cc:3060] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.500392 32449 leader_election.cc:304] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.514453 32576 raft_consensus.cc:2804] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.515590 32576 raft_consensus.cc:697] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:38.515130 32230 catalog_manager.cc:5697] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 1 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.517056 32576 consensus_queue.cc:237] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.506138 32408 raft_consensus.cc:2468] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.511665 32578 raft_consensus.cc:493] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.520144 32578 raft_consensus.cc:515] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.521219 32570 raft_consensus.cc:515] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.522830 32578 leader_election.cc:290] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.523553 32570 leader_election.cc:290] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.524518 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea241c8fe8746498950fdc7e74a22b0" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:38.525305 32335 raft_consensus.cc:3060] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.525836 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:38.528573 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.530016 32409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea241c8fe8746498950fdc7e74a22b0" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:38.530761 32409 raft_consensus.cc:3060] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.531493 32408 raft_consensus.cc:2393] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 036a73fc2e744989b2d6be1020a7143d in current term 1: Already voted for candidate ecfc475fc7344b56984a0936a43b831b in this term.
I20260709 13:10:38.532483 32526 tablet_bootstrap.cc:492] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:38.533031 32526 ts_tablet_manager.cc:1403] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.016s
I20260709 13:10:38.533106 32301 leader_election.cc:304] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d; no voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:38.534644 32578 raft_consensus.cc:3060] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.535912 32526 raft_consensus.cc:359] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.536698 32526 raft_consensus.cc:385] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:38.536985 32526 raft_consensus.cc:740] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:38.537739 32526 consensus_queue.cc:260] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.540963 32526 ts_tablet_manager.cc:1434] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:38.541240 32335 raft_consensus.cc:2468] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.542577 32409 raft_consensus.cc:2468] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 1.
I20260709 13:10:38.542893 32555 raft_consensus.cc:493] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.543561 32555 raft_consensus.cc:515] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.544924 32450 leader_election.cc:304] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.546128 32531 raft_consensus.cc:2804] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:38.546716 32531 raft_consensus.cc:697] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:38.547667 32531 consensus_queue.cc:237] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.548117 32336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.547674 32532 consensus_queue.cc:1048] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:38.550184 32578 raft_consensus.cc:2749] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.554840 32555 leader_election.cc:290] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.556422 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:38.557858 32484 raft_consensus.cc:2393] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 78099f91879a4fac821e248e77afbd0f in current term 1: Already voted for candidate 036a73fc2e744989b2d6be1020a7143d in this term.
I20260709 13:10:38.559823 32376 leader_election.cc:304] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f; no voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:38.561645 32555 raft_consensus.cc:3060] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.561853 32233 catalog_manager.cc:5697] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 0 to 1, leader changed from <none> to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 1 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.563938 32233 catalog_manager.cc:5697] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 0 to 1, leader changed from <none> to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 1 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.565500 32531 consensus_queue.cc:1048] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.566063 32233 catalog_manager.cc:5697] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 0 to 1, leader changed from <none> to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 1 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.570906 32555 raft_consensus.cc:2749] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.585839 32484 raft_consensus.cc:3060] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.587915 32233 catalog_manager.cc:5697] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 0 to 1, leader changed from <none> to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 1 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.593024 32576 consensus_queue.cc:1048] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.596020 32555 consensus_queue.cc:1048] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.663164 32484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22257a12f6e040709c74744a0a217635"
dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
mode: GRACEFUL
new_leader_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:47406
I20260709 13:10:38.663729 32484 raft_consensus.cc:606] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Received request to transfer leadership to TS 036a73fc2e744989b2d6be1020a7143d
I20260709 13:10:38.668810 32484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d3a433578c1432ca8ddc36094708b16"
dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
mode: GRACEFUL
new_leader_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:47406
I20260709 13:10:38.669282 32484 raft_consensus.cc:606] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Received request to transfer leadership to TS 036a73fc2e744989b2d6be1020a7143d
I20260709 13:10:38.674182 32484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591"
dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
mode: GRACEFUL
new_leader_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:47406
I20260709 13:10:38.674669 32484 raft_consensus.cc:606] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Received request to transfer leadership to TS 036a73fc2e744989b2d6be1020a7143d
I20260709 13:10:38.693815 32561 consensus_queue.cc:1048] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.694095 32334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
mode: GRACEFUL
new_leader_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:38938
I20260709 13:10:38.694790 32334 raft_consensus.cc:606] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Received request to transfer leadership to TS 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:38.700882 32484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5"
dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
mode: GRACEFUL
new_leader_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:47406
I20260709 13:10:38.701510 32484 raft_consensus.cc:606] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Received request to transfer leadership to TS 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:38.706698 32578 consensus_queue.cc:1048] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.711874 32484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ea241c8fe8746498950fdc7e74a22b0"
dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
mode: GRACEFUL
new_leader_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:47406
I20260709 13:10:38.712513 32484 raft_consensus.cc:606] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Received request to transfer leadership to TS 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:38.813428 32576 consensus_queue.cc:1048] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.819967 32542 raft_consensus.cc:993] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b: : Instructing follower 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:38.820552 32531 raft_consensus.cc:1081] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Signalling peer 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:38.823622 32409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:47246
I20260709 13:10:38.824788 32409 raft_consensus.cc:493] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.825193 32409 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.826730 32531 consensus_queue.cc:1048] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.833125 32409 raft_consensus.cc:515] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.836141 32334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:38.837013 32409 leader_election.cc:290] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.837229 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:38.837934 32484 raft_consensus.cc:3055] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.836774 32334 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.838279 32484 raft_consensus.cc:740] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:38.839464 32484 consensus_queue.cc:260] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.840830 32484 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.845090 32334 raft_consensus.cc:2468] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:38.846319 32375 leader_election.cc:304] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:38.847136 32555 raft_consensus.cc:2804] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.847816 32555 raft_consensus.cc:697] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:38.846885 32484 raft_consensus.cc:2468] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:38.848794 32555 consensus_queue.cc:237] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.856002 32232 catalog_manager.cc:5697] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 1 to 2, leader changed from ecfc475fc7344b56984a0936a43b831b (127.20.69.3) to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 2 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.873756 32531 consensus_queue.cc:1048] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.883363 32570 raft_consensus.cc:493] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.883872 32570 raft_consensus.cc:515] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.884991 32542 consensus_queue.cc:1048] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.885991 32570 leader_election.cc:290] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:38.887629 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:38.888458 32408 raft_consensus.cc:2393] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecfc475fc7344b56984a0936a43b831b in current term 1: Already voted for candidate 036a73fc2e744989b2d6be1020a7143d in this term.
I20260709 13:10:38.889145 32334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:38.893325 32450 leader_election.cc:304] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:38.894567 32570 raft_consensus.cc:3060] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:38.895009 32542 raft_consensus.cc:993] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b: : Instructing follower 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:38.895529 32542 raft_consensus.cc:1081] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Signalling peer 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:38.897444 32333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:38934
I20260709 13:10:38.898046 32333 raft_consensus.cc:493] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.898399 32333 raft_consensus.cc:3060] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.900936 32570 raft_consensus.cc:2749] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:38.903731 32333 raft_consensus.cc:515] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.905668 32333 leader_election.cc:290] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.906493 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:38.906813 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b20b75a2b24d619d7b7c190a19e591" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:38.907192 32408 raft_consensus.cc:3060] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.907435 32484 raft_consensus.cc:3055] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.907799 32484 raft_consensus.cc:740] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:38.908684 32484 consensus_queue.cc:260] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.909976 32484 raft_consensus.cc:3060] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.915127 32408 raft_consensus.cc:2468] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:38.915606 32570 consensus_queue.cc:1048] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.916347 32301 leader_election.cc:304] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:38.917253 32578 raft_consensus.cc:2804] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.917246 32484 raft_consensus.cc:2468] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:38.917913 32578 raft_consensus.cc:697] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:38.918774 32578 consensus_queue.cc:237] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.926460 32233 catalog_manager.cc:5697] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 1 to 2, leader changed from ecfc475fc7344b56984a0936a43b831b (127.20.69.3) to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 2 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.928956 32542 consensus_queue.cc:1048] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:38.946285 32578 consensus_queue.cc:1048] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.960073 32530 consensus_queue.cc:1048] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:38.969493 32596 raft_consensus.cc:993] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d: : Instructing follower 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:38.969956 32530 raft_consensus.cc:1081] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Signalling peer 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:38.971530 32408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:47250
I20260709 13:10:38.972149 32408 raft_consensus.cc:493] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.972554 32408 raft_consensus.cc:3060] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.977952 32408 raft_consensus.cc:515] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.980402 32408 leader_election.cc:290] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:38.980863 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:38.981038 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae711578b5fb49a4a884c3c7c15a4eb9" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:38.981606 32333 raft_consensus.cc:3055] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.981696 32484 raft_consensus.cc:3060] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.982055 32333 raft_consensus.cc:740] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:38.982936 32333 consensus_queue.cc:260] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.983994 32333 raft_consensus.cc:3060] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.988070 32484 raft_consensus.cc:2468] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:38.989276 32376 leader_election.cc:304] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:38.989531 32333 raft_consensus.cc:2468] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:38.990051 32555 raft_consensus.cc:2804] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.990585 32555 raft_consensus.cc:697] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:38.991501 32555 consensus_queue.cc:237] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:38.998039 32232 catalog_manager.cc:5697] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 1 to 2, leader changed from 036a73fc2e744989b2d6be1020a7143d (127.20.69.1) to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 2 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.009073 32542 consensus_queue.cc:1048] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.015636 32570 raft_consensus.cc:993] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b: : Instructing follower 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:39.016134 32576 raft_consensus.cc:1081] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Signalling peer 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:39.017890 32333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d3a433578c1432ca8ddc36094708b16"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:38934
I20260709 13:10:39.021706 32333 raft_consensus.cc:493] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.022162 32333 raft_consensus.cc:3060] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.022610 32576 consensus_queue.cc:1048] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.031217 32333 raft_consensus.cc:515] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:39.035629 32333 leader_election.cc:290] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:39.036875 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3a433578c1432ca8ddc36094708b16" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:39.037567 32408 raft_consensus.cc:3060] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.037526 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3a433578c1432ca8ddc36094708b16" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:39.039220 32484 raft_consensus.cc:3055] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.039535 32484 raft_consensus.cc:740] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:39.039999 32570 raft_consensus.cc:993] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b: : Instructing follower 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:39.040561 32576 raft_consensus.cc:1081] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Signalling peer 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:39.040360 32484 consensus_queue.cc:260] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:39.041818 32484 raft_consensus.cc:3060] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.042711 32333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22257a12f6e040709c74744a0a217635"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:38934
I20260709 13:10:39.043625 32333 raft_consensus.cc:493] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.044035 32333 raft_consensus.cc:3060] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.046275 32408 raft_consensus.cc:2468] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:39.049079 32301 leader_election.cc:304] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:39.049160 32484 raft_consensus.cc:2468] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:39.050066 32530 raft_consensus.cc:2804] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.050590 32530 raft_consensus.cc:697] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:39.051452 32530 consensus_queue.cc:237] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:39.051733 32333 raft_consensus.cc:515] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:39.054463 32333 leader_election.cc:290] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Requested vote from peers ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:39.054709 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22257a12f6e040709c74744a0a217635" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:39.055598 32484 raft_consensus.cc:3055] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.055923 32484 raft_consensus.cc:740] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:39.056790 32484 consensus_queue.cc:260] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:39.058156 32484 raft_consensus.cc:3060] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.058126 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22257a12f6e040709c74744a0a217635" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:39.058993 32408 raft_consensus.cc:3060] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.059124 32233 catalog_manager.cc:5697] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 1 to 2, leader changed from ecfc475fc7344b56984a0936a43b831b (127.20.69.3) to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 2 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.066619 32484 raft_consensus.cc:2468] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:39.066970 32408 raft_consensus.cc:2468] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:39.068071 32301 leader_election.cc:304] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:39.068956 32530 raft_consensus.cc:2804] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.069532 32530 raft_consensus.cc:697] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:39.070329 32530 consensus_queue.cc:237] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:39.073465 32576 consensus_queue.cc:1048] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:39.077319 32233 catalog_manager.cc:5697] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 1 to 2, leader changed from ecfc475fc7344b56984a0936a43b831b (127.20.69.3) to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 2 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.083038 32570 raft_consensus.cc:993] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b: : Instructing follower 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:39.083596 32570 raft_consensus.cc:1081] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Signalling peer 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:39.087442 32409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ea241c8fe8746498950fdc7e74a22b0"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:47246
I20260709 13:10:39.088878 32409 raft_consensus.cc:493] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.089336 32409 raft_consensus.cc:3060] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.094494 32576 consensus_queue.cc:1048] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:39.097183 32409 raft_consensus.cc:515] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:39.100581 32334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea241c8fe8746498950fdc7e74a22b0" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:39.100828 32409 leader_election.cc:290] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:39.104940 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea241c8fe8746498950fdc7e74a22b0" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:39.105569 32484 raft_consensus.cc:3055] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.105906 32484 raft_consensus.cc:740] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:39.106784 32484 consensus_queue.cc:260] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:39.108179 32484 raft_consensus.cc:3060] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.114555 32484 raft_consensus.cc:2468] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:39.115631 32376 leader_election.cc:304] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d
I20260709 13:10:39.116432 32555 raft_consensus.cc:2804] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.116938 32555 raft_consensus.cc:697] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:39.117614 32555 consensus_queue.cc:237] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:39.123939 32233 catalog_manager.cc:5697] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 1 to 2, leader changed from ecfc475fc7344b56984a0936a43b831b (127.20.69.3) to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 2 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.236662 32333 raft_consensus.cc:1275] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.237972 32610 consensus_queue.cc:1048] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.246434 32484 raft_consensus.cc:1275] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.248301 32555 consensus_queue.cc:1048] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.325701 32409 raft_consensus.cc:1275] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.327036 32530 consensus_queue.cc:1048] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.335443 32484 raft_consensus.cc:1275] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.338325 32530 consensus_queue.cc:1048] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.425208 32333 raft_consensus.cc:1275] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.426879 32610 consensus_queue.cc:1048] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.427861 32484 raft_consensus.cc:1275] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.429411 32610 consensus_queue.cc:1048] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.441552 32409 raft_consensus.cc:1275] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.443693 32530 consensus_queue.cc:1048] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.457531 32484 raft_consensus.cc:1275] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.459568 32530 consensus_queue.cc:1048] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.522769 32484 raft_consensus.cc:1275] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.524143 32530 consensus_queue.cc:1048] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.532567 32408 raft_consensus.cc:1275] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.534811 32596 consensus_queue.cc:1048] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.714408 32333 raft_consensus.cc:3060] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.718277 32484 raft_consensus.cc:1275] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.719918 32610 consensus_queue.cc:1048] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.722270 32333 raft_consensus.cc:1275] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.724169 32610 consensus_queue.cc:1048] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.753670 32233 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42784:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:41.755978 32233 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:41.805729 32324 tablet_service.cc:1511] Processing CreateTablet for tablet 6a96b6bab50c4c2db59aa9e2ed4b0d60 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:41.807109 32324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a96b6bab50c4c2db59aa9e2ed4b0d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.807646 32395 tablet_service.cc:1511] Processing CreateTablet for tablet 6a96b6bab50c4c2db59aa9e2ed4b0d60 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:41.808993 32395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a96b6bab50c4c2db59aa9e2ed4b0d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.809913 32471 tablet_service.cc:1511] Processing CreateTablet for tablet 6a96b6bab50c4c2db59aa9e2ed4b0d60 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:41.811395 32471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a96b6bab50c4c2db59aa9e2ed4b0d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.811305 32322 tablet_service.cc:1511] Processing CreateTablet for tablet 05d375a7dec54a619b40fe4a08f5ea74 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:41.812914 32322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d375a7dec54a619b40fe4a08f5ea74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.819813 32394 tablet_service.cc:1511] Processing CreateTablet for tablet 05d375a7dec54a619b40fe4a08f5ea74 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:41.833525 32394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d375a7dec54a619b40fe4a08f5ea74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.820160 32398 tablet_service.cc:1511] Processing CreateTablet for tablet 3817d7d3ae6341deb3968c4e838e58f2 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:41.834952 32398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3817d7d3ae6341deb3968c4e838e58f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.835067 32473 tablet_service.cc:1511] Processing CreateTablet for tablet 453bddd17a4d4cdc9f5e95fa8c6cf66d (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:41.836391 32473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453bddd17a4d4cdc9f5e95fa8c6cf66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.837482 32397 tablet_service.cc:1511] Processing CreateTablet for tablet 4f94f7836f82440f99059b6e7227cb71 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:41.837615 32321 tablet_service.cc:1511] Processing CreateTablet for tablet 4f94f7836f82440f99059b6e7227cb71 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:41.838821 32397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f94f7836f82440f99059b6e7227cb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.838971 32321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f94f7836f82440f99059b6e7227cb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.820559 32470 tablet_service.cc:1511] Processing CreateTablet for tablet 05d375a7dec54a619b40fe4a08f5ea74 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:41.841375 32470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d375a7dec54a619b40fe4a08f5ea74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.842151 32323 tablet_service.cc:1511] Processing CreateTablet for tablet b12b9ea9154f4d84ba0976bed3e2a212 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:41.843508 32469 tablet_service.cc:1511] Processing CreateTablet for tablet 4f94f7836f82440f99059b6e7227cb71 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:41.844810 32469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f94f7836f82440f99059b6e7227cb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.845613 32400 tablet_service.cc:1511] Processing CreateTablet for tablet 453bddd17a4d4cdc9f5e95fa8c6cf66d (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:41.846943 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453bddd17a4d4cdc9f5e95fa8c6cf66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.843531 32323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12b9ea9154f4d84ba0976bed3e2a212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.822140 32467 tablet_service.cc:1511] Processing CreateTablet for tablet 3817d7d3ae6341deb3968c4e838e58f2 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:41.823342 32326 tablet_service.cc:1511] Processing CreateTablet for tablet b1016aba5761411b9152a0a653df6f1f (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:41.849318 32399 tablet_service.cc:1511] Processing CreateTablet for tablet b12b9ea9154f4d84ba0976bed3e2a212 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:41.849905 32326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1016aba5761411b9152a0a653df6f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.850589 32399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12b9ea9154f4d84ba0976bed3e2a212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.821606 32319 tablet_service.cc:1511] Processing CreateTablet for tablet 3817d7d3ae6341deb3968c4e838e58f2 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:41.849906 32467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3817d7d3ae6341deb3968c4e838e58f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.853328 32319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3817d7d3ae6341deb3968c4e838e58f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.824942 32401 tablet_service.cc:1511] Processing CreateTablet for tablet b1016aba5761411b9152a0a653df6f1f (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:41.856393 32401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1016aba5761411b9152a0a653df6f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.857276 32475 tablet_service.cc:1511] Processing CreateTablet for tablet b12b9ea9154f4d84ba0976bed3e2a212 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:41.858173 32474 tablet_service.cc:1511] Processing CreateTablet for tablet 95d6294883754288923b68421fea2c47 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:41.859091 32393 tablet_service.cc:1511] Processing CreateTablet for tablet 95d6294883754288923b68421fea2c47 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:41.860335 32393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d6294883754288923b68421fea2c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.829622 32472 tablet_service.cc:1511] Processing CreateTablet for tablet 358c677830e740bab5f0420cc2365a60 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:41.831709 32320 tablet_service.cc:1511] Processing CreateTablet for tablet 453bddd17a4d4cdc9f5e95fa8c6cf66d (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:41.828192 32396 tablet_service.cc:1511] Processing CreateTablet for tablet 358c677830e740bab5f0420cc2365a60 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:41.846598 32318 tablet_service.cc:1511] Processing CreateTablet for tablet 95d6294883754288923b68421fea2c47 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:41.824391 32325 tablet_service.cc:1511] Processing CreateTablet for tablet 358c677830e740bab5f0420cc2365a60 (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:41.826596 32468 tablet_service.cc:1511] Processing CreateTablet for tablet b1016aba5761411b9152a0a653df6f1f (DEFAULT_TABLE table=soft_deleted_table [id=48e216c377704c19a923365243952162]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:41.867328 32396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 358c677830e740bab5f0420cc2365a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.869807 32320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453bddd17a4d4cdc9f5e95fa8c6cf66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.873323 32325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 358c677830e740bab5f0420cc2365a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.858645 32475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12b9ea9154f4d84ba0976bed3e2a212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.877223 32318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d6294883754288923b68421fea2c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.877229 32472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 358c677830e740bab5f0420cc2365a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.884954 32468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1016aba5761411b9152a0a653df6f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.916512 32474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d6294883754288923b68421fea2c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:41.965039 32624 tablet_bootstrap.cc:492] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
W20260709 13:10:41.989810 32281 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:41.999027 32623 tablet_bootstrap.cc:492] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:42.001413 32624 tablet_bootstrap.cc:654] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.011631 32625 tablet_bootstrap.cc:492] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.016942 32625 tablet_bootstrap.cc:654] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.019518 32624 tablet_bootstrap.cc:492] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.020007 32624 ts_tablet_manager.cc:1403] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.006s
I20260709 13:10:42.022699 32623 tablet_bootstrap.cc:654] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.023334 32624 raft_consensus.cc:359] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.024277 32624 raft_consensus.cc:385] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.024638 32625 tablet_bootstrap.cc:492] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.024741 32624 raft_consensus.cc:740] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.025313 32625 ts_tablet_manager.cc:1403] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:10:42.025926 32624 consensus_queue.cc:260] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.028218 32625 raft_consensus.cc:359] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.029112 32623 tablet_bootstrap.cc:492] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:42.029424 32625 raft_consensus.cc:385] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.028432 32624 ts_tablet_manager.cc:1434] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:42.029976 32625 raft_consensus.cc:740] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.030205 32623 ts_tablet_manager.cc:1403] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.003s
I20260709 13:10:42.030795 32624 tablet_bootstrap.cc:492] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:42.033455 32623 raft_consensus.cc:359] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.034250 32623 raft_consensus.cc:385] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.034621 32623 raft_consensus.cc:740] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.030804 32625 consensus_queue.cc:260] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.037179 32625 ts_tablet_manager.cc:1434] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:42.037673 32623 consensus_queue.cc:260] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.038369 32624 tablet_bootstrap.cc:654] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.039361 32625 tablet_bootstrap.cc:492] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.041441 32623 ts_tablet_manager.cc:1434] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:42.042783 32623 tablet_bootstrap.cc:492] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:42.048890 32625 tablet_bootstrap.cc:654] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.049580 32623 tablet_bootstrap.cc:654] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.054312 32624 tablet_bootstrap.cc:492] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.054885 32624 ts_tablet_manager.cc:1403] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:10:42.057693 32623 tablet_bootstrap.cc:492] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:42.058316 32623 ts_tablet_manager.cc:1403] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 13:10:42.058727 32624 raft_consensus.cc:359] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.059530 32624 raft_consensus.cc:385] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.059828 32625 tablet_bootstrap.cc:492] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.059844 32624 raft_consensus.cc:740] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.060539 32625 ts_tablet_manager.cc:1403] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.021s	user 0.001s	sys 0.012s
I20260709 13:10:42.061136 32623 raft_consensus.cc:359] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.060952 32624 consensus_queue.cc:260] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.061758 32623 raft_consensus.cc:385] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.062395 32623 raft_consensus.cc:740] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.063490 32624 ts_tablet_manager.cc:1434] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:42.063294 32623 consensus_queue.cc:260] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.063755 32625 raft_consensus.cc:359] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.064515 32625 raft_consensus.cc:385] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.064666 32624 tablet_bootstrap.cc:492] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:42.064883 32625 raft_consensus.cc:740] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.065780 32625 consensus_queue.cc:260] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.068109 32625 ts_tablet_manager.cc:1434] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:42.069084 32623 ts_tablet_manager.cc:1434] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:42.069204 32625 tablet_bootstrap.cc:492] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.070245 32623 tablet_bootstrap.cc:492] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:42.072219 32624 tablet_bootstrap.cc:654] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.076709 32625 tablet_bootstrap.cc:654] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.077621 32623 tablet_bootstrap.cc:654] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:42.114717 32437 tablet.cc:2406] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:42.135732 32623 tablet_bootstrap.cc:492] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:42.136348 32623 ts_tablet_manager.cc:1403] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.032s
I20260709 13:10:42.137274 32625 tablet_bootstrap.cc:492] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.138072 32625 ts_tablet_manager.cc:1403] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.041s
I20260709 13:10:42.139209 32623 raft_consensus.cc:359] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.139887 32623 raft_consensus.cc:385] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.140142 32623 raft_consensus.cc:740] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.140898 32623 consensus_queue.cc:260] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.141898 32624 tablet_bootstrap.cc:492] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.142483 32624 ts_tablet_manager.cc:1403] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.078s	user 0.033s	sys 0.033s
I20260709 13:10:42.143018 32623 ts_tablet_manager.cc:1434] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:10:42.142894 32625 raft_consensus.cc:359] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.143762 32625 raft_consensus.cc:385] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.144109 32623 tablet_bootstrap.cc:492] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:42.144083 32625 raft_consensus.cc:740] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.145217 32625 consensus_queue.cc:260] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.145699 32624 raft_consensus.cc:359] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.146472 32624 raft_consensus.cc:385] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.146765 32624 raft_consensus.cc:740] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.147716 32625 ts_tablet_manager.cc:1434] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:42.147682 32624 consensus_queue.cc:260] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.148896 32625 tablet_bootstrap.cc:492] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.150315 32624 ts_tablet_manager.cc:1434] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:10:42.152426 32624 tablet_bootstrap.cc:492] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:42.155632 32625 tablet_bootstrap.cc:654] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.159518 32624 tablet_bootstrap.cc:654] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.165289 32623 tablet_bootstrap.cc:654] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.168507 32625 tablet_bootstrap.cc:492] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.169224 32625 ts_tablet_manager.cc:1403] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:10:42.172322 32624 tablet_bootstrap.cc:492] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.172400 32625 raft_consensus.cc:359] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.172996 32624 ts_tablet_manager.cc:1403] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 13:10:42.173343 32625 raft_consensus.cc:385] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.173679 32625 raft_consensus.cc:740] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.174569 32625 consensus_queue.cc:260] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.176311 32624 raft_consensus.cc:359] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.176994 32625 ts_tablet_manager.cc:1434] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:10:42.177184 32624 raft_consensus.cc:385] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.177508 32624 raft_consensus.cc:740] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.178148 32625 tablet_bootstrap.cc:492] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.178232 32624 consensus_queue.cc:260] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.187472 32625 tablet_bootstrap.cc:654] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.188066 32624 ts_tablet_manager.cc:1434] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:10:42.189386 32624 tablet_bootstrap.cc:492] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:42.197832 32624 tablet_bootstrap.cc:654] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.200093 32638 raft_consensus.cc:493] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.200773 32638 raft_consensus.cc:515] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.200119 32625 tablet_bootstrap.cc:492] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.201879 32625 ts_tablet_manager.cc:1403] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:10:42.204252 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d375a7dec54a619b40fe4a08f5ea74" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
W20260709 13:10:42.206089 32301 leader_election.cc:343] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.207252 32638 leader_election.cc:290] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.207674 32625 raft_consensus.cc:359] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.208956 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d375a7dec54a619b40fe4a08f5ea74" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:42.209219 32611 raft_consensus.cc:493] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.211417 32625 raft_consensus.cc:385] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.211851 32625 raft_consensus.cc:740] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.211763 32611 raft_consensus.cc:515] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.212891 32625 consensus_queue.cc:260] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.217052 32484 raft_consensus.cc:2468] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:42.217904 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d375a7dec54a619b40fe4a08f5ea74" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:42.219692 32611 leader_election.cc:290] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:42.224357 32450 leader_election.cc:343] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.227787 32624 tablet_bootstrap.cc:492] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.228961 32624 ts_tablet_manager.cc:1403] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.003s
I20260709 13:10:42.230291 32301 leader_election.cc:304] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:42.235096 32624 raft_consensus.cc:359] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.236310 32624 raft_consensus.cc:385] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.238466 32624 raft_consensus.cc:740] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.240098 32623 tablet_bootstrap.cc:492] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:42.239645 32624 consensus_queue.cc:260] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.240754 32623 ts_tablet_manager.cc:1403] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.097s	user 0.047s	sys 0.034s
I20260709 13:10:42.228721 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d375a7dec54a619b40fe4a08f5ea74" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:42.241477 32596 raft_consensus.cc:2804] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.242219 32596 raft_consensus.cc:493] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.242604 32596 raft_consensus.cc:3060] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.244089 32624 ts_tablet_manager.cc:1434] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:10:42.246068 32624 tablet_bootstrap.cc:492] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:42.244109 32623 raft_consensus.cc:359] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.252774 32623 raft_consensus.cc:385] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.253103 32623 raft_consensus.cc:740] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.253894 32623 consensus_queue.cc:260] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.256778 32623 ts_tablet_manager.cc:1434] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:10:42.257911 32623 tablet_bootstrap.cc:492] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:42.260501 32625 ts_tablet_manager.cc:1434] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.058s	user 0.021s	sys 0.021s
I20260709 13:10:42.261807 32625 tablet_bootstrap.cc:492] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.265866 32624 tablet_bootstrap.cc:654] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.268853 32625 tablet_bootstrap.cc:654] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.279345 32596 raft_consensus.cc:515] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.281212 32333 raft_consensus.cc:2393] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecfc475fc7344b56984a0936a43b831b in current term 1: Already voted for candidate 036a73fc2e744989b2d6be1020a7143d in this term.
I20260709 13:10:42.283195 32596 leader_election.cc:290] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.283898 32449 leader_election.cc:304] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:42.285312 32611 raft_consensus.cc:3060] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.285835 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d375a7dec54a619b40fe4a08f5ea74" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
W20260709 13:10:42.287382 32301 leader_election.cc:343] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.289331 32625 tablet_bootstrap.cc:492] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.289772 32624 tablet_bootstrap.cc:492] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.289958 32625 ts_tablet_manager.cc:1403] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.008s
I20260709 13:10:42.290385 32624 ts_tablet_manager.cc:1403] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.000s
I20260709 13:10:42.293365 32625 raft_consensus.cc:359] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.294191 32625 raft_consensus.cc:385] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.294840 32625 raft_consensus.cc:740] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.294144 32611 raft_consensus.cc:2749] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.293956 32624 raft_consensus.cc:359] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.295475 32624 raft_consensus.cc:385] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.295882 32624 raft_consensus.cc:740] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.295991 32625 consensus_queue.cc:260] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.296589 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d375a7dec54a619b40fe4a08f5ea74" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:42.296711 32624 consensus_queue.cc:260] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.299360 32624 ts_tablet_manager.cc:1434] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:10:42.300421 32624 tablet_bootstrap.cc:492] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:42.304291 32484 raft_consensus.cc:2468] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
I20260709 13:10:42.306545 32301 leader_election.cc:304] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:42.307341 32624 tablet_bootstrap.cc:654] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.307813 32596 raft_consensus.cc:2804] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.308364 32638 raft_consensus.cc:493] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.309124 32638 raft_consensus.cc:515] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.312045 32638 leader_election.cc:290] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.317413 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:42.318462 32408 raft_consensus.cc:2468] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:42.318626 32625 ts_tablet_manager.cc:1434] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.028s	user 0.020s	sys 0.009s
I20260709 13:10:42.319836 32625 tablet_bootstrap.cc:492] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.320904 32624 tablet_bootstrap.cc:492] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.321455 32624 ts_tablet_manager.cc:1403] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:10:42.323132 32623 tablet_bootstrap.cc:654] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.327088 32625 tablet_bootstrap.cc:654] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.327572 32596 raft_consensus.cc:697] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:42.328958 32596 consensus_queue.cc:237] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.329797 32624 raft_consensus.cc:359] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.331137 32624 raft_consensus.cc:385] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.331614 32624 raft_consensus.cc:740] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.332979 32624 consensus_queue.cc:260] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.340379 32645 raft_consensus.cc:493] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.344372 32645 raft_consensus.cc:515] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.352788 32645 leader_election.cc:290] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.357487 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:42.358781 32484 raft_consensus.cc:2468] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:42.360492 32611 raft_consensus.cc:493] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.361217 32611 raft_consensus.cc:515] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.365482 32611 leader_election.cc:290] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:42.365795 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:42.366830 32408 raft_consensus.cc:2468] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:42.368778 32450 leader_election.cc:304] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:42.370167 32611 raft_consensus.cc:2804] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.370774 32611 raft_consensus.cc:493] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.371249 32611 raft_consensus.cc:3060] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.374356 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:42.375473 32333 raft_consensus.cc:2468] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:42.384080 32610 raft_consensus.cc:493] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.384749 32610 raft_consensus.cc:515] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.386824 32624 ts_tablet_manager.cc:1434] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.065s	user 0.016s	sys 0.006s
I20260709 13:10:42.388141 32624 tablet_bootstrap.cc:492] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:42.388836 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96b6bab50c4c2db59aa9e2ed4b0d60" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:42.389025 32610 leader_election.cc:290] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.389590 32333 raft_consensus.cc:2468] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:42.390307 32625 tablet_bootstrap.cc:492] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.390887 32625 ts_tablet_manager.cc:1403] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.071s	user 0.034s	sys 0.034s
I20260709 13:10:42.388857 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96b6bab50c4c2db59aa9e2ed4b0d60" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:42.391400 32484 raft_consensus.cc:2468] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:42.392405 32375 leader_election.cc:304] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:42.394363 32610 raft_consensus.cc:2804] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.394207 32625 raft_consensus.cc:359] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.394798 32610 raft_consensus.cc:493] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.395017 32625 raft_consensus.cc:385] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.395159 32610 raft_consensus.cc:3060] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.395457 32625 raft_consensus.cc:740] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.396273 32625 consensus_queue.cc:260] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.398561 32623 tablet_bootstrap.cc:492] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:42.398088 32229 catalog_manager.cc:5697] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 1 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.399114 32623 ts_tablet_manager.cc:1403] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.011s
I20260709 13:10:42.402503 32623 raft_consensus.cc:359] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.403241 32623 raft_consensus.cc:385] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.403604 32623 raft_consensus.cc:740] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.409036 32623 consensus_queue.cc:260] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.413022 32624 tablet_bootstrap.cc:654] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.413587 32301 leader_election.cc:304] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:42.414799 32648 raft_consensus.cc:2804] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.415174 32648 raft_consensus.cc:493] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.415524 32648 raft_consensus.cc:3060] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.417351 32625 ts_tablet_manager.cc:1434] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:10:42.419425 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:42.419865 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:42.420039 32484 raft_consensus.cc:2468] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:42.420976 32625 tablet_bootstrap.cc:492] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.423964 32648 raft_consensus.cc:515] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
W20260709 13:10:42.426359 32301 leader_election.cc:343] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:42.426932 32648 leader_election.cc:290] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.427225 32301 leader_election.cc:304] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:42.430253 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:42.431035 32408 raft_consensus.cc:3060] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.435622 32611 raft_consensus.cc:515] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.439392 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:42.440239 32333 raft_consensus.cc:2393] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ecfc475fc7344b56984a0936a43b831b in current term 1: Already voted for candidate 036a73fc2e744989b2d6be1020a7143d in this term.
I20260709 13:10:42.442504 32625 tablet_bootstrap.cc:654] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.447686 32611 leader_election.cc:290] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:42.453588 32409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:42.435720 32610 raft_consensus.cc:515] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.455965 32450 leader_election.cc:304] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:42.457183 32611 raft_consensus.cc:2749] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:42.464857 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96b6bab50c4c2db59aa9e2ed4b0d60" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:42.465638 32625 tablet_bootstrap.cc:492] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.465777 32484 raft_consensus.cc:3060] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.466506 32625 ts_tablet_manager.cc:1403] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.001s
I20260709 13:10:42.464423 32610 leader_election.cc:290] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.470324 32625 raft_consensus.cc:359] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.471089 32625 raft_consensus.cc:385] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.471417 32625 raft_consensus.cc:740] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.472193 32625 consensus_queue.cc:260] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.474570 32625 ts_tablet_manager.cc:1434] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:42.475620 32625 tablet_bootstrap.cc:492] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b: Bootstrap starting.
I20260709 13:10:42.477303 32408 raft_consensus.cc:2468] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
I20260709 13:10:42.478891 32648 raft_consensus.cc:2804] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.479384 32648 raft_consensus.cc:493] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.481061 32484 raft_consensus.cc:2468] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:42.480516 32648 raft_consensus.cc:3060] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.482299 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:42.483340 32483 raft_consensus.cc:2393] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 036a73fc2e744989b2d6be1020a7143d in current term 1: Already voted for candidate ecfc475fc7344b56984a0936a43b831b in this term.
I20260709 13:10:42.484979 32376 leader_election.cc:304] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:42.485357 32301 leader_election.cc:304] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:42.486347 32653 raft_consensus.cc:2804] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.486909 32650 raft_consensus.cc:2804] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.486994 32653 raft_consensus.cc:697] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:42.487624 32650 raft_consensus.cc:697] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:42.488528 32650 consensus_queue.cc:237] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.488243 32653 consensus_queue.cc:237] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.490908 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96b6bab50c4c2db59aa9e2ed4b0d60" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:42.491572 32333 raft_consensus.cc:3060] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.453588 32659 raft_consensus.cc:493] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.645241 32644 raft_consensus.cc:493] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.645370 32624 tablet_bootstrap.cc:492] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.646303 32624 ts_tablet_manager.cc:1403] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.258s	user 0.017s	sys 0.009s
I20260709 13:10:42.646029 32644 raft_consensus.cc:515] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.648114 32611 raft_consensus.cc:493] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.648713 32611 raft_consensus.cc:515] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.649408 32624 raft_consensus.cc:359] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.649784 32641 raft_consensus.cc:493] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.650130 32624 raft_consensus.cc:385] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.650496 32624 raft_consensus.cc:740] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.650348 32641 raft_consensus.cc:515] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.650861 32611 leader_election.cc:290] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:42.651249 32624 consensus_queue.cc:260] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.651798 32648 raft_consensus.cc:515] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.653023 32624 ts_tablet_manager.cc:1434] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:42.653354 32641 leader_election.cc:290] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:42.654016 32624 tablet_bootstrap.cc:492] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d: Bootstrap starting.
I20260709 13:10:42.681377 32610 raft_consensus.cc:493] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.801848 32644 leader_election.cc:290] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:42.657055 32659 raft_consensus.cc:515] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.840086 32610 raft_consensus.cc:515] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.887202 32659 leader_election.cc:290] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.918972 32623 ts_tablet_manager.cc:1434] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.520s	user 0.009s	sys 0.016s
I20260709 13:10:42.919850 32656 raft_consensus.cc:493] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.919958 32623 ts_tablet_manager.cc:1467] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: Tablet startup took 520ms
I20260709 13:10:42.920524 32656 raft_consensus.cc:515] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
W20260709 13:10:42.920488 32623 ts_tablet_manager.cc:1469] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: Trace:
0709 13:10:41.856614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.858192 (+  1578us) service_pool.cc:224] Handling call
0709 13:10:41.859872 (+  1680us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:10:41.859983 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:10:41.949059 (+ 89076us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:41.974411 (+ 25352us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:41.974892 (+   481us) inbound_call.cc:177] Queueing success response
0709 13:10:42.257518 (+282626us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:10:42.399442 (+141924us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:10:42.400019 (+   577us) tablet_replica.cc:261] Starting instrumentation
0709 13:10:42.400752 (+   733us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":42108,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"tablet-open.queue_time_us":282707,"thread_start_us":81964,"threads_started":1}
I20260709 13:10:42.925179 32624 tablet_bootstrap.cc:654] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.888460 32610 leader_election.cc:290] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.926432 32623 tablet_bootstrap.cc:492] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:42.924219 32656 leader_election.cc:290] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.931062 32625 tablet_bootstrap.cc:654] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.926038 32648 leader_election.cc:290] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.941901 32625 tablet_bootstrap.cc:492] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b: No bootstrap required, opened a new log
I20260709 13:10:42.942498 32625 ts_tablet_manager.cc:1403] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b: Time spent bootstrapping tablet: real 0.467s	user 0.009s	sys 0.006s
I20260709 13:10:42.943579 32624 tablet_bootstrap.cc:492] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d: No bootstrap required, opened a new log
I20260709 13:10:42.944109 32624 ts_tablet_manager.cc:1403] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d: Time spent bootstrapping tablet: real 0.290s	user 0.017s	sys 0.003s
I20260709 13:10:42.946151 32623 tablet_bootstrap.cc:654] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.946767 32625 raft_consensus.cc:359] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.947634 32625 raft_consensus.cc:385] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.947911 32625 raft_consensus.cc:740] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.948686 32625 consensus_queue.cc:260] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.948783 32624 raft_consensus.cc:359] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.949653 32624 raft_consensus.cc:385] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.949957 32624 raft_consensus.cc:740] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.950651 32624 consensus_queue.cc:260] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.951356 32625 ts_tablet_manager.cc:1434] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:42.952374 32624 ts_tablet_manager.cc:1434] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:42.956298 32650 raft_consensus.cc:493] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.956977 32650 raft_consensus.cc:515] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.951273 32333 raft_consensus.cc:2468] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:42.959422 32650 leader_election.cc:290] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.965291 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:42.965811 32484 raft_consensus.cc:3060] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.966482 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358c677830e740bab5f0420cc2365a60" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:42.967224 32483 raft_consensus.cc:2468] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:42.968629 32301 leader_election.cc:304] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:42.971704 32669 raft_consensus.cc:2804] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:42.972151 32669 raft_consensus.cc:493] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.972510 32669 raft_consensus.cc:3060] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.972981 32484 raft_consensus.cc:2468] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
I20260709 13:10:42.976162 32301 leader_election.cc:304] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:42.976521 32623 tablet_bootstrap.cc:492] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:42.977159 32623 ts_tablet_manager.cc:1403] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.011s
I20260709 13:10:42.983006 32669 raft_consensus.cc:515] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.984551 32623 raft_consensus.cc:359] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.985654 32623 raft_consensus.cc:385] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:42.986040 32623 raft_consensus.cc:740] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:42.986521 32670 raft_consensus.cc:2804] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.986958 32623 consensus_queue.cc:260] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:42.988256 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358c677830e740bab5f0420cc2365a60" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:42.985682 32669 leader_election.cc:290] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:42.988849 32484 raft_consensus.cc:3060] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:42.990823 32623 ts_tablet_manager.cc:1434] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:10:42.991958 32623 tablet_bootstrap.cc:492] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:42.996444 32484 raft_consensus.cc:2468] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
I20260709 13:10:42.997875 32301 leader_election.cc:304] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:42.998800 32669 raft_consensus.cc:2804] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:42.998986 32623 tablet_bootstrap.cc:654] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:42.999298 32669 raft_consensus.cc:697] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:43.000234 32669 consensus_queue.cc:237] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.005710 32670 raft_consensus.cc:697] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:43.006953 32670 consensus_queue.cc:237] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.010259 32623 tablet_bootstrap.cc:492] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:43.010944 32623 ts_tablet_manager.cc:1403] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:10:43.014520 32623 raft_consensus.cc:359] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.015291 32623 raft_consensus.cc:385] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.015623 32623 raft_consensus.cc:740] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.016412 32623 consensus_queue.cc:260] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.018226 32623 ts_tablet_manager.cc:1434] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:43.019372 32623 tablet_bootstrap.cc:492] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
W20260709 13:10:43.022040 32281 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:43.025749 32623 tablet_bootstrap.cc:654] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:43.031076 32623 tablet_bootstrap.cc:492] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:43.031608 32623 ts_tablet_manager.cc:1403] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:10:43.034536 32623 raft_consensus.cc:359] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.036999 32623 raft_consensus.cc:385] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.037328 32623 raft_consensus.cc:740] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.038193 32623 consensus_queue.cc:260] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.040262 32623 ts_tablet_manager.cc:1434] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:43.041342 32623 tablet_bootstrap.cc:492] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f: Bootstrap starting.
I20260709 13:10:43.048336 32623 tablet_bootstrap.cc:654] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:43.084200 32375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:35077, user_credentials={real_user=slave}} blocked reactor thread for 284414us
I20260709 13:10:43.147162 32662 raft_consensus.cc:493] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.147671 32662 raft_consensus.cc:515] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.149959 32662 leader_election.cc:290] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.155606 32677 raft_consensus.cc:493] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.156210 32677 raft_consensus.cc:515] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.159397 32677 leader_election.cc:290] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.160360 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358c677830e740bab5f0420cc2365a60" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:43.160550 32334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453bddd17a4d4cdc9f5e95fa8c6cf66d" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:43.160955 32336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d6294883754288923b68421fea2c47" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:43.161386 32334 raft_consensus.cc:2468] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:43.161653 32336 raft_consensus.cc:2468] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:43.162186 32678 raft_consensus.cc:493] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.162861 32678 raft_consensus.cc:515] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.165000 32334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:43.166324 32409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358c677830e740bab5f0420cc2365a60" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:43.167140 32409 raft_consensus.cc:2468] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:43.168541 32375 leader_election.cc:304] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:43.170516 32375 leader_election.cc:304] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:43.171617 32662 raft_consensus.cc:2804] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.171792 32410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358c677830e740bab5f0420cc2365a60" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:43.172086 32662 raft_consensus.cc:493] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.172418 32410 raft_consensus.cc:3060] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.172456 32662 raft_consensus.cc:3060] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.173339 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:43.177735 32333 raft_consensus.cc:2468] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:43.178954 32375 leader_election.cc:304] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:43.180070 32661 raft_consensus.cc:2804] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.180437 32661 raft_consensus.cc:493] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.171361 32677 raft_consensus.cc:2804] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.181134 32677 raft_consensus.cc:493] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.181480 32677 raft_consensus.cc:3060] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.181780 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:43.182613 32408 raft_consensus.cc:3060] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.180799 32661 raft_consensus.cc:3060] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.195664 32408 raft_consensus.cc:2468] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
I20260709 13:10:43.203038 32410 raft_consensus.cc:2468] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
I20260709 13:10:43.205910 32409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3817d7d3ae6341deb3968c4e838e58f2" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:43.207378 32678 leader_election.cc:290] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.207927 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453bddd17a4d4cdc9f5e95fa8c6cf66d" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:43.210011 32409 raft_consensus.cc:2468] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
I20260709 13:10:43.212092 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d6294883754288923b68421fea2c47" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:43.212952 32485 raft_consensus.cc:2468] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:43.211987 32301 leader_election.cc:304] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:43.231364 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:43.232172 32485 raft_consensus.cc:2468] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:43.233223 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:43.234385 32482 raft_consensus.cc:2393] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 78099f91879a4fac821e248e77afbd0f in current term 1: Already voted for candidate 036a73fc2e744989b2d6be1020a7143d in this term.
I20260709 13:10:43.242980 32661 raft_consensus.cc:515] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.247421 32661 leader_election.cc:290] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.223095 32678 raft_consensus.cc:2804] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.247960 32678 raft_consensus.cc:493] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.248389 32678 raft_consensus.cc:3060] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.248736 32662 raft_consensus.cc:515] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.248108 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
W20260709 13:10:43.249334 32653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.006s	sys 0.016s
I20260709 13:10:43.250047 32333 raft_consensus.cc:3060] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:43.250391 32653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.006s	sys 0.016s
I20260709 13:10:43.251930 32334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d6294883754288923b68421fea2c47" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:43.228940 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3817d7d3ae6341deb3968c4e838e58f2" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:43.252776 32334 raft_consensus.cc:3060] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.253451 32408 raft_consensus.cc:2468] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 0.
I20260709 13:10:43.255999 32407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f" is_pre_election: true
I20260709 13:10:43.256928 32407 raft_consensus.cc:2393] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecfc475fc7344b56984a0936a43b831b in current term 1: Already voted for candidate 78099f91879a4fac821e248e77afbd0f in this term.
I20260709 13:10:43.259390 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453bddd17a4d4cdc9f5e95fa8c6cf66d" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:43.260097 32483 raft_consensus.cc:2468] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 0.
I20260709 13:10:43.262310 32662 leader_election.cc:290] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.264926 32333 raft_consensus.cc:2468] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:43.266601 32375 leader_election.cc:304] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:43.267799 32662 raft_consensus.cc:2804] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:43.268646 32662 raft_consensus.cc:697] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:43.269708 32662 consensus_queue.cc:237] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.281210 32677 raft_consensus.cc:515] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.282910 32411 raft_consensus.cc:2393] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecfc475fc7344b56984a0936a43b831b in current term 1: Already voted for candidate 78099f91879a4fac821e248e77afbd0f in this term.
I20260709 13:10:43.286324 32481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3817d7d3ae6341deb3968c4e838e58f2" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:43.287402 32481 raft_consensus.cc:2468] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 0.
W20260709 13:10:43.301224 32376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:42077, user_credentials={real_user=slave}} blocked reactor thread for 64106.5us
I20260709 13:10:43.305645 32450 leader_election.cc:304] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:43.306171 32376 leader_election.cc:304] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f; no voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:43.307754 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:43.308662 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d6294883754288923b68421fea2c47" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:43.307114 32683 raft_consensus.cc:2749] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.316036 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:43.316987 32335 raft_consensus.cc:2393] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecfc475fc7344b56984a0936a43b831b in current term 1: Already voted for candidate 78099f91879a4fac821e248e77afbd0f in this term.
I20260709 13:10:43.309088 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453bddd17a4d4cdc9f5e95fa8c6cf66d" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:43.311657 32611 raft_consensus.cc:2804] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:43.321404 32333 raft_consensus.cc:3060] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.321679 32611 raft_consensus.cc:493] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.322099 32611 raft_consensus.cc:3060] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.312333 32623 tablet_bootstrap.cc:492] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f: No bootstrap required, opened a new log
I20260709 13:10:43.323472 32623 ts_tablet_manager.cc:1403] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f: Time spent bootstrapping tablet: real 0.282s	user 0.040s	sys 0.042s
I20260709 13:10:43.326257 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453bddd17a4d4cdc9f5e95fa8c6cf66d" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:43.327060 32485 raft_consensus.cc:3060] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.312747 32483 raft_consensus.cc:3060] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.330186 32676 consensus_queue.cc:1048] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.309422 32482 raft_consensus.cc:3060] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.314164 32677 leader_election.cc:290] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.332922 32648 consensus_queue.cc:1048] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.333278 32332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3817d7d3ae6341deb3968c4e838e58f2" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:43.333630 32335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453bddd17a4d4cdc9f5e95fa8c6cf66d" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d" is_pre_election: true
I20260709 13:10:43.337098 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358c677830e740bab5f0420cc2365a60" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b" is_pre_election: true
I20260709 13:10:43.346300 32484 raft_consensus.cc:2393] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 78099f91879a4fac821e248e77afbd0f in current term 1: Already voted for candidate 036a73fc2e744989b2d6be1020a7143d in this term.
I20260709 13:10:43.319952 32678 raft_consensus.cc:515] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.350669 32332 raft_consensus.cc:2393] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ecfc475fc7344b56984a0936a43b831b in current term 1: Already voted for candidate 036a73fc2e744989b2d6be1020a7143d in this term.
I20260709 13:10:43.338361 32449 leader_election.cc:304] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:43.304661 32334 raft_consensus.cc:2468] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:43.347888 32623 raft_consensus.cc:359] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.354646 32623 raft_consensus.cc:385] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:43.355196 32623 raft_consensus.cc:740] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Initialized, Role: FOLLOWER
I20260709 13:10:43.356295 32623 consensus_queue.cc:260] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.366995 32375 leader_election.cc:304] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:43.368444 32610 raft_consensus.cc:2804] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:43.369179 32610 raft_consensus.cc:697] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:43.370333 32610 consensus_queue.cc:237] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.362977 32376 leader_election.cc:304] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f; no voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:43.387480 32623 ts_tablet_manager.cc:1434] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.001s
I20260709 13:10:43.388015 32662 raft_consensus.cc:2749] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.360942 32678 leader_election.cc:290] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.354884 32485 raft_consensus.cc:2468] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:43.394362 32376 leader_election.cc:304] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:43.395373 32407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3817d7d3ae6341deb3968c4e838e58f2" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:43.396065 32407 raft_consensus.cc:3060] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.396474 32411 raft_consensus.cc:3060] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:43.396339 32611 raft_consensus.cc:515] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.398172 32662 raft_consensus.cc:2804] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:43.399495 32662 raft_consensus.cc:697] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:43.400808 32611 leader_election.cc:290] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:43.402033 32406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3817d7d3ae6341deb3968c4e838e58f2" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:43.403071 32449 leader_election.cc:304] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:43.400439 32662 consensus_queue.cc:237] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.406306 32480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3817d7d3ae6341deb3968c4e838e58f2" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:43.416162 32480 raft_consensus.cc:2393] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 036a73fc2e744989b2d6be1020a7143d in current term 1: Already voted for candidate ecfc475fc7344b56984a0936a43b831b in this term.
I20260709 13:10:43.414494 32333 raft_consensus.cc:2468] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:43.428128 32483 raft_consensus.cc:2468] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:43.436586 32670 consensus_queue.cc:1048] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.438679 32611 raft_consensus.cc:2749] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.438032 32233 catalog_manager.cc:5697] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 0 to 1, leader changed from <none> to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 1 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } }
I20260709 13:10:43.445375 32407 raft_consensus.cc:2468] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 1.
I20260709 13:10:43.445616 32332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3817d7d3ae6341deb3968c4e838e58f2" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:43.445390 32229 catalog_manager.cc:5697] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 1 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.446892 32332 raft_consensus.cc:2393] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ecfc475fc7344b56984a0936a43b831b in current term 1: Already voted for candidate 036a73fc2e744989b2d6be1020a7143d in this term.
I20260709 13:10:43.447378 32301 leader_election.cc:304] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:43.437961 32482 raft_consensus.cc:2468] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 1.
I20260709 13:10:43.448254 32670 raft_consensus.cc:2804] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:43.448918 32641 raft_consensus.cc:2749] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.453671 32670 raft_consensus.cc:697] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:43.480142 32449 leader_election.cc:304] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:43.481287 32690 raft_consensus.cc:2749] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:43.481169 32670 consensus_queue.cc:237] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.447790 32229 catalog_manager.cc:5697] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 1 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.494184 32229 catalog_manager.cc:5697] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 1 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.502254 32648 consensus_queue.cc:1048] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.603157 32231 catalog_manager.cc:5697] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 1 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.606532 32231 catalog_manager.cc:5697] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 1 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.609050 32231 catalog_manager.cc:5697] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 1 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.626699 32229 catalog_manager.cc:5697] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 0 to 1, leader changed from <none> to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 1 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.694868 32670 consensus_queue.cc:1048] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.712579 32670 consensus_queue.cc:1048] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.719254 32662 consensus_queue.cc:1048] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.746742 32662 consensus_queue.cc:1048] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.761763 32411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a96b6bab50c4c2db59aa9e2ed4b0d60"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
mode: GRACEFUL
new_leader_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:47252
I20260709 13:10:43.762531 32411 raft_consensus.cc:606] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Received request to transfer leadership to TS 036a73fc2e744989b2d6be1020a7143d
I20260709 13:10:43.764707 32670 consensus_queue.cc:1048] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.782843 32408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
mode: GRACEFUL
new_leader_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:47252
I20260709 13:10:43.783586 32408 raft_consensus.cc:606] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Received request to transfer leadership to TS 036a73fc2e744989b2d6be1020a7143d
I20260709 13:10:43.790927 32332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "358c677830e740bab5f0420cc2365a60"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
mode: GRACEFUL
new_leader_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:38938
I20260709 13:10:43.791589 32332 raft_consensus.cc:606] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Received request to transfer leadership to TS 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:43.795722 32678 consensus_queue.cc:1048] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.810003 32332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
mode: GRACEFUL
new_leader_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:38938
I20260709 13:10:43.811578 32332 raft_consensus.cc:606] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Received request to transfer leadership to TS 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:43.821092 32332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
mode: GRACEFUL
new_leader_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:38938
I20260709 13:10:43.821981 32332 raft_consensus.cc:606] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Received request to transfer leadership to TS 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:43.824981 32610 consensus_queue.cc:1048] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.832690 32411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95d6294883754288923b68421fea2c47"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
mode: GRACEFUL
new_leader_uuid: "ecfc475fc7344b56984a0936a43b831b"
 from {username='slave'} at 127.0.0.1:47252
I20260709 13:10:43.833570 32411 raft_consensus.cc:606] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Received request to transfer leadership to TS ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:43.844326 32683 consensus_queue.cc:1048] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.863535 32683 raft_consensus.cc:993] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f: : Instructing follower 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:43.864001 32610 raft_consensus.cc:1081] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Signalling peer 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:43.865625 32332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a96b6bab50c4c2db59aa9e2ed4b0d60"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:38936
I20260709 13:10:43.866120 32332 raft_consensus.cc:493] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.866508 32332 raft_consensus.cc:3060] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.872397 32332 raft_consensus.cc:515] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.874171 32332 leader_election.cc:290] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.875355 32480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96b6bab50c4c2db59aa9e2ed4b0d60" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:43.876030 32480 raft_consensus.cc:3060] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.875958 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a96b6bab50c4c2db59aa9e2ed4b0d60" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:43.876914 32408 raft_consensus.cc:3055] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.877283 32408 raft_consensus.cc:740] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:43.878018 32408 consensus_queue.cc:260] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.879009 32408 raft_consensus.cc:3060] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.881963 32480 raft_consensus.cc:2468] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:43.883208 32301 leader_election.cc:304] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:43.883924 32678 raft_consensus.cc:2804] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.884008 32408 raft_consensus.cc:2468] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:43.884413 32678 raft_consensus.cc:697] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:43.885288 32678 consensus_queue.cc:237] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.892947 32229 catalog_manager.cc:5697] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 1 to 2, leader changed from 78099f91879a4fac821e248e77afbd0f (127.20.69.2) to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 2 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.925086 32596 consensus_queue.cc:1048] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.935572 32650 consensus_queue.cc:1048] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.966872 32610 consensus_queue.cc:1048] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:43.981590 32678 raft_consensus.cc:993] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d: : Instructing follower 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:43.982088 32678 raft_consensus.cc:1081] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Signalling peer 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:43.982180 32610 consensus_queue.cc:1048] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:43.983894 32408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:47250
I20260709 13:10:43.984411 32408 raft_consensus.cc:493] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.984745 32408 raft_consensus.cc:3060] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.992022 32408 raft_consensus.cc:515] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.994621 32408 leader_election.cc:290] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:43.994699 32332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:43.995138 32610 raft_consensus.cc:993] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: : Instructing follower ecfc475fc7344b56984a0936a43b831b to start an election
I20260709 13:10:43.995474 32332 raft_consensus.cc:3055] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.995653 32610 raft_consensus.cc:1081] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Signalling peer ecfc475fc7344b56984a0936a43b831b to start an election
I20260709 13:10:43.995844 32332 raft_consensus.cc:740] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:43.996760 32480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f94f7836f82440f99059b6e7227cb71" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:43.996747 32332 consensus_queue.cc:260] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:43.997673 32485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95d6294883754288923b68421fea2c47"
dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
 from {username='slave'} at 127.0.0.1:47386
I20260709 13:10:43.997674 32480 raft_consensus.cc:3060] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.998446 32332 raft_consensus.cc:3060] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.998332 32485 raft_consensus.cc:493] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.999462 32485 raft_consensus.cc:3060] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.006532 32480 raft_consensus.cc:2468] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:44.007972 32376 leader_election.cc:304] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:44.008715 32485 raft_consensus.cc:515] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.008924 32332 raft_consensus.cc:2468] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:44.009141 32610 raft_consensus.cc:2804] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.009884 32610 raft_consensus.cc:697] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:44.010744 32610 consensus_queue.cc:237] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.017741 32485 leader_election.cc:290] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:44.018352 32332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d6294883754288923b68421fea2c47" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:44.019038 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d6294883754288923b68421fea2c47" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:44.019137 32332 raft_consensus.cc:3060] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.019863 32408 raft_consensus.cc:3055] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.019204 32232 catalog_manager.cc:5697] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 1 to 2, leader changed from 036a73fc2e744989b2d6be1020a7143d (127.20.69.1) to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 2 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.020226 32408 raft_consensus.cc:740] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:44.021080 32408 consensus_queue.cc:260] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.022269 32408 raft_consensus.cc:3060] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.027772 32332 raft_consensus.cc:2468] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 2.
I20260709 13:10:44.029230 32449 leader_election.cc:304] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:44.030112 32641 raft_consensus.cc:2804] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.030352 32408 raft_consensus.cc:2468] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 2.
I20260709 13:10:44.031317 32641 raft_consensus.cc:697] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 2 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:44.032305 32641 consensus_queue.cc:237] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.041965 32232 catalog_manager.cc:5697] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 1 to 2, leader changed from 78099f91879a4fac821e248e77afbd0f (127.20.69.2) to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 2 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:44.120386 32432 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8d80 after lost signal to thread 20759
W20260709 13:10:44.121719 32432 debug-util.cc:398] Leaking SignalData structure 0x7b0800263900 after lost signal to thread 32267
W20260709 13:10:44.122874 32432 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5880 after lost signal to thread 32360
W20260709 13:10:44.124792 32432 debug-util.cc:398] Leaking SignalData structure 0x7b080037cae0 after lost signal to thread 32509
I20260709 13:10:44.230083 32678 raft_consensus.cc:993] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d: : Instructing follower 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:44.230752 32678 raft_consensus.cc:1081] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Signalling peer 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:44.233026 32408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:47250
I20260709 13:10:44.233645 32408 raft_consensus.cc:493] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.234009 32408 raft_consensus.cc:3060] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.241768 32408 raft_consensus.cc:515] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.244024 32408 leader_election.cc:290] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:44.246008 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:44.246825 32485 raft_consensus.cc:3060] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.249329 32332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12b9ea9154f4d84ba0976bed3e2a212" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:44.250962 32332 raft_consensus.cc:3055] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.251312 32332 raft_consensus.cc:740] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:44.249688 32654 raft_consensus.cc:993] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f: : Instructing follower 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:44.252468 32654 raft_consensus.cc:1081] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Signalling peer 036a73fc2e744989b2d6be1020a7143d to start an election
I20260709 13:10:44.252158 32332 consensus_queue.cc:260] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.253716 32332 raft_consensus.cc:3060] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.254655 32333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
 from {username='slave'} at 127.0.0.1:38936
I20260709 13:10:44.255333 32333 raft_consensus.cc:493] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.255730 32333 raft_consensus.cc:3060] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.255739 32485 raft_consensus.cc:2468] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:44.257398 32376 leader_election.cc:304] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:44.258389 32610 raft_consensus.cc:2804] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.258934 32610 raft_consensus.cc:697] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:44.261858 32332 raft_consensus.cc:2468] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:44.259833 32610 consensus_queue.cc:237] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.266913 32333 raft_consensus.cc:515] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.270963 32333 leader_election.cc:290] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Requested vote from peers 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:44.272179 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:44.272478 32408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1016aba5761411b9152a0a653df6f1f" candidate_uuid: "036a73fc2e744989b2d6be1020a7143d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:44.273063 32408 raft_consensus.cc:3055] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.273401 32408 raft_consensus.cc:740] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:44.273063 32485 raft_consensus.cc:3060] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.273497 32232 catalog_manager.cc:5697] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 1 to 2, leader changed from 036a73fc2e744989b2d6be1020a7143d (127.20.69.1) to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 2 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.274222 32408 consensus_queue.cc:260] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.275462 32408 raft_consensus.cc:3060] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.281689 32485 raft_consensus.cc:2468] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:44.282528 32408 raft_consensus.cc:2468] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 036a73fc2e744989b2d6be1020a7143d in term 2.
I20260709 13:10:44.283802 32301 leader_election.cc:304] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:44.284757 32650 raft_consensus.cc:2804] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.285249 32650 raft_consensus.cc:697] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Becoming Leader. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:44.286079 32650 consensus_queue.cc:237] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.295609 32232 catalog_manager.cc:5697] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d reported cstate change: term changed from 1 to 2, leader changed from 78099f91879a4fac821e248e77afbd0f (127.20.69.2) to 036a73fc2e744989b2d6be1020a7143d (127.20.69.1). New cstate: current_term: 2 leader_uuid: "036a73fc2e744989b2d6be1020a7143d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.313067 32678 raft_consensus.cc:993] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d: : Instructing follower 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:44.313624 32650 raft_consensus.cc:1081] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Signalling peer 78099f91879a4fac821e248e77afbd0f to start an election
I20260709 13:10:44.315222 32408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "358c677830e740bab5f0420cc2365a60"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
 from {username='slave'} at 127.0.0.1:47250
I20260709 13:10:44.315672 32408 raft_consensus.cc:493] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.315949 32408 raft_consensus.cc:3060] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.320426 32408 raft_consensus.cc:515] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.322068 32408 leader_election.cc:290] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), ecfc475fc7344b56984a0936a43b831b (127.20.69.3:42077)
I20260709 13:10:44.322839 32333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358c677830e740bab5f0420cc2365a60" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:44.323329 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "358c677830e740bab5f0420cc2365a60" candidate_uuid: "78099f91879a4fac821e248e77afbd0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
I20260709 13:10:44.323558 32333 raft_consensus.cc:3055] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.323904 32333 raft_consensus.cc:740] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:44.323947 32485 raft_consensus.cc:3060] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.324769 32333 consensus_queue.cc:260] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.326037 32333 raft_consensus.cc:3060] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.332836 32333 raft_consensus.cc:2468] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:44.334100 32375 leader_election.cc:304] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f; no voters: 
I20260709 13:10:44.334991 32610 raft_consensus.cc:2804] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.334830 32485 raft_consensus.cc:2468] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78099f91879a4fac821e248e77afbd0f in term 2.
I20260709 13:10:44.335601 32610 raft_consensus.cc:697] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Becoming Leader. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:44.336511 32610 consensus_queue.cc:237] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:44.341826 32408 raft_consensus.cc:1275] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.344394 32650 consensus_queue.cc:1048] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:44.350592 32232 catalog_manager.cc:5697] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f reported cstate change: term changed from 1 to 2, leader changed from 036a73fc2e744989b2d6be1020a7143d (127.20.69.1) to 78099f91879a4fac821e248e77afbd0f (127.20.69.2). New cstate: current_term: 2 leader_uuid: "78099f91879a4fac821e248e77afbd0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.353973 32485 raft_consensus.cc:1275] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.356803 32596 consensus_queue.cc:1048] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.521626 32480 raft_consensus.cc:1275] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.523284 32654 consensus_queue.cc:1048] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.536923 32333 raft_consensus.cc:1275] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.539566 32683 consensus_queue.cc:1048] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.614058 32333 raft_consensus.cc:1275] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Refusing update from remote peer ecfc475fc7344b56984a0936a43b831b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.615478 32641 consensus_queue.cc:1048] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.626545 32408 raft_consensus.cc:1275] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Refusing update from remote peer ecfc475fc7344b56984a0936a43b831b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.628350 32641 consensus_queue.cc:1048] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:44.679956 32480 raft_consensus.cc:1275] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.681489 32683 consensus_queue.cc:1048] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.690248 32333 raft_consensus.cc:1275] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.692091 32654 consensus_queue.cc:1048] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.710755 32480 raft_consensus.cc:1275] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.713673 32596 consensus_queue.cc:1048] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:44.723905 32408 raft_consensus.cc:1275] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Refusing update from remote peer 036a73fc2e744989b2d6be1020a7143d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.727958 32485 raft_consensus.cc:1275] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.730393 32610 consensus_queue.cc:1048] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:44.733280 32681 consensus_queue.cc:1048] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:44.743993 32333 raft_consensus.cc:1275] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Refusing update from remote peer 78099f91879a4fac821e248e77afbd0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.745594 32683 consensus_queue.cc:1048] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:46.837184 32232 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42784:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:46.861356 32232 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42784:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:47.008942 32760 tablet.cc:1724] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.026481 32764 tablet.cc:1724] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.029202 32762 tablet.cc:1724] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.098946 32752 tablet.cc:1724] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.121892 32763 tablet.cc:1724] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.127326 32761 tablet.cc:1724] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.162247 32764 tablet.cc:1724] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.171868   301 tablet.cc:1724] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.180845   305 tablet.cc:1724] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.178841 32762 tablet.cc:1724] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:47.258456   308 log.cc:927] Time spent T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:10:47.288235 20756 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:47.302974   306 tablet.cc:1724] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:47.317698   307 log.cc:927] Time spent T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:10:47.316640 32753 tablet.cc:1724] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.324417   301 tablet.cc:1724] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.401590 32752 tablet.cc:1724] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:47.382954 32375 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.1:35077, user_credentials={real_user=slave}} blocked reactor thread for 61521.2us
I20260709 13:10:47.417070   314 tablet.cc:1724] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.419612   315 tablet.cc:1724] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:47.460704 32376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.69.3:42077, user_credentials={real_user=slave}} blocked reactor thread for 110964us
I20260709 13:10:47.481858   305 tablet.cc:1724] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.492375   306 tablet.cc:1724] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.526738 32753 tablet.cc:1724] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.527905 32763 tablet.cc:1724] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.555063   305 tablet.cc:1724] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.529292 32761 tablet.cc:1724] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.530445   314 tablet.cc:1724] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.534066 32752 tablet.cc:1724] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.536527 32760 tablet.cc:1724] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.538777 32764 tablet.cc:1724] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.540405 32232 catalog_manager.cc:5789] TS 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877) does not have the latest schema for tablet 4f94f7836f82440f99059b6e7227cb71 (table soft_deleted_table [id=48e216c377704c19a923365243952162]). Expected version 1 got 0
I20260709 13:10:47.579191   315 tablet.cc:1724] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:47.587607 32411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5"
dest_uuid: "78099f91879a4fac821e248e77afbd0f"
mode: GRACEFUL
new_leader_uuid: "ecfc475fc7344b56984a0936a43b831b"
 from {username='slave'} at 127.0.0.1:51276
I20260709 13:10:47.588676 32411 raft_consensus.cc:606] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Received request to transfer leadership to TS ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:47.644810 32232 catalog_manager.cc:6242] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63: soft_deleted_table [id=48e216c377704c19a923365243952162] alter complete (version 1)
I20260709 13:10:47.659188 32332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8"
dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
mode: GRACEFUL
new_leader_uuid: "ecfc475fc7344b56984a0936a43b831b"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:10:47.659896 32332 raft_consensus.cc:606] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Received request to transfer leadership to TS ecfc475fc7344b56984a0936a43b831b
I20260709 13:10:47.661571 20756 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:47.662128 20756 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:47.802711 32755 raft_consensus.cc:993] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d: : Instructing follower ecfc475fc7344b56984a0936a43b831b to start an election
I20260709 13:10:47.803570 32758 raft_consensus.cc:1081] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Signalling peer ecfc475fc7344b56984a0936a43b831b to start an election
I20260709 13:10:47.805737 32481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8"
dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
 from {username='slave'} at 127.0.0.1:47396
I20260709 13:10:47.806409 32481 raft_consensus.cc:493] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.806789 32481 raft_consensus.cc:3060] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.815275 32481 raft_consensus.cc:515] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:47.817293 32481 leader_election.cc:290] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:47.818451 32332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:47.818971 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff08ecb1bf24a3aa812cbcfd2889fa8" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:47.819399 32332 raft_consensus.cc:3055] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.819653 32411 raft_consensus.cc:3060] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.819787 32332 raft_consensus.cc:740] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 036a73fc2e744989b2d6be1020a7143d, State: Running, Role: LEADER
I20260709 13:10:47.820844 32332 consensus_queue.cc:260] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:47.822593 32332 raft_consensus.cc:3060] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.829073 32411 raft_consensus.cc:2468] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 2.
I20260709 13:10:47.830814 32450 leader_election.cc:304] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78099f91879a4fac821e248e77afbd0f, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:47.831138 32332 raft_consensus.cc:2468] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 2.
I20260709 13:10:47.832140 32726 raft_consensus.cc:2804] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.832703 32726 raft_consensus.cc:697] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 2 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:47.833695 32726 consensus_queue.cc:237] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:47.843924 32233 catalog_manager.cc:5697] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 1 to 2, leader changed from 036a73fc2e744989b2d6be1020a7143d (127.20.69.1) to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 2 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.016966 32731 raft_consensus.cc:993] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f: : Instructing follower ecfc475fc7344b56984a0936a43b831b to start an election
I20260709 13:10:48.017556   302 raft_consensus.cc:1081] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Signalling peer ecfc475fc7344b56984a0936a43b831b to start an election
I20260709 13:10:48.019376 32483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5"
dest_uuid: "ecfc475fc7344b56984a0936a43b831b"
 from {username='slave'} at 127.0.0.1:47386
I20260709 13:10:48.020145 32483 raft_consensus.cc:493] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:48.020583 32483 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.031255 32483 raft_consensus.cc:515] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:48.034016 32483 leader_election.cc:290] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 election: Requested vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:48.034718 32332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "036a73fc2e744989b2d6be1020a7143d"
I20260709 13:10:48.035473 32332 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.035333 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117c41c87d814f27bbd17ebf7b0d2ad5" candidate_uuid: "ecfc475fc7344b56984a0936a43b831b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "78099f91879a4fac821e248e77afbd0f"
I20260709 13:10:48.036288 32411 raft_consensus.cc:3055] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:48.036779 32411 raft_consensus.cc:740] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 78099f91879a4fac821e248e77afbd0f, State: Running, Role: LEADER
I20260709 13:10:48.037868 32411 consensus_queue.cc:260] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:48.039602 32411 raft_consensus.cc:3060] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.042050 32332 raft_consensus.cc:2468] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 3.
I20260709 13:10:48.043529 32449 leader_election.cc:304] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 036a73fc2e744989b2d6be1020a7143d, ecfc475fc7344b56984a0936a43b831b; no voters: 
I20260709 13:10:48.044330 32726 raft_consensus.cc:2804] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:48.044960 32726 raft_consensus.cc:697] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 3 LEADER]: Becoming Leader. State: Replica: ecfc475fc7344b56984a0936a43b831b, State: Running, Role: LEADER
I20260709 13:10:48.045903 32726 consensus_queue.cc:237] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:48.048971 32411 raft_consensus.cc:2468] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfc475fc7344b56984a0936a43b831b in term 3.
I20260709 13:10:48.055565 32233 catalog_manager.cc:5697] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b reported cstate change: term changed from 2 to 3, leader changed from 78099f91879a4fac821e248e77afbd0f (127.20.69.2) to ecfc475fc7344b56984a0936a43b831b (127.20.69.3). New cstate: current_term: 3 leader_uuid: "ecfc475fc7344b56984a0936a43b831b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.386656 32411 raft_consensus.cc:1275] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Refusing update from remote peer ecfc475fc7344b56984a0936a43b831b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.388224 32726 consensus_queue.cc:1048] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.398887 32332 raft_consensus.cc:1275] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Refusing update from remote peer ecfc475fc7344b56984a0936a43b831b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.408849 32726 consensus_queue.cc:1048] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.528865 32411 raft_consensus.cc:1275] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 3 FOLLOWER]: Refusing update from remote peer ecfc475fc7344b56984a0936a43b831b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:48.530783   310 consensus_queue.cc:1048] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:48.546224 32332 raft_consensus.cc:1275] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 3 FOLLOWER]: Refusing update from remote peer ecfc475fc7344b56984a0936a43b831b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:48.551367   310 consensus_queue.cc:1048] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [LEADER]: Connected to new peer: Peer: permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.735008 20756 tablet_server.cc:179] TabletServer@127.20.69.1:0 shutting down...
I20260709 13:10:48.780802 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:48.781759 20756 tablet_replica.cc:333] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.782708 20756 raft_consensus.cc:2243] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.783282 20756 raft_consensus.cc:2272] T 95d6294883754288923b68421fea2c47 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.786502 20756 tablet_replica.cc:333] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.787258 20756 raft_consensus.cc:2243] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:48.788182 20756 raft_consensus.cc:2272] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.790969 20756 tablet_replica.cc:333] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.791697 20756 raft_consensus.cc:2243] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.792356 20756 raft_consensus.cc:2272] T 4f94f7836f82440f99059b6e7227cb71 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.794842 20756 tablet_replica.cc:333] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.795547 20756 raft_consensus.cc:2243] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.796147 20756 raft_consensus.cc:2272] T 358c677830e740bab5f0420cc2365a60 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.798789 20756 tablet_replica.cc:333] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.799436 20756 raft_consensus.cc:2243] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.799890 20756 raft_consensus.cc:2272] T 7f4ba051e42149f5a5e24e8129e735b5 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.802991 20756 tablet_replica.cc:333] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
W20260709 13:10:48.803030 32375 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:10:48.803767 20756 raft_consensus.cc:2243] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.804457 20756 raft_consensus.cc:2272] T b12b9ea9154f4d84ba0976bed3e2a212 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:48.806779 32375 consensus_peers.cc:597] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.807536 20756 tablet_replica.cc:333] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.808218 20756 raft_consensus.cc:2243] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:48.809132 20756 raft_consensus.cc:2272] T b1016aba5761411b9152a0a653df6f1f P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.811583 20756 tablet_replica.cc:333] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.812315 20756 raft_consensus.cc:2243] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:48.813210 20756 raft_consensus.cc:2272] T 3d3a433578c1432ca8ddc36094708b16 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.815573 20756 tablet_replica.cc:333] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.816301 20756 raft_consensus.cc:2243] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.816855 20756 raft_consensus.cc:2272] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 036a73fc2e744989b2d6be1020a7143d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.819926 20756 tablet_replica.cc:333] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.820618 20756 raft_consensus.cc:2243] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.821185 20756 raft_consensus.cc:2272] T 53502e0413404888895b5f18672ad837 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.823678 20756 tablet_replica.cc:333] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.824302 20756 raft_consensus.cc:2243] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.824918 20756 raft_consensus.cc:2272] T 3ea241c8fe8746498950fdc7e74a22b0 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.827288 20756 tablet_replica.cc:333] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.827872 20756 raft_consensus.cc:2243] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.828342 20756 raft_consensus.cc:2272] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.830706 20756 tablet_replica.cc:333] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.831310 20756 raft_consensus.cc:2243] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.831760 20756 raft_consensus.cc:2272] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.834661 20756 tablet_replica.cc:333] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.835312 20756 raft_consensus.cc:2243] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:48.836257 20756 raft_consensus.cc:2272] T 22257a12f6e040709c74744a0a217635 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.839318 20756 tablet_replica.cc:333] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.840082 20756 raft_consensus.cc:2243] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:48.841244 20756 raft_consensus.cc:2272] T 05d375a7dec54a619b40fe4a08f5ea74 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.844177 20756 tablet_replica.cc:333] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.844831 20756 raft_consensus.cc:2243] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:48.845803 20756 raft_consensus.cc:2272] T 3817d7d3ae6341deb3968c4e838e58f2 P 036a73fc2e744989b2d6be1020a7143d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.848240 20756 tablet_replica.cc:333] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.848870 20756 raft_consensus.cc:2243] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:48.850018 20756 raft_consensus.cc:2272] T a3b20b75a2b24d619d7b7c190a19e591 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.853328 20756 tablet_replica.cc:333] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d: stopping tablet replica
I20260709 13:10:48.854007 20756 raft_consensus.cc:2243] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:48.853941 32375 consensus_peers.cc:597] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.854811 20756 raft_consensus.cc:2272] T ae711578b5fb49a4a884c3c7c15a4eb9 P 036a73fc2e744989b2d6be1020a7143d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.903558 20756 tablet_server.cc:196] TabletServer@127.20.69.1:0 shutdown complete.
W20260709 13:10:48.910691 32375 consensus_peers.cc:597] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:48.962000 32449 consensus_peers.cc:597] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.964996 20756 tablet_server.cc:179] TabletServer@127.20.69.2:0 shutting down...
W20260709 13:10:48.975019 32375 consensus_peers.cc:597] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:48.992746 32375 consensus_peers.cc:597] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:48.994648 32449 consensus_peers.cc:597] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.012326 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:49.013506 20756 tablet_replica.cc:333] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.014726 20756 raft_consensus.cc:2243] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.015514 20756 raft_consensus.cc:2272] T 95d6294883754288923b68421fea2c47 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.018965 20756 tablet_replica.cc:333] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.019909 20756 raft_consensus.cc:2243] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:49.019999 32450 consensus_peers.cc:597] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b -> Peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Couldn't send request to peer 78099f91879a4fac821e248e77afbd0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.021070 20756 raft_consensus.cc:2272] T 358c677830e740bab5f0420cc2365a60 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.024533 20756 tablet_replica.cc:333] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.025733 20756 raft_consensus.cc:2243] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:49.026924 20756 raft_consensus.cc:2272] T 4f94f7836f82440f99059b6e7227cb71 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.030229 20756 tablet_replica.cc:333] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.031085 20756 raft_consensus.cc:2243] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:49.032227 20756 raft_consensus.cc:2272] T 3ea241c8fe8746498950fdc7e74a22b0 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:49.032866 32449 consensus_peers.cc:597] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.034898 20756 tablet_replica.cc:333] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.035678 20756 raft_consensus.cc:2243] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:49.036540 20756 raft_consensus.cc:2272] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.038997 20756 tablet_replica.cc:333] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.039709 20756 raft_consensus.cc:2243] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.040179 20756 raft_consensus.cc:2272] T cff08ecb1bf24a3aa812cbcfd2889fa8 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.043355 20756 tablet_replica.cc:333] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.043958 20756 raft_consensus.cc:2243] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.044466 20756 raft_consensus.cc:2272] T 53502e0413404888895b5f18672ad837 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.046944 20756 tablet_replica.cc:333] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.047647 20756 raft_consensus.cc:2243] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.048254 20756 raft_consensus.cc:2272] T b1016aba5761411b9152a0a653df6f1f P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.050978 20756 tablet_replica.cc:333] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.051625 20756 raft_consensus.cc:2243] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.052103 20756 raft_consensus.cc:2272] T 117c41c87d814f27bbd17ebf7b0d2ad5 P 78099f91879a4fac821e248e77afbd0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.054961 20756 tablet_replica.cc:333] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.055626 20756 raft_consensus.cc:2243] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.056162 20756 raft_consensus.cc:2272] T 3d3a433578c1432ca8ddc36094708b16 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.058490 20756 tablet_replica.cc:333] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.059068 20756 raft_consensus.cc:2243] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:49.059962 20756 raft_consensus.cc:2272] T ae711578b5fb49a4a884c3c7c15a4eb9 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.062294 20756 tablet_replica.cc:333] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.063005 20756 raft_consensus.cc:2243] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.063673 20756 raft_consensus.cc:2272] T 3817d7d3ae6341deb3968c4e838e58f2 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.067342 20756 tablet_replica.cc:333] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.068231 20756 raft_consensus.cc:2243] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.068897 20756 raft_consensus.cc:2272] T a3b20b75a2b24d619d7b7c190a19e591 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.072026 20756 tablet_replica.cc:333] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.072897 20756 raft_consensus.cc:2243] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:49.074095 20756 raft_consensus.cc:2272] T b12b9ea9154f4d84ba0976bed3e2a212 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.077409 20756 tablet_replica.cc:333] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.078302 20756 raft_consensus.cc:2243] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:49.079617 20756 raft_consensus.cc:2272] T 7f4ba051e42149f5a5e24e8129e735b5 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.083029 20756 tablet_replica.cc:333] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.083897 20756 raft_consensus.cc:2243] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.084643 20756 raft_consensus.cc:2272] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.088011 20756 tablet_replica.cc:333] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.088850 20756 raft_consensus.cc:2243] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.089452 20756 raft_consensus.cc:2272] T 05d375a7dec54a619b40fe4a08f5ea74 P 78099f91879a4fac821e248e77afbd0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:49.092675 20756 tablet_replica.cc:333] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f: stopping tablet replica
I20260709 13:10:49.093384 20756 raft_consensus.cc:2243] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:49.093984 20756 raft_consensus.cc:2272] T 22257a12f6e040709c74744a0a217635 P 78099f91879a4fac821e248e77afbd0f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:49.220150 32450 consensus_peers.cc:597] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b -> Peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Couldn't send request to peer 78099f91879a4fac821e248e77afbd0f. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:49.226339 32449 consensus_peers.cc:597] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b -> Peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Couldn't send request to peer 036a73fc2e744989b2d6be1020a7143d. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:49.327865 32450 consensus_peers.cc:597] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b -> Peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Couldn't send request to peer 78099f91879a4fac821e248e77afbd0f. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:49.467299 32450 consensus_peers.cc:597] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b -> Peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Couldn't send request to peer 78099f91879a4fac821e248e77afbd0f. Status: Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.802783   332 raft_consensus.cc:493] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 036a73fc2e744989b2d6be1020a7143d)
I20260709 13:10:49.803419   332 raft_consensus.cc:515] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:49.805805   332 leader_election.cc:290] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:49.813593 32449 leader_election.cc:336] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:49.816146 32450 leader_election.cc:336] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:49.816553 32450 leader_election.cc:304] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:49.817389 32726 raft_consensus.cc:2749] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.882136 32726 raft_consensus.cc:493] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 036a73fc2e744989b2d6be1020a7143d)
I20260709 13:10:49.882640 32726 raft_consensus.cc:515] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:49.884713 32726 leader_election.cc:290] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:49.888686 32449 leader_election.cc:336] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
I20260709 13:10:49.889170 32726 raft_consensus.cc:493] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 036a73fc2e744989b2d6be1020a7143d)
W20260709 13:10:49.889413 32450 leader_election.cc:336] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:49.889804 32726 raft_consensus.cc:515] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:49.890029 32450 leader_election.cc:304] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:49.890841   332 raft_consensus.cc:2749] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.891939 32726 leader_election.cc:290] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:49.896095 32449 leader_election.cc:336] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:49.897092 32450 leader_election.cc:336] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:49.897434 32450 leader_election.cc:304] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:49.898033 32726 raft_consensus.cc:2749] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.021049 32726 raft_consensus.cc:493] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 036a73fc2e744989b2d6be1020a7143d)
I20260709 13:10:50.021595 32726 raft_consensus.cc:515] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:50.023720 32726 leader_election.cc:290] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:50.028151 32450 leader_election.cc:336] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
W20260709 13:10:50.028927 32449 leader_election.cc:336] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
I20260709 13:10:50.029307 32449 leader_election.cc:304] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:50.029938 32726 raft_consensus.cc:2749] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.074424 32726 raft_consensus.cc:493] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 036a73fc2e744989b2d6be1020a7143d)
I20260709 13:10:50.075033 32726 raft_consensus.cc:515] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } }
I20260709 13:10:50.077018 32726 leader_election.cc:290] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
I20260709 13:10:50.078167 32726 raft_consensus.cc:493] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 036a73fc2e744989b2d6be1020a7143d)
I20260709 13:10:50.078835 32726 raft_consensus.cc:515] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:50.081796 32726 leader_election.cc:290] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:50.083030 32449 leader_election.cc:336] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:50.083602 32450 leader_election.cc:336] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:50.084115 32450 leader_election.cc:304] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:50.084931 32726 raft_consensus.cc:2749] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:50.085763 32449 leader_election.cc:336] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:50.087281 32450 leader_election.cc:336] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:50.087678 32450 leader_election.cc:304] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:50.088315 32726 raft_consensus.cc:2749] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.104952 32726 raft_consensus.cc:493] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 036a73fc2e744989b2d6be1020a7143d)
I20260709 13:10:50.105618 32726 raft_consensus.cc:515] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:50.108214 32726 leader_election.cc:290] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:50.112416 32449 leader_election.cc:336] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:50.113214 32450 leader_election.cc:336] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:50.113585 32450 leader_election.cc:304] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:50.114238 32726 raft_consensus.cc:2749] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:50.146070 20756 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 32432)
I20260709 13:10:50.175997 32726 raft_consensus.cc:493] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 78099f91879a4fac821e248e77afbd0f)
I20260709 13:10:50.176757 32726 raft_consensus.cc:515] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:50.179394 32726 leader_election.cc:290] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:50.183838 32449 leader_election.cc:336] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:50.184484 32450 leader_election.cc:336] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:50.184929 32450 leader_election.cc:304] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:50.185593 32726 raft_consensus.cc:2749] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.203540 32726 raft_consensus.cc:493] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 78099f91879a4fac821e248e77afbd0f)
I20260709 13:10:50.204190 32726 raft_consensus.cc:515] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:50.206800 32726 leader_election.cc:290] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:50.210678 32449 leader_election.cc:336] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:50.211303 32450 leader_election.cc:336] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:50.211658 32450 leader_election.cc:304] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:50.212390 32726 raft_consensus.cc:2749] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.212985   310 raft_consensus.cc:493] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 78099f91879a4fac821e248e77afbd0f)
I20260709 13:10:50.213532   310 raft_consensus.cc:515] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:50.215363   310 leader_election.cc:290] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:50.219583 32449 leader_election.cc:336] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:50.220233 32450 leader_election.cc:336] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:50.220636 32450 leader_election.cc:304] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:50.221282   310 raft_consensus.cc:2749] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.330614 20756 tablet_server.cc:196] TabletServer@127.20.69.2:0 shutdown complete.
I20260709 13:10:50.341375   310 raft_consensus.cc:493] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 78099f91879a4fac821e248e77afbd0f)
I20260709 13:10:50.342092   310 raft_consensus.cc:515] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "036a73fc2e744989b2d6be1020a7143d" member_type: VOTER last_known_addr { host: "127.20.69.1" port: 35077 } } peers { permanent_uuid: "78099f91879a4fac821e248e77afbd0f" member_type: VOTER last_known_addr { host: "127.20.69.2" port: 40877 } } peers { permanent_uuid: "ecfc475fc7344b56984a0936a43b831b" member_type: VOTER last_known_addr { host: "127.20.69.3" port: 42077 } }
I20260709 13:10:50.344322   310 leader_election.cc:290] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077), 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877)
W20260709 13:10:50.349068 32449 leader_election.cc:336] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 036a73fc2e744989b2d6be1020a7143d (127.20.69.1:35077): Network error: Client connection negotiation failed: client connection to 127.20.69.1:35077: connect: Connection refused (error 111)
W20260709 13:10:50.349756 32450 leader_election.cc:336] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 78099f91879a4fac821e248e77afbd0f (127.20.69.2:40877): Network error: Client connection negotiation failed: client connection to 127.20.69.2:40877: connect: Connection refused (error 111)
I20260709 13:10:50.350164 32450 leader_election.cc:304] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ecfc475fc7344b56984a0936a43b831b; no voters: 036a73fc2e744989b2d6be1020a7143d, 78099f91879a4fac821e248e77afbd0f
I20260709 13:10:50.350857   310 raft_consensus.cc:2749] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.371251 20756 tablet_server.cc:179] TabletServer@127.20.69.3:0 shutting down...
I20260709 13:10:50.408382 20756 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:50.409171 20756 tablet_replica.cc:333] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.409857 20756 raft_consensus.cc:2243] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.410719 20756 raft_consensus.cc:2272] T 95d6294883754288923b68421fea2c47 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.413040 20756 tablet_replica.cc:333] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.413651 20756 raft_consensus.cc:2243] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.414111 20756 raft_consensus.cc:2272] T 358c677830e740bab5f0420cc2365a60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.416186 20756 tablet_replica.cc:333] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.416793 20756 raft_consensus.cc:2243] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.417259 20756 raft_consensus.cc:2272] T 6a96b6bab50c4c2db59aa9e2ed4b0d60 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.419348 20756 tablet_replica.cc:333] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.419917 20756 raft_consensus.cc:2243] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.420382 20756 raft_consensus.cc:2272] T 4f94f7836f82440f99059b6e7227cb71 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.422341 20756 tablet_replica.cc:333] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.422932 20756 raft_consensus.cc:2243] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.423417 20756 raft_consensus.cc:2272] T b12b9ea9154f4d84ba0976bed3e2a212 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.425669 20756 tablet_replica.cc:333] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.426258 20756 raft_consensus.cc:2243] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.426746 20756 raft_consensus.cc:2272] T 7f4ba051e42149f5a5e24e8129e735b5 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.428889 20756 tablet_replica.cc:333] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.429483 20756 raft_consensus.cc:2243] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.429970 20756 raft_consensus.cc:2272] T b1016aba5761411b9152a0a653df6f1f P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.432111 20756 tablet_replica.cc:333] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.432793 20756 raft_consensus.cc:2243] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.433277 20756 raft_consensus.cc:2272] T 3d3a433578c1432ca8ddc36094708b16 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.435446 20756 tablet_replica.cc:333] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.435999 20756 raft_consensus.cc:2243] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.436901 20756 raft_consensus.cc:2272] T 117c41c87d814f27bbd17ebf7b0d2ad5 P ecfc475fc7344b56984a0936a43b831b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.438877 20756 tablet_replica.cc:333] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.439435 20756 raft_consensus.cc:2243] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.440233 20756 raft_consensus.cc:2272] T 53502e0413404888895b5f18672ad837 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.442384 20756 tablet_replica.cc:333] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.442953 20756 raft_consensus.cc:2243] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.443437 20756 raft_consensus.cc:2272] T 3ea241c8fe8746498950fdc7e74a22b0 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.445569 20756 tablet_replica.cc:333] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.446091 20756 raft_consensus.cc:2243] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.446563 20756 raft_consensus.cc:2272] T 453bddd17a4d4cdc9f5e95fa8c6cf66d P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.448508 20756 tablet_replica.cc:333] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.449079 20756 raft_consensus.cc:2243] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.449903 20756 raft_consensus.cc:2272] T cff08ecb1bf24a3aa812cbcfd2889fa8 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.452685 20756 tablet_replica.cc:333] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.453365 20756 raft_consensus.cc:2243] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.453824 20756 raft_consensus.cc:2272] T 22257a12f6e040709c74744a0a217635 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.455988 20756 tablet_replica.cc:333] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.456481 20756 raft_consensus.cc:2243] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.456970 20756 raft_consensus.cc:2272] T 05d375a7dec54a619b40fe4a08f5ea74 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.459055 20756 tablet_replica.cc:333] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.459600 20756 raft_consensus.cc:2243] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.460084 20756 raft_consensus.cc:2272] T ae711578b5fb49a4a884c3c7c15a4eb9 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.462389 20756 tablet_replica.cc:333] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.462954 20756 raft_consensus.cc:2243] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.463457 20756 raft_consensus.cc:2272] T 3817d7d3ae6341deb3968c4e838e58f2 P ecfc475fc7344b56984a0936a43b831b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.465857 20756 tablet_replica.cc:333] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b: stopping tablet replica
I20260709 13:10:50.466342 20756 raft_consensus.cc:2243] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.466846 20756 raft_consensus.cc:2272] T a3b20b75a2b24d619d7b7c190a19e591 P ecfc475fc7344b56984a0936a43b831b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.508316 20756 tablet_server.cc:196] TabletServer@127.20.69.3:0 shutdown complete.
I20260709 13:10:50.544209 20756 master.cc:562] Master@127.20.69.62:41817 shutting down...
I20260709 13:10:50.570065 20756 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.570698 20756 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.571066 20756 tablet_replica.cc:333] T 00000000000000000000000000000000 P aafc98a4e2384f0cbd28865a18664e63: stopping tablet replica
I20260709 13:10:50.592881 20756 master.cc:584] Master@127.20.69.62:41817 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (13844 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26541 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (343606 ms total)
[  PASSED  ] 8 tests.
I20260709 13:10:50.648255 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 477 messages since previous log ~16 seconds ago
I20260709 13:10:50.648516 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 476 messages since previous log ~16 seconds ago
I20260709 13:10:50.648797 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 469 messages since previous log ~16 seconds ago
I20260709 13:10:50.649034 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:10:50.649235 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:10:50.649447 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~80 seconds ago
I20260709 13:10:50.649658 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 10 messages since previous log ~188 seconds ago
I20260709 13:10:50.649928 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 51 messages since previous log ~1 seconds ago
I20260709 13:10:50.650249 20756 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~8 seconds ago
